Abstract: A method for generating an effect video, an apparatus for generating an effect video, an electronic device, and a storage medium are provided by embodiments of the present disclosure. The method includes: obtaining, in response to detecting that an effect generation condition is met, at least two video frames to be processed which are associated with a current moment; generating a target face dynamic image based on a face image of a target object in the at least two video frames to be processed, and blending the target face dynamic image into a target effect to obtain a target effect image; and determining an effect video frame in a target effect video based on the target effect image and a video frame to be processed which corresponds to the current moment.

Abstract: A display device (1), a container system, and a method for controlling the display device (1) are provided. The display device (1) includes: a display screen (10) including a display surface (101) and a back surface (102) opposite to the display surface (101); a depth camera component (11) configured to obtain image information in front of the display screen (10) in real time, the image information including distance information between a user and the display screen; and a processing component (12) electrically connected to the depth camera component (11) and configured to control switching of display content and/or format of the display screen (10) according to the distance information between the user and the display screen (10) determined by means of the obtained image information.

Abstract: A tactile feedback system is provided, including a fixed part, a movable part, and a driving assembly. The fixed part is affixed to an electronic device. The movable part can move relative to the fixed part. The driving assembly is configured to drive the movable part to move relative to the fixed part, thereby generating a tactile feedback force to a user.

Abstract: A pen-shaped input and/or output device and a method for generating a haptic signal are disclosed. In an embodiment a device includes an actuator unit comprising a piezoelectric actuator, wherein the device is a pen-shaped input and/or output device, and wherein the pen-shaped input and/or output device is configured to determine an acceleration based on voltages recorded by the piezoelectric actuator.

Abstract: Disclosed are an electronic apparatus, a display apparatus and a method of controlling the same an electronic apparatus, a display apparatus and a method of controlling the same, the electronic apparatus including: a speaker configured to output a sound; a microphone configured to receive a user voice; a communicator configured to perform communication; a processor configured to: identify a state of an external apparatus through the communicator based on reception of the user voice, process the received user voice and output a sound corresponding to a process result through the speaker based on identification that the external apparatus is in a turned-off state, and control the communicator to transmit information about the received user voice to the external apparatus and request the external apparatus to process the voice based on identification that the external apparatus is in a turned-on state.

Abstract: In an embodiment, a computer-implemented method for decoding neural activity is provided. In the method, at least one machine learning model is trained using a training data set of EEG data and concurrently collected environmental data collected from data collection participants. Once the at least one machine learning model is trained, EEG data measured from sensors attached to or near a user's head is received. Environmental data describing stimulus the user is exposed to concurrently with the measurement of the EEG data is also received. The EEG data and the environmental data is input into the at least one machine learning model to determine an inference related to the neural activity. Based on the inference, an operation of a computer program is altered.

Abstract: The present disclosure discloses a glove and a hand gesture recognition method, device, and apparatus, which are applied to the technical field of intelligent wearable devices. The glove includes a fabric-based pressure sensor configured to collect sensor information corresponding to a pressure of respective glove knitting positions, wherein the glove knitting positions include finger joint positions; and a data processing and transmitting module connected to the fabric-based pressure sensor and configured to obtain pressure information corresponding to the sensor information and transmit the pressure information to the hand gesture recognition apparatus.

Abstract: An acoustic device includes a detection unit configured to detect a timing to transition to each of a first power-saving mode and a second power-saving mode, a battery, a monitoring unit configured to monitor a remaining capacity of the battery, a signal processing unit configured to process a sound signal, a sound emitting unit configured to acoustically output the processed sound signal, a communication unit configured to transmit and receive a signal to and from a communication terminal and transmit the processed sound signal to the communication terminal, and a control unit configured to stop an operation of the signal processing unit based on the detection of the timing to transition to the first power-saving mode.

Abstract: An information processing apparatus includes a processor configured to, in displaying an operator on a display screen laminated with an operation surface in an image display device on which a contact operation of operating the operator displayed on the display screen in a state where an instruction object is in contact with the operation surface, and a contactless operation of operating the operator displayed on the display screen in a state where the instruction object is within a preset height range from the operation surface can be performed, acquire information about a height from the operation surface to the instruction object, in a case where the instruction object is not in contact with the operation surface and a distance in which the instruction object is separated from the height range in a height direction is within a preset distance, display an operator for the contactless operation and an operator for the contact operation in a superimposed manner on the display screen, and in a case where the in

Abstract: A method (200) of reconfiguring a telecommunications network (100), the telecommunications network being configured to facilitate telehaptic communication with a User Equipment (UE) (110), the method comprising the steps of: processing a network communication so as to determine a likelihood of future telehaptic communication with the UE (230); determining that said likelihood of future telehaptic communication exceeds a threshold value (240); and in response to said determining, reconfiguring the telecommunications network so as to improve network performance for the UE (250).

Abstract: Embodiments of the present disclosure provide a positioning method and apparatus, a device, and a storage medium, the method is applied to a wearable display device, where the wearable display device includes a display host and a peripheral, the display host and/or the peripheral are used for projecting a structure light image onto an object in a real environment, and the method includes: acquiring an image obtained by the display host shooting the object, and an image obtained by the peripheral shooting the object; and determining, according to image obtained by shooting and the structure light image, a pose of the peripheral relative to the display host.

Abstract: According to one aspect, systems, methods, and/or techniques associated with operator take-over prediction may include receiving a two-channel series of images of an operating environment through which a vehicle is travelling. A first series of images may be represented by labels corresponding to classified objects. A second series of images may be represented as a gaze heatmap or an eye tracking heatmap. Additionally, feeding encoded series of images through a three-dimensional (3D) convolutional neural network (CNN) to produce a first output, receiving sets of information corresponding to a first series of images and a second series of images in time, feeding sets of information through processing layers to produce additional outputs, concatenating the first output and the additional outputs to produce a concatenation output, and feeding the concatenation output through additional processing layers to generate an operator take-over prediction may be performed.

Abstract: A method includes obtaining a gesture sample via a gesture classifier. The gesture sample includes parameters of features extracted from the radar signals based on user motion in performance of a gesture. The method includes determining whether to obtain feedback for a target gesture associated with the gesture sample. The method includes in response to a determination to obtain the feedback, obtaining the feedback for the target gesture. The feedback includes a label indicating a type of gesture. The method includes determining whether the gesture sample associated with the label is valid based on comparison to a dataset of pre-existing validated gesture samples and a distance threshold. The method includes in response to determining that the gesture sample associated with the label is valid, determining whether to update a model for the gesture classifier using the validated gesture sample as a training sample.

Abstract: Touch detection includes obtaining image data for a finger and a target surface, and determining a touch region in the image data on which the fingertip makes contact with the target surface. A pointing direction of the finger in the image data is determined, and a target region is estimated on the target surface based on the touch region and the pointing direction, wherein the touch region comprises a portion of the target surface that extends from the touch region in a direction of the pointing direction.

Abstract: There is provided a data processing method including displaying three-dimensional scan data, and changing display of the three-dimensional scan data in response to a remote control signal received from a scanner, wherein the remote control signal includes a signal for controlling a virtual camera obtaining an image of the three-dimensional scan data.

Abstract: Disclosed are methods, systems and non-transitory computer readable memory for gesture inference. For instance, a first method may include computer vision to train and/or infer gesture inferences. For instance, a second method may include using transformations to data and/or ML models to address inter/intra-session variability of sensor data. For instance, a third method may include using ML model selection to select a ML model to address inter/intra-session variability of sensor data.

Abstract: A nautical chart processing device is provided. The nautical chart processing device includes processing circuitry. The processing circuitry is configured to receive position information indicating position of a pair of base points on an electronic chart, set a movable measurement point on a straight line connecting the pair of base points in real time, calculate, on the electronic chart, a distance between the movable measurement point and at least one base point of the pair of base points, and output position information of the movable measurement point and the calculated distance.

Abstract: A smart mask includes a first material layer, at least one display, a first sensor, and a control module. The first material layer is configured to cover a portion of a face of a person. The at least one display is connected to the first material layer and configured to display images over a mouth of the person. The first sensor is configured to detect movement of the mouth of the person and generate a signal indicative of the movement of the mouth. The control module is configured to receive the signal and display the images on the display based on the movement of the mouth.

Abstract: A system, method and computer program product for use in recognizing input of multiple input types on a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The computing device further has an input management system for recognizing the input. The input management system is configured to accept input, with respect to the interface surface, of one or more different types of input, cause recognition of the input as recognized objects regardless of the one or more input types, each recognized object being associated with a corresponding probability of recognition, and return at least one of the recognized objects as the recognized input based on the probabilities.

Abstract: An ultrasound imaging system and method for flow-mode imaging. A method of ultrasound imaging includes displaying an initial ultrasound image, receiving a selection of a flow region through a user interface, and receiving a selection of an angular range through the user interface. The method includes displaying a flow-mode image on the display device after receiving both the selection of the flow region and the selection of the angular range, wherein the flow-mode image represents flow information that is both within the flow region and within the selected angular range. Wherein the flow-mode image does not represent flow information that is either outside of the flow region or outside of the angular range.

Abstract: An electronic device includes: a sensor module, a display module comprising a main display and a sub-display, a memory configured to store computer-executable instructions, and a processor configured to execute the instructions by accessing the memory, wherein the instructions, when executed by the processor, cause the processor to: identify at least one real object displayed through the main display, select one real object from among the identified at least one real object as a target object, control the sensor module to measure ambient illuminance of the electronic device, determine a visibility level of the electronic device based on the ambient illuminance of the electronic device, and display at least one augmented reality (AR) content corresponding to the selected target object on at least one of the main display or the sub-display based on the determined visibility level.

Abstract: A finger-worn wearable ring device may include a ring-shaped housing, a printed circuit board, and a sensor module that includes one or more light-emitting components and one or more light-receiving components. The wearable ring device may further include a communication module configured to wirelessly communicate with an application executable on a user device.

Abstract: A tracking system and associated algorithms are disclosed that can provide a user with a continuous, reset-free augmented reality (AR) experience. When the user wears an AR headset equipped with a camera and an inertial measurement unit (IMU), motion sensor data from the IMU can be combined with image data from the camera to create a device pose, representing a position and an orientation of the headset relative to its environment. In some implementations, when a reset occurs, a six-degrees-of-freedom (6DoF) algorithm can be configured to support the pose until a re-initialization is completed. In some implementations, a neural network can be used to correct for IMU integration drifts in the 6DoF algorithm. In some implementations, the IMU-based 6DoF uses a neural network that exploits the device's past motion to infer its future motion.

Abstract: A virtual reality/augmented reality (VR/AR) wearable assembly is described herein. The VR/AR wearable assembly includes a support frame, a display mounted to the support frame, a plurality of light emitters configured to illuminate an area of a subject's eye, a plurality of photosensors configured to receive reflected light from different portions of the illuminated subject's eye, and a controller operatively coupled to the display, the plurality of light emitters, and the plurality of photosensors. The controller includes a processor programmed to execute an algorithm including the steps of alternating illumination of the light emitters to generate predefined lighting patterns, acquiring data from the plurality of photosensors when corresponding light emitters are illuminated, mapping intensities of reflected light based on the acquired data from the plurality of photosensors, and determining a gaze position of the subject's eye based on the mapped intensities of reflected light.

Abstract: Disclosed herein is a coordinate output device that outputs absolute coordinates indicating a position in a predetermined region or relative coordinates, according to a position indicated by a position indicator. The coordinate output device continues to output the relative coordinates while the absolute coordinates are not acquired, and starts output of the absolute coordinates and stops the output of the relative coordinates in response to acquisition of the absolute coordinates.

Abstract: Wearable computing apparatuses, which can be adapted to be worn on a user's hand, are provided for augmented reality, virtual reality, and artificial intelligence interactions. Generally, the wearable computing apparatus can include a first subassembly comprising one or more processors, non-transitory memory for storing instructions, at least one haptic motor, and a first set of sensors configured to measure positional characteristics associated with a user's hand. The wearable computing apparatus can further comprise a second subassembly removably coupled to the first subassembly, the second subassembly including a plurality of leads each of which is attached to a finger and comprises a distal portion that houses a haptic motor and a second set of sensors. The second set of sensors is configured to measure positional characteristics associated with the user's fingers.

Abstract: According to an embodiment, a wearable device may display, based on contact on a second surface identified using a touch sensor, a visual object indicating a first position of the touch input on the second surface in a screen through a display. The wearable device may identify, in response to the touch input, a second position in the screen of a gaze identified based on an image obtained through a camera exposed outside at a portion of a first surface. The wearable device may provide, in response to the second position identified within a specified distance from the first position of the visual object, feedback with respect to the touch input. The wearable device may cease to provide the feedback in response to the second position identified outside from the first position by the specified distance.

Abstract: A glasses-type wearable information device transfers, when a notification from an application is received, the notification to another wearable terminal in a case where the glasses-type wearable information device is not in use, and does not perform display control to project the notification into a field of vision of a user.

Abstract: A finger-worn wearable ring device may include a ring-shaped housing, a printed circuit board, and a sensor module that includes one or more light-emitting components and one or more light-receiving components. The wearable ring device may further include a communication module configured to wirelessly communicate with an application executable on a user device.

Abstract: Embodiments provide systems and techniques for automated generation of haptic effects based on haptics data. An example technique includes obtaining a set of haptic data associated with media content being streamed to a computing device. The media content is displayed on the first computing device. One or more haptic effects are generated using one or more haptic devices while displaying the media content, based on the set of haptic data. One or more parameters of the one or more haptic effects is adjusted when a predetermined condition(s) is satisfied.

Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.

Abstract: An MR device may determine whether to perform an operation to blur on the virtual content. A pixel may be sampled, as well several pixels with a vicinity, or predetermined distance, from the sampled pixel. When a threshold number of pixels is used to present the virtual content, a blur operation is performed on the pixels, thus blurring the virtual content, which may cause the virtual content to be at least partially presented as a low-resolution image. Alternatively, when the threshold number of pixels is not used to present the virtual content, the blur operation is not performed, thus minimizing computational processes associated with presenting the virtual content.

Abstract: An under-display optical fingerprint sensors employing microlens arrays (MLAs) and an opaque aperture layer includes high aspect-ratio metal aperture structures for efficient angular signal filtering and stray light control. Instead of relying on one or more opaque aperture baffle-layers, embodiments disclosed herein utilize an image sensor's inherent metal layers for filtering signals originated from unwanted angular ranges and blocking undesired stray light could achieve similar or better performance with simplified process flow and lower cost. Layers from the sensors' inherent metal layers are brought into the sensing area on purpose to form the high aspect-ratio metal aperture structure. The metal layers in the sensing area may include apertures aligned to apertures in the opaque layer, and may also be grounded.

Abstract: An analysis assistance device includes an estimator that estimates distribution of measurement quality index data using a plurality of analysis condition data to be provided to an analysis device and a plurality of measurement data obtained in the analysis device based on the plurality of analysis condition data, and a measurement quality index outputter that outputs for display a region where the measurement quality index data is not less than a predetermined threshold value as a design space, and the measurement quality index outputter outputs the region of the design space in an enlarged manner by cutting off at least part of a region other than the design space in a distribution region of the measurement quality index data.

Abstract: A state estimation apparatus 1 includes: a generation unit 2 configured to generate acoustic characteristic information indicating an acoustic characteristic using a first acoustic signal output to the ear canal and a second acoustic signal produced by the first acoustic signal echoing inside the body; and an estimation unit 3 configured to estimate the state of the vocal tract and the state of the respiratory tract using the acoustic characteristic information.

Abstract: Upon detection of a gesture, a current context of an environment in which the gesture is performed may be determined. The current context may be used to interpret the gesture to determine which of potentially a plurality of devices are to be controlled by the gesture and whether the gesture is configured to control the determined device(s) in the current context. The current context may also be used to determine whether to adjust a threshold for determining whether the gesture is intended as a control command. An aspect of the detected gesture may be compared to the threshold to determine whether the gesture is intended as a control command. If the gesture is intended as a control command, the determined device(s) may be controlled accordingly.

Abstract: The embodiments of the disclosure provide a method for hand tracking. The method includes following steps. A first image of a hand is obtained through a head-mounted device. A first pose of a first part of the hand is determined through a processor based on the first image. A second image of the hand is obtained through a hand-held device. A second pose of a second part of the hand is determined through a processor based on the first image. The first part and the second part complementarily form an entirety of the hand. A gesture of the hand is determined through the processor based on the first pose and the second pose.

Abstract: A sensor adjustment method includes obtaining a folding status parameter, where the folding status parameter is used to describe a folding extent of a foldable device, and where a component of the foldable device in a folded state causes interference to a first sensor of the foldable device compared with a non-folded state; invoking a sensor adjustment corresponding to the folding status parameter; and adjusting a sensor operating parameter of the first sensor according to the sensor adjustment and/or performing data preprocessing on first sensor data collected by the first sensor.

Abstract: A three-dimensional gesture detection device and a three-dimensional gesture detection method are provided. The three-dimensional gesture detection device includes a node detection unit, a gesture recognition model and a gesture trajectory detection unit. The node detection unit obtains several nodes according to each of the hand frames of a continuous hand image. The gesture recognition model obtains confidence levels of several gesture categories. The gesture trajectory detection unit includes a weight analyzer, a gesture analyzer, a key point classifier and a trajectory analyzer. The weight analyzer obtains weights of the gesture categories through a user interface. The gesture analyzer performs a weighting calculation on the confidence levels of the gesture categories to analyze a gesture on each of the hand frames. The key point classifier classifies several key points from the nodes. The trajectory analyzer obtains an inertial trajectory of the gesture according to the key points.

Abstract: A nonverbal information generation apparatus includes a nonverbal information generation unit that generates time-information-stamped nonverbal information that corresponds to time-information-stamped text feature quantities on the basis of the time-information-stamped text feature quantities and a learned nonverbal information generation model. The time-information-stamped text feature quantities are configured to include feature quantities that have been extracted from text and time information representing times assigned to predetermined units of the text. The nonverbal information is information for controlling an expression unit that expresses behavior that corresponds to the text.

Abstract: Disclosed are methods, systems and non-transitory computer readable memory for gesture inference. For instance, a first method may include computer vision to train and/or infer gesture inferences. For instance, a second method may include using transformations to data and/or ML models to address inter/intra-session variability of sensor data. For instance, a third method may include using ML model selection to select a ML model to address inter/intra-session variability of sensor data.

Abstract: An operation detection device includes a motion detection unit that detects a motion of an operator; a certainty level estimation unit; a sounds detection unit; and an operation determination unit. The certainty level estimation unit estimates a certainty level at predetermined time intervals based on the motion of the operator detected by the motion detection unit and acquires the certainty level with respect to a change in the motion. The certainty level indicates that the operator has performed a predetermined operation. The sound detection unit detects a predetermined sound generated from an operation object operated by the operator or an physical body accompanying the operation object when the predetermined operation is performed.

Abstract: Various aspects of the present disclosure generally relate to wireless communication. In some aspects, a user equipment (UE) performs a training procedure in which it measures a signal strength and gathers information about objects surrounding the UE, such as the location of fingers holding the UE. This information may be used later in order to mitigate signal issues related to the UE environment by different mitigation strategies such as triggering a re-training of beamforming weights, or increasing the number of reference signals used for beam training.

Abstract: A display substrate, and a display apparatus are provided. Multiple subpixels in the display substrate include first and second subpixels. Each subpixel includes a power signal line pattern and a light-emitting element. The power signal line pattern includes first and second power line portions. At least a part of the first power line portion extends in a second direction. The light-emitting element includes an anode pattern. The second power line portion includes a body portion, a first end portion, and a second end portion. Each of the subpixels further includes a power compensation pattern, and the power compensation pattern forms an integral structure with the body portion and the first power line portion.

Abstract: A process is provided for usage-pattern-based generation of a digital model of a product. The process includes obtaining a usage pattern of a user of a product, where the usage pattern includes a set of usage pattern parameters. In addition, the process includes using a machine learning model of an artificial intelligence system to generate a 3-D virtual image of the product aligned with the usage pattern, and analyzing, by the artificial intelligence system, the 3-D virtual image of the product to facilitate identifying a requirement specification for the product based on the usage pattern. Further, the process includes generating a digital model of a new product for the user based on the identified requirement specification.

Abstract: Described herein are liquid crystal (LC) assemblies that are dimmable and techniques for manufacturing LC assemblies. Example LC assemblies are described that include a flexible substrate, a twisted nematic liquid crystal, a polarizer with cellulose triacetate and an ultraviolet blocker, a polycarbonate layer, polyvinyl butyral as a connecting layer, or any combination of these features. A flexible substrate can permit an LC assembly to be applied to a window or other rigid surface, even if the surface has a three-dimensional curvature. LC assemblies featuring Guest-Host or vertical alignment configurations are also described. In some embodiments, a dimmable LC assembly is provided as part of a kit including a control unit adapted to electrically connect to the LC assembly via a cable. Both the LC assembly and the control unit can be mounted to a window or other rigid surface. The control unit can be powered using a photovoltaic cell.

Abstract: Systems and methods for employing virtual environmental augmentation in clinical care environments to enhance a clinician's in-the-moment knowledge, leverage past experiences of the clinician and others, and improve the quality of patient care are provided. Such virtual environmental augmentation may align with prior-established, evidence-based clinical processes and enhance the clinician's in-the-moment knowledge by extracting relevant data from one or more clinical sources and presenting a virtual representation of at least a portion of the extracted data (or a summary, exemplification, or interpretation thereof) in the clinician's field-of-view while the clinician is present in a clinical care environment and is utilizing an environmental augmentation device. Such environmental augmentation additionally may facilitate real-time documentation enabling more complete clinical records and ultimately improving the quality of patient care.

Abstract: A manipulating device comprising: a rocker, a supporting member a magnetic assembly and a coil assembly, wherein the rocker is rotatable around the supporting member; the coil assembly is disposed opposite to the rocker, the magnetic assembly is disposed on one end of the rocker adjacent to the coil assembly; the magnetic assembly (3) comprising a central magnet (31) and at least one side magnets. By providing the magnetic assembly on the one end of the rocker adjacent to the coil assembly (4), the power for rotating the rocker is adjusted by interaction force between the magnetic assembly and the coil assembly, and the interaction force between the magnetic assembly and the coil assembly can be further adjusted by adjusting the magnitude of the current of the coil assembly.

Abstract: A vehicle-mounted apparatus (10) according to the present invention includes: a surrounding object information acquisition unit (11) that acquires surrounding object information relating to a surrounding object being an object detected in surroundings of a vehicle; a line-of-sight information acquisition unit (12) that acquires line-of-sight information of a driver of the vehicle; an operation information acquisition unit (13) that acquires operation information indicating an operation performed by the driver on the vehicle; an operation intention information generation unit (14) that generates operation intention information associating an operation indicated by the operation information with the surrounding object causing the operation indicated by the operation information, based on the surrounding object information, the line-of-sight information, and the operation information; and a transmission and reception unit (15) that transmits the operation intention information to a surrounding vehicle.

Abstract: A UI for a HMD system includes a HMD configured to be worn by a surgeon. A tracker is configured to track head gestures by the surgeon. A footswitch is configured to detect foot motion inputs by the surgeon. A computer couples to the HMD, the tracker, and the footswitch. A user interface includes the HMD, tracker, and footswitch. The use interface is configured to: provide to the computer the head gesture in association with the foot motion input, and display an image relating to a surgical procedure on the HMD. The computer is configured to: apply the head gesture received in association with the foot motion input to perform a first action on the HMD system when the HMD system is in a first system mode, and perform a second action on the HMD system when the HMD system is in a second system mode.