Abstract: Herein disclosed is a three-dimensional depth-sensing device and an illumination module for the same. The illumination module for a three-dimensional depth-sensing device comprises: a light source; a diffuser, diffusing light from the light source; a tunable lens, positioned after the diffuser and having at least three statuses; and a control unit, setting the tunable lens to one of the at least three statuses. The at least three statuses of the tunable lens correspond to at least three configurations between a dot light and a flood light.

Abstract: Aspects of the disclosure provide a liquid crystal (LC) device, a head mounted display (HMD) system, and a method of tuning the HMD system. The LC device includes a first electrode structure disposed on a first substrate with an elliptical shape. The first electrode structure includes parallel first segments connected by second segments. The LC device includes a plurality of first control electrodes electrically coupled with the first electrode structure. The plurality of first control electrodes is configured to form LC lenses at different positions. Each of the LC lenses at the different positions is formed when electrical signals are applied to a subset of the plurality of first control electrodes that is associated with the respective LC lens. The LC device includes a second electrode structure disposed on a second substrate and at least one second control electrode electrically coupled with the second electrode structure.

Abstract: An audio converter system is provided. The system comprises an audio input configured to receive a source audio, an audio output configured to couple to a hybrid speaker comprising at least two nondirectional speakers and a directional speaker, and a processor configured to generate an output audio for the hybrid speaker based on the source audio by: identifying a specific sound in the source audio, isolating the specific sound from the source audio, generating a directional speaker output for the directional speaker of the hybrid speaker based on the specific sound, and generating at least two channels of nondirectional speaker output for the at least two nondirectional speakers of the hybrid speaker.

Abstract: Environmental sound is recorded using one or more microphones. A source of the recorded environmental sound is classified. The recorded environmental sound is weighted based on the classification of the source and the source media sound using a weighting mode to determine whether to mix the recorded environmental. The recorded environmental sound is mixed with source media sound to produce a mixed sound based on the determination. The mixed sound is played over one or more speakers.

Abstract: To derive three dimensional (3D) position and orientation of a 3-axis (or more) magnetometer/accelerometer device (such as may be implemented in VR or AR headset or computer game controller) without line of sight constraints, a spinning magnetic field is used to discriminate and remove the external (Earth's) magnetic field from the spinning magnetic field. This reduces the problem to finding the distance to the source of the magnetic field using a calibration table (or formula), finding two angles describing the deviation of the magnetic sensor from the axis of rotation of the spinning magnetic field and the phase around this axis, and from these values deriving the orientation of the sensor.

Abstract: Environmental sound is recorded using one or more microphones. A source of the recorded environmental sound is classified. The recorded environmental sound is weighted based on the classification of the source and the source media sound using a weighting mode to determine whether to mix the recorded environmental. The recorded environmental sound is mixed with source media sound to produce a mixed sound based on the determination. The mixed sound is played over one or more speakers.

Abstract: An audio converter system is provided. The system comprises an audio input configured to receive a source audio, an audio output configured to couple to a hybrid speaker comprising at least two nondirectional speakers and a directional speaker, and a processor configured to generate an output audio for the hybrid speaker based on the source audio by: identifying a specific sound in the source audio, isolating the specific sound from the source audio, generating a directional speaker output for the directional speaker of the hybrid speaker based on the specific sound, and generating at least two channels of nondirectional speaker output for the at least two nondirectional speakers of the hybrid speaker.

Abstract: In device having at least one microphone and one or more speakers, environmental sound may be recorded using the microphone, classified and mixed with source media sound to produce a mixed sound depending on the classification. The mixed sound may then be played over the one or more speakers.

Abstract: An audio converter system is provided. The system comprises an audio input configured to receive a source audio, an audio output configured to couple to a hybrid speaker comprising at least two nondirectional speakers and a directional speaker, and a processor configured to generate an output audio for the hybrid speaker based on the source audio by: identifying a specific sound in the source audio, isolating the specific sound from the source audio, generating a directional speaker output for the directional speaker of the hybrid speaker based on the specific sound, and generating at least two channels of nondirectional speaker output for the at least two nondirectional speakers of the hybrid speaker.

Abstract: A method includes receiving a signal that includes noise, generating a reference signal that comprises an estimate of the noise included in the received signal, and using the reference signal to remove at least part of the noise from the received signal. The reference signal is generated by a model built using machine learning. A system includes a first apparatus that carries a signal that includes noise, and a processor based apparatus configured to execute steps including receiving the signal that includes the noise, generating a reference signal that comprises an estimate of the noise included in the received signal, and using the reference signal to remove at least part of the noise from the received signal. A storage medium storing one or more computer programs is also provided.

Abstract: A method includes running a computer simulation that is controlled at least in part by a handheld controller, displaying images generated by the computer simulation on a display, and projecting at least one image generated by the computer simulation from an image projector coupled to the handheld controller. A system includes a display, a handheld controller, an image projector coupled to the handheld controller, and a processor based apparatus. Another system includes a display, a handheld controller, an image projector that is housed in a unit configured to be releasably docked to the handheld controller, and a processor based apparatus. Storage mediums storing one or more computer programs are also provided.

Abstract: Plural individual sensor assemblies are engaged with respective parts of a person's body. Each assembly may include accelerometers, magnetometers, and gyroscopes. Sensor data is fused together to get the orientation at each body location. To simplify, the body is assumed to consist of rigid bars of known length connected with ball joints so that once the relative orientations of all bars are given by the respective assemblies, body pose can be computed. Then the body pose is translated as a virtual body into a virtual world either by a ray cast method that anchors a foot of the virtual body to the ground assuming infinite gravity and infinite friction and then translating the other body parts to make the ground contact point fixed, or by implementing an approximate dynamics physics engine on the virtual body. The technique may be used in VR location-based entertainment and for motion capture.

Abstract: In device having at least one microphone and one or more speakers, environmental sound may be recorded using the microphone, classified and mixed with source media sound to produce a mixed sound depending on the classification. The mixed sound may then be played over the one or more speakers.

Abstract: An audio converter system is provided. The system comprises an audio input configured to receive a source audio, an audio output configured to couple to a hybrid speaker comprising at least two nondirectional speakers and a directional speaker, and a processor configured to generate an output audio for the hybrid speaker based on the source audio by: identifying a specific sound in the source audio, isolating the specific sound from the source audio, generating a directional speaker output for the directional speaker of the hybrid speaker based on the specific sound, and generating at least two channels of nondirectional speaker output for the at least two nondirectional speakers of the hybrid speaker.

Abstract: To derive three dimensional (3D) position and orientation of a 3-axis (or more) magnetometer/accelerometer device (such as may be implemented in VR or AR headset or computer game controller) without line of sight constraints, a spinning magnetic field is used to discriminate and remove the external (Earth's) magnetic field from the spinning magnetic field. This reduces the problem to finding the distance to the source of the magnetic field using a calibration table (or formula), finding two angles describing the deviation of the magnetic sensor from the axis of rotation of the spinning magnetic field and the phase around this axis, and from these values deriving the orientation of the sensor.

Abstract: In device having at least one microphone and one or more speakers, environmental sound may be recorded using the microphone, classified and mixed with source media sound to produce a mixed sound depending on the classification. The mixed sound may then be played over the one or more speakers.

Abstract: To derive three dimensional (3D) position and orientation of a 3-axis (or more) magnetometer/accelerometer device (such as may be implemented in VR or AR headset or computer game controller) without line of sight constraints, a spinning magnetic field is used to discriminate and remove the external (Earth's) magnetic field from the spinning magnetic field. This reduces the problem to finding the distance to the source of the magnetic field using a calibration table (or formula), finding two angles describing the deviation of the magnetic sensor from the axis of rotation of the spinning magnetic field and the phase around this axis, and from these values deriving the orientation of the sensor.

Abstract: In device having at least one microphone and one or more speakers, environmental sound may be recorded using the microphone, classified and mixed with source media sound to produce a mixed sound depending on the classification. The mixed sound may then be played over the one or more speakers.

Abstract: A system, including: a computing device that executes an interactive application and generates and transmits image frames; a head-mounted display (HMD) that receives and presents the image frames, wherein the HMD includes a magnetic emitter that emits a magnetic signal having a synchronization encoding synchronized to the received image frames; a controller device that includes a magnetic sensor that detects the magnetic signal, wherein the controller device processes the detected magnetic signal to determine magnetic position data and read the synchronization encoding, wherein the controller device uses the synchronization encoding to generate corresponding timing data indicating a timing of the magnetic position data based on the synchronization encoding, wherein the controller device transmits the magnetic position data and the corresponding timing data to the computing device; wherein the computing device uses the magnetic position data and the corresponding timing data to determine the location and/or or

Abstract: A method includes running a computer simulation that is controlled at least in part by a handheld controller, displaying images generated by the computer simulation on a display, and projecting at least one image generated by the computer simulation from an image projector coupled to the handheld controller. A system includes a display, a handheld controller, an image projector coupled to the handheld controller, and a processor based apparatus. Another system includes a display, a handheld controller, an image projector that is housed in a unit configured to be releasably docked to the handheld controller, and a processor based apparatus. Storage mediums storing one or more computer programs are also provided.