Abstract: Systems and methods herein describe pausing operation of an augmented reality device based on user facial movement by monitoring user eye movement of a user of a head-wearable apparatus, determining that the user eye movement is directionally facing away from a display device coupled to the head-wearable apparatus, based on the determination, pausing operation of one or more sensors of the head-wearable apparatus.

Abstract: This disclosure describes various examples of a system which uses a multi-bank, multi-port shared memory system that may be implemented as part of a system on a chip. The shared memory system may have particular applicability in the context of an artificial reality system, and may be designed to have distributed or varied latency for one or more memory banks and/or one or more components or subsystems within the system on a chip. The described shared memory system may be logically a single entity, but physically may have multiple memory banks, each accessible by any of a number of components or subsystems. In some examples, the memory system may enable concurrent, common, and/or shared access to memory without requiring, in some situations, full locking or arbitration.

Abstract: There is disclosed an augmented reality (AR) glasses device including: a camera, a transparent display, a communication circuit, a memory storing images of a plurality of external electronic devices, and a processor. The processor may be configured to control the AR glasses device to: acquire an image including an image of at least one external electronic device, acquire running application information of the at least one external electronic device, identify a first external electronic device corresponding to a gaze from among the at least one external electronic device from the acquired image, determine whether a specified application is running in the first external electronic device based on the running application information, and connect to the first external electronic device using a communication circuit, based on the specified application running.

Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking error parameters are determined from the gaze tracking data including a rate of rotation of a user's eye with respect to one or more axes. An error in a fixation of the user's eye on a particular region of interest is determined. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest.

Abstract: An electronic device is provided which displays an object (body) on a flexible display screen in accordance with a three-dimensional shape of the display screen by utilizing the flexibility of the display screen. An electronic device including a display portion which includes a flexible display device displaying an object on a display screen; a detection portion detecting positional data of a given part of the display screen; and an arithmetic portion calculating a three-dimensional shape of the display screen on the basis of the positional data and computing motion of the object to make the object move according to a given law in accordance with the calculated three-dimensional shape of the display screen.

Abstract: According to an aspect, an electronic system for outputting video data and audio data includes a terminal device which generates the audio data and the video data; a wearable audio device which communicatively connects to the terminal device through a first wireless communication scheme; and a wearable augmented reality (AR) device which communicatively connects to the terminal device through a second wireless communication scheme. The wearable AR device receives the audio data and the video data from the terminal device, outputs the video data through a display of the wearable AR device, and outputs the audio data through a speaker of the wearable AR device, and the wearable audio device receives the audio data output from the wearable AR device using a microphone of the wearable audio device and outputs the audio data received from the wearable AR device through a speaker of the wearable audio device.

Abstract: A method for immersively displaying a scanned environment of a region to a set of users in a training environment wearing augmented reality head display units. The training environment includes a pseudo-GPS system, which allows position tracking over time. This enables rehearsing military operations before they occur.

Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.

Abstract: Aspects of the present invention relate to methods and devices for receiving and presenting content. In an example method, content is received, the content to be delivered to a plurality of recipients. Each recipient of the plurality of recipients has a preference for a respective first physical location at which the content is to be presented on a display of a wearable head device associated with the recipient. A sender of the content has a preference for a second physical location at which the content is to be presented to the respective recipient of the plurality of recipients. A respective final physical location for the presentation of the content for the respective recipient of the plurality of recipients is identified. The respective final physical location is based on the respective recipient's preference and the sender's preference. It is determined whether the respective recipient is proximate to a zone associated with the respective final physical location.

Abstract: Systems for identifying threat materials such as CBRNE threats and locations are provided. The systems can include a data acquisition component configured to determine the presence of a CBRNE threat; data storage media; and processing circuitry operatively coupled to the data acquisition device and the storage media. Methods for identifying a CBRNE threat are provided. The methods can include: determining the presence of a CBRNE threat using a data acquisition component; and acquiring an image while determining the presence of the CBRNE threat. Methods for augmenting a real-time display to include the location and/or type of CBRNE threat previously identified are also provided. Methods for identifying and responding to CBRNE threats are provided as well.

Abstract: This invention comprises a smart room comprising at least 4 non-planar arranged transmitters and an object equipped with a receiver and an orientation sensor. The object position and orientation are tracked at time points and a dataset is built which provides object orientation information and object position information at each time point.

Abstract: Systems and methods for gesture-based control are disclosed. In some embodiments, a system may include a wearable device configured to obtain physiological data and wrist location data. The system may be configured to detect a first gesture and transition to an object control state in which changes in the wrist location data and/or the physiological data are configured to control a movement of the object. In the object control state, the system may be configured to detect a first motion of a body part, generate a first command to move the object in a first command direction, detect a second motion of the body part, and generate a command to move the object in a second command direction. The system may detect a second gesture indicating an intention to cease control of the object, and transition out of the object control state.

Abstract: A head-mounted device may have a left display and a right display that provide respective left and right images. Left and right optical combiner systems may be configured to pass real-world light to left and right eye boxes while directing the left and right images respectively to the left and right eye boxes. Misalignment of the left and right images with respect to the left and right eye boxes may be detected using gaze tracking systems, using cameras such as front-facing cameras in conjunction with a database of known real-world object properties, using visual inertial odometry systems formed from cameras and inertial measurement units, or using one or more sensors in a portable head-mounted device case or other item with a receptacle configured to receive a head-mounted device. Compensating adjustments may be made to the images based on the measured misalignment.

Abstract: A system and method for rendering perspective adjusted views is provided. A registration code is generated for a mobile computing device and includes static and dynamic information about the mobile computing device. A representation of the registration code changes based on a change in the dynamic information of the mobile computing device. The registration code is provided to at least one other mobile computing device and registration of the other mobile computing device with the mobile computing device is performed upon receipt of the registration code by the other mobile computing device. A view of the mobile computing device and other mobile computing device is synchronized based on respective positions of the mobile computing device with respect to the other mobile computing device.

Abstract: In one embodiment, a computing system may display, to a viewer, a virtual surface rendered based on a first mesh of the virtual surface. In response a trigger condition, the system may generate a second mesh for the virtual surface based at least on a distance of the viewer to the virtual surface. The second mesh may include at least one new vertex with respect to the first mesh. The new vertex may be associated with a target position. The system may determine a starting position on the first mesh corresponding to the new vertex of the second mesh. The system may generate a sequence of frames depicting the virtual surface undergoing a progressive transition process using a progressively-changing mesh with a progressively-changing vertex that corresponds to the new vertex. The progressively-changing vertex may progressively move from the starting position to the target position during the progressive transition process.

Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.

Abstract: A foveated rendering method of a Virtual Reality (VR) system based on monocular eyeball tracking is provided. A first monocular mapping position, corresponding to a monocular eyeball of a user, on a display screen of the VR system is obtained, and then an Inter Pupilary Distance (IPD) corresponding to a binocular pupil distance of the user is obtained, so as to calculate a second monocular mapping position, corresponding to the other monocular eyeball of the user, on the display screen of the VR system according to the IPD and the first monocular mapping position. Then, main rendering regions are determined by taking the first monocular mapping position and the second monocular mapping position as circle centers and preset thresholds as radiuses respectively. High-resolution main rendering is performed in the main rendering regions.

Abstract: An apparatus connected to a first display apparatus of head mounted type including two or more displays and to a second display apparatus includes a determination unit configured to determine an image to be displayed on a display that corresponds to a dominant eye of a wearer wearing the first display apparatus among the two or more displays of the first display apparatus based on information about the dominant eye of the wearer of the first display apparatus and a control unit configured to perform control to display the determined image on the second display apparatus.

Abstract: A wearable computing system that includes a head-mounted display implements a gaze timer feature for enabling the user to temporarily extend the functionality of a handheld controller or other user input device. In one embodiment, when the user gazes at, or in the vicinity of, a handheld controller for a predetermined period of time, the functionality of one or more input elements (e.g., buttons) of the handheld controller is temporarily modified. For example, the function associated with a particular controller button may be modified to enable the user to open a particular menu using the button. The gaze timer feature may, for example, be used to augment the functionality of a handheld controller or other user input device during mixed reality and/or augmented reality sessions.

Abstract: Embodiments of the subject matter include a heart lung machine (HLM), including a plurality of actuators and a peripheral processing unit configured to receive a set of parameter data from the plurality of actuators. The HLM also may include a peripheral display device configured to present a subset of the set of parameter data and a control assembly comprising a control display device configured to present a user interface having a representation of a parameter value and an associated indication, where at least a portion of the associated indication overlaps at least a portion of the representation of the parameter value.