Abstract: An augmented reality, AR, system (100) for use in a medical procedure is disclosed. The AR system (100) comprises an AR headset (2), and a processor (12), The AR headset (2) comprises a camera (6a, 6b), a near eye display (4a, 4b) and a distance sensor (10a, 10b). The processor (12) is configured to adjust the position of the image obtained by the camera (6a, 6b) on the display (4a, 4b) throughout the medical procedure based on changes in the distance measured by the distance sensor (10a, 10b).

Abstract: An apparatus comprises at least one processing device comprising a processor coupled to a memory. The at least one processing device is configured to select physiologic data to be visualized, the selected physiologic data comprising a given set of one or more physiologic parameters collected from a given set of one or more subjects over a given period of time. The at least one processing device is also configured to determine a plot type for visualization of the selected physiologic data, the plot type being determined based at least in part on a repetitiveness of the selected physiologic data over a plurality of time segments in the given period of time. The at least one processing device is further configured to generate a visualization of the selected physiologic data utilizing the determined plot type, and to output the generated visualization of the selected physiologic data via an interactive graphical user interface.

Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking parameters are determined from the gaze tracking data. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest. Adjusting compression includes eliminating the region(s) of interest from images that are presented to the user during the saccade or blink.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.

Abstract: An electronic device is provided which displays an object (body) on a flexible display screen in accordance with a three-dimensional shape of the display screen by utilizing the flexibility of the display screen. An electronic device including a display portion which includes a flexible display device displaying an object on a display screen; a detection portion detecting positional data of a given part of the display screen; and an arithmetic portion calculating a three-dimensional shape of the display screen on the basis of the positional data and computing motion of the object to make the object move according to a given law in accordance with the calculated three-dimensional shape of the display screen.

Abstract: In some embodiments, techniques for producing user-generated content are provided. For example, a process may involve sending a product identifier; receiving a first candidate image that is associated with the product identifier; determining that a similarity between a user structure and a target structure satisfies a threshold condition, wherein the user structure characterizes a figure of a user in a first input image and the target structure is based on a pose guide associated with the first candidate image; and capturing, based on the determining, the first input image.

Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.

Abstract: A head-mounted device may have a left display and a right display that provide respective left and right images. Left and right optical combiner systems may be configured to pass real-world light to left and right eye boxes while directing the left and right images respectively to the left and right eye boxes. Misalignment of the left and right images with respect to the left and right eye boxes may be detected using gaze tracking systems, using cameras such as front-facing cameras in conjunction with a database of known real-world object properties, using visual inertial odometry systems formed from cameras and inertial measurement units, or using one or more sensors in a portable head-mounted device case or other item with a receptacle configured to receive a head-mounted device. Compensating adjustments may be made to the images based on the measured misalignment.

Abstract: A computer device displays a conversation page of a target conversation corresponding to an instant messaging application, The target conversation comprises at least two conversation participants. In accordance with a determination that emojis transmitted by the at least two conversation participants in the target conversation satisfy a trigger condition for a first emoji interaction animation, the computer device displays the first emoji interaction animation on the conversation page. The first emoji interaction animation comprises an interaction animation between the emojis transmitted by the at least two conversation participants.

Abstract: A vehicular driver assist system includes a sensor disposed at a vehicle and a display disposed at the vehicle and viewable by a driver of the vehicle. An electronic control unit (ECU) includes a processor for processing sensor data captured by the sensor to detect presence of objects in the field of view of the sensor. The vehicular driver assist system, responsive to processing by the processor of sensor data captured by the sensor, determines presence of a driver of the vehicle and determines a position of the driver's head. The vehicular driver assist system, responsive to determining the position of the driver's head, adjusts an orientation of the display based on the determined position of the driver's head to increase visibility of the display for the driver.

Abstract: A system for displaying a driving scene to a passenger in a vehicle includes first and second cameras for capturing images of the driving scene; a processor that receives the images from the first and second cameras, applies noise filtering to the received images to at least partially remove occlusions from the images of the driving scene received from the first and second cameras related to a weather condition; and a display that receives the filtered images from the processor after application of the filtering operation and displays the filtered images of the driving scene.

Abstract: Provided is an electronic device for detecting lost portions of a field of vision and distorted portions of a field of vision and storing these in a vision map. The lost portions and distorted portions are identified in cooperation with the user by means of virtual image superposition on a real scene, audible requests to the user, gesture inputs provided by the user and gaze tracking. The electronic device may detect an object and provide visual information to a user when the object is in a lost portion or distorted portion of the field of vision.

Abstract: A wearable computing system that includes a head-mounted display implements a gaze timer feature for enabling the user to temporarily extend the functionality of a handheld controller or other user input device. In one embodiment, when the user gazes at, or in the vicinity of, a handheld controller for a predetermined period of time, the functionality of one or more input elements (e.g., buttons) of the handheld controller is temporarily modified. For example, the function associated with a particular controller button may be modified to enable the user to open a particular menu using the button. The gaze timer feature may, for example, be used to augment the functionality of a handheld controller or other user input device during mixed reality and/or augmented reality sessions.

Abstract: A method for generating a colored tridimensional map of an environment surrounding a device, including the steps of receiving a first stream including a plurality of N point cloud frames from a tridimensional sensor, receiving a second stream including a plurality of M images from a camera, generating a global tridimensional map by merging the plurality of N point cloud frames in a reference coordinate system, and determining the colored tridimensional map by assigning a calculated color to each tridimensional data point of global tridimensional map, the calculated color being determined from color values of pixels of the plurality of M images.

Abstract: Methods, systems and apparatuses may provide for technology to receive a first video data stream from a first graphics display engine via a first video data channel, receive a second video data stream from a second graphics display engine via a second video data channel, and switch a video output from the first video data stream to the second video data stream based on a switch command to accompany the second video data stream.

Abstract: A head-up display system includes a first plurality of on-board sensors adapted to detect vehicle driving characteristics, a wireless communication module adapted to receive information from external sources, a driver monitoring system adapted to track a driver's eyes, and a controller in electronic communication with the first plurality of on-board sensors and the wireless communication module, the controller adapted to determine if the vehicle is performing a parking maneuver, and, when the vehicle is performing a parking maneuver, to capture images of an environment surrounding the vehicle, detect objects within the environment, identify location markers for a parking space and objects within the environment surrounding the vehicle adjacent to the parking space, determine the position of the vehicle relative to the identified location markers and objects, and display, with a projection module a parking assist graphic adapted to provide guidance to a driver of the vehicle.

Abstract: Some embodiments of the presently disclosed subject matter are directed to an indicator device of user activity in Augmented Reality (AR). The indicator device comprises an indicator module being configured and operable to generate at least one signal being indicative of at least one social relevant parameter related to the user activity to at least one user's onlooker, and a monitoring module connectable to the indicator module and being configured and operable to receive and process data related to user activity, determine whether the user is in a certain condition corresponding to a certain social relevant parameter, and activate the indicator module upon identification of the certain user condition.

Abstract: A display device configured to be used in a state of being fixed to a head of a user, includes: a camera; a display configured to display a part of an image captured by the camera as a display range; an orientation detection sensor configured to detect an orientation of the display device; a line-of-sight detection sensor configured to detect a line-of-sight of the user to the display; and a processor configured not to control a position of the display range based on the line-of-sight detected by the line-of-sight detection sensor in a case where a change amount of the orientation detected by the orientation detection sensor is smaller than a predetermined amount, and to control the position of the display range based on the line-of-sight in a case where the change amount of the orientation is larger than the predetermined amount.

Abstract: A camera of a virtual reality (VR) headset captures a plurality of images of a reflection of a user in a mirror. The plurality of images include at least a first image of a reflection of the user in a first position with respect to the mirror and a second image of a reflection of the user in a second position with respect to the mirror. A three-dimensional avatar is generated based on the plurality of images captured by the camera.

Abstract: A system and method provide for processing, by a mobile computing device, information received from a transmission device to identify the transmission device, an object, or the transmission device and the object, wherein the transmission device is configured to be coupled to or embedded within the object. The mobile computing device provides, as a function of the at least one of the accelerometer and the gyroscope, a representation that the mobile computing device is determined to be level, wherein the representation that the mobile computing device is level is usable to level the object.