Abstract: The invention relates to a method for operating a virtual reality headset in a vehicle, in which at least an instantaneous orientation of the virtual reality headset is determined by means of an inertial measurement unit arranged on the virtual reality headset, and a corresponding control device. Based thereon and on vehicle localisation data, a virtual perspective of a virtual environment displayed in the virtual reality headset is simulated. Therein, a relative arrangement of the virtual reality headset with respect to the vehicle interior is determined through an optical capture device arranged on the virtual reality headset. Corresponding data from the inertial measurement unit and the optical capture device are fused together to determine a corrected orientation or pose of the virtual reality headset with respect to the vehicle interior for simulating the virtual perspective.

Abstract: A model can be trained to detect interactions of other drivers through a window of their vehicle. A human driver behind a window (e.g., front windshield) of a vehicle can be detected in a real-world driving data. The human driver can be tracked over time through the window. The real-world driving data can be augmented by replacing at least a portion of the human driver with at least a portion of a virtual driver performing a target driver interaction to generate an augmented real-world driving dataset. The target driver interaction can be a gesture or a gaze. Using the augmented real-world driving data set, a machine learning model can be trained to detect the target driver interactions. Thus, simulation can be leveraged to provide a large set of useful training data without having to acquire real-world data of drivers performing target driver interactions as viewed from outside the vehicle.

Abstract: Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include superimposing a first 3D model of an object onto the 2D environment, and replacing the first 3D model of the object with a second 3D model of an object. Further, the method may include superimposing a smart 3D model of an object onto the 2D environment. Additionally, the method may include a code or mark to identify images of the 2D environment to which 3D models of objects have been superimposed.

Abstract: Virtual humans exhibit behaviors associated with inputs and outputs of an autonomous control system for medical monitoring of patients. To foster the awareness and trust, the virtual humans exhibit situational awareness via apparent (e.g., rendered) behaviors based on inputs such as physiological vital signs. The virtual humans also exhibit situational control via apparent behaviors associated with outputs such as direct control of devices, functions of control, actions based on high-level goals, and the optional use of virtual versions of conventional physical controls. A dynamic virtual human who continually exhibits awareness of the system state and relevant contextual circumstances, along with the ability to directly control the system, is used to reduce negative feelings associated with the system such as uncertainty, concern, stress, or anxiety on the part of real human patients.

Abstract: An image display system includes a body, a first correction unit, and a second correction unit. The body houses a display unit to display an image and projects a virtual image, corresponding to the image, onto a target space using outgoing light of the display unit. The first correction unit corrects for distortion of the image. The second correction unit corrects a display location of the image on the display unit in accordance with an orientation signal representing a change in orientation of the body. Each of divisional areas of a display screen of the display unit is assigned with a distortion correction parameter for correcting for the distortion of the virtual image. The first correction unit applies distortion correction to each of the image regions of the image on the display screen based on a distortion correction parameter assigned to a divisional area where the image region is displayed.

Abstract: Techniques are described for automated operations to analyze visual data combined from multiple images captured in a room to determine the room shape, such as by iteratively refining alignment of the multiple images' visual data into a common coordinate system until alignment differences satisfy one or more defined criteria, and for subsequently using the determined room shape information in further automated manners. The images may be panorama images in an equirectangular or other spherical format, and determined room shapes for one or more rooms of a building may be fully closed three-dimensional shapes and used to improve navigation of the building (e.g., as part of a generated building floor plan)—the automated room shape determination may be further performed without having or using information from any distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding room.

Abstract: The present disclosure provides systems and methods that include or otherwise leverage an artificial intelligence system and/or provide user interface mechanisms particularly suited for interacting and/or interfacing with an artificial intelligence system. A computing system can include a camera, a light-emitting device, and an artificial intelligence system that comprises one or more machine-learned models. The computing system can include a processor and one or more non-transitory computer-readable media that stores instructions that, when executed, cause the processor to obtain an image of a scene captured by the camera; generate an attention output that describes at least one region of the scene that includes a subject of a processing operation performed by the artificial intelligence system; and control the light-emitting device to emit light onto or adjacent a region of the scene that includes the subject of the processing operation performed by the artificial intelligence system.

Abstract: Disclosed herein is a software technology for facilitating an interactive conversational session between a user and a digital conversational character. For instance, in one aspect, the disclosed process may involve two primary phases: (1) an authoring phase that involves a first user accessing a content authoring tool to create a given type of visual conversation application that facilitates interactions between a second user and a digital conversational character in an interactive conversational session, and (2) a rendering phase that involves the second user accessing the created visual conversation application to interact with the digital conversational character in an interactive conversational session. In one implementation, accessing the created visual conversation application may involve detecting an object and identifying information associated with the detected object.

Abstract: In an example, an apparatus comprises a plurality of execution units, and logic, at least partially including hardware logic, to create a scatter gather list in memory and collect a plurality of operating statistics for the plurality of execution units using the scatter gather list. Other embodiments are also disclosed and claimed.

Abstract: In a current image processing environment, providing feedback for a user operation is slow, and a user cannot confirm the result of the operation in real time. Thus, the user interrupts the operation every time the user confirms the feedback, and a time period for performing image processing is long. An image processing device includes a guidance information generator. The guidance information generator acquires trajectory information to be used to segment an image object on an image input from a user, generates guidance information indicating a segmentation region desired by the user based on the trajectory information, and presents the segmentation region based on a user's intention in real-time. The guidance information generator provides a function of smoothly continuously segmenting an image object.

Abstract: In one embodiment, the method includes obtaining a plurality of sensor data items, each specifying a set of values determined from at least one sensor; and training, based on the plurality of sensor data items, a machine learning model configured for classifying sensor data items. The machine learning model includes a data adaptation part configured for determining a modified sensor data item based on an input sensor data item, an encoder configured for determining encoded features based on the modified sensor data item, a decoder configured for determining a decoded sensor data item based on the encoded features, representing an estimation of the input sensor data item, and a classifier configured for determining a class associated with the input sensor data item.

Abstract: A method and system for localizing a plurality of stationary devices, such as Internet of Things (IoT devices), arranged in an environment is disclosed. A mobile device is configured to survey an environment to generate a three-dimensional map of the environment using simultaneous localization and mapping (SLAM) techniques. The mobile device and the stationary devices are equipped with wireless transceivers, such as Ultra-wideband radios, for measuring distances between the devices using wireless ranging techniques. Based on the measured distances, the mobile device is configured to determine locations of the stationary devices in a reference frame of the three-dimensional map. In some embodiments, the determined locations can be used to enable a variety of spatially aware augmented reality features and interactions between the mobile device and the stationary device.

Abstract: Disclosed is a control device querying a preset data set to obtain color vision sensitivity information corresponding to acquired identity information of a user of the augmented reality device; the control device judging whether the user is a color recognition disorder patient according to obtained color vision sensitivity information; the control device acquiring a personalized color display mode corresponding to the color vision sensitivity information as a target color display mode when the user is judged as a color recognition disorder patient; and the control device providing the augmented reality device with the target color display mode so that the augmented reality device employs the target color display mode to display an image.

Abstract: Techniques for providing adaptive assistive technology for assisting users with visual impairment can be used on a computing device. These techniques include displaying content to a user, capturing a series of images or video of the user using a camera, analyzing the series of images or video to determine whether the user is exhibiting behavior or characteristics indicative of visual impairment, and rendering a magnification user interface on the display configured to magnify at least a portion of the content of the display based on a determination that the user is exhibiting behavior or characteristics indicative of visual impairment. The magnification user interface may be controlled based on head and/or eye movements of the user of the computing device.

Abstract: A head-up display of the present disclosure projects a display image on a transparent reflecting member. The head-up display includes: a display device that displays the display image; and a projection optical system that projects the display image displayed on the display device. On an assumption that light reaching a center of a viewpoint region of the observer and corresponding to a center of the virtual image is reference light, the projection optical system includes a prism element that has an incident surface, a reflection surface, and an emitting surface different from the incident surface sequentially in an optical path from the display device. The emitting surface is inclined to the reference light. An inclination amount ?2 of the reference light emitted from the emitting surface with respect to the emitting surface lies in a range of 15°<|?2|<45° in the optical path from the display device.

Abstract: A platform for visualization of traffic information at an observed roadway or traffic intersection converts data collected from sensors for rendering as dynamic animations on a virtual map of the observed roadway or traffic intersection. The platform parses and curates incoming sensor data from either a single or multiple sensors representing one or more objects at the observed roadway or traffic intersection, and translates at least location data of each object for correlation of the object's movement relative to the observed roadway or traffic intersection. The platform then generates dynamic animations of the movement of each object and displays the animations as an overlay on the virtual map.

Abstract: To reduce this amount of bandwidth needed to share 3D map images between mobile devices, according to some embodiments, a user's mobile device (i.e., a host device) may identify its origin in a 3D map and a current virtual camera position relative to the origin based on the physical position of the mobile device. The mobile device may send both the origin and the virtual camera position to another mobile device (i.e., a client device) for use in rendering a corresponding image. Separately, the client device may download the 3D map images from a server, e.g., in preparation for a meeting. In this manner, the host device may send the origin to the client device once, as well as send a data stream of the current virtual camera position for use in accessing the corresponding 3D map images at the client device.

Abstract: A system performs image stabilization of a display in a vehicle, in particular a motor vehicle. The system includes at least one display, in particular a monitor, for visualization; at least one sensor, in particular an acceleration sensor; and a computer unit, in particular an on-board computer. The system is designed to detect, by way of the sensor, a shock to the vehicle, in particular as a result of unevenness of the roadway, and to carry out on the basis thereof, a compensation calculation by use of the computer unit and to output a correction signal to the display, in order to stabilize the visualization on the display.

Abstract: Methods, systems, and devices for dynamic structure and surface environment are described. A columnar structure that may include a tiled surface may be used to create or adjust a surface of physical structure to allow for dynamic columns to provide an augmented physical environment. In some examples, a first plurality of columns may be configured to adjust in a first direction from a first position to a second position, an actuator in contact with some of the columns may be configured to cause the columns to adjust in the first direction from the first position to the second position; and a controller configured to receive information associated with position information of some of the columns and may communicate with the actuator.

Abstract: This application describes a head-mounted display (HMD) for use in virtual-reality (VR) environments. The systems and methods described herein may determine information about a real-world environment surrounding the user, a location of the user within the real-world environment, and/or a pose of the user within the real-world environment. Such information may allow the HMD to display images of the real-world environment in a pass-through manner and without detracting the user from the VR environment. In some instances, the HMD may pass-through images of the real-world environment based on one or more triggering events.