Abstract: Techniques are described for automated operations to analyze visual data combined from multiple images captured in a room to determine the room shape, such as by iteratively refining alignment of the multiple images' visual data into a common coordinate system until alignment differences satisfy one or more defined criteria, and for subsequently using the determined room shape information in further automated manners. The images may be panorama images in an equirectangular or other spherical format, and determined room shapes for one or more rooms of a building may be fully closed three-dimensional shapes and used to improve navigation of the building (e.g., as part of a generated building floor plan)—the automated room shape determination may be further performed without having or using information from any distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding room.

Abstract: The present disclosure provides systems and methods that include or otherwise leverage an artificial intelligence system and/or provide user interface mechanisms particularly suited for interacting and/or interfacing with an artificial intelligence system. A computing system can include a camera, a light-emitting device, and an artificial intelligence system that comprises one or more machine-learned models. The computing system can include a processor and one or more non-transitory computer-readable media that stores instructions that, when executed, cause the processor to obtain an image of a scene captured by the camera; generate an attention output that describes at least one region of the scene that includes a subject of a processing operation performed by the artificial intelligence system; and control the light-emitting device to emit light onto or adjacent a region of the scene that includes the subject of the processing operation performed by the artificial intelligence system.

Abstract: Disclosed herein is a software technology for facilitating an interactive conversational session between a user and a digital conversational character. For instance, in one aspect, the disclosed process may involve two primary phases: (1) an authoring phase that involves a first user accessing a content authoring tool to create a given type of visual conversation application that facilitates interactions between a second user and a digital conversational character in an interactive conversational session, and (2) a rendering phase that involves the second user accessing the created visual conversation application to interact with the digital conversational character in an interactive conversational session. In one implementation, accessing the created visual conversation application may involve detecting an object and identifying information associated with the detected object.

Abstract: In an example, an apparatus comprises a plurality of execution units, and logic, at least partially including hardware logic, to create a scatter gather list in memory and collect a plurality of operating statistics for the plurality of execution units using the scatter gather list. Other embodiments are also disclosed and claimed.

Abstract: In a current image processing environment, providing feedback for a user operation is slow, and a user cannot confirm the result of the operation in real time. Thus, the user interrupts the operation every time the user confirms the feedback, and a time period for performing image processing is long. An image processing device includes a guidance information generator. The guidance information generator acquires trajectory information to be used to segment an image object on an image input from a user, generates guidance information indicating a segmentation region desired by the user based on the trajectory information, and presents the segmentation region based on a user's intention in real-time. The guidance information generator provides a function of smoothly continuously segmenting an image object.

Abstract: In one embodiment, the method includes obtaining a plurality of sensor data items, each specifying a set of values determined from at least one sensor; and training, based on the plurality of sensor data items, a machine learning model configured for classifying sensor data items. The machine learning model includes a data adaptation part configured for determining a modified sensor data item based on an input sensor data item, an encoder configured for determining encoded features based on the modified sensor data item, a decoder configured for determining a decoded sensor data item based on the encoded features, representing an estimation of the input sensor data item, and a classifier configured for determining a class associated with the input sensor data item.

Abstract: Disclosed is a control device querying a preset data set to obtain color vision sensitivity information corresponding to acquired identity information of a user of the augmented reality device; the control device judging whether the user is a color recognition disorder patient according to obtained color vision sensitivity information; the control device acquiring a personalized color display mode corresponding to the color vision sensitivity information as a target color display mode when the user is judged as a color recognition disorder patient; and the control device providing the augmented reality device with the target color display mode so that the augmented reality device employs the target color display mode to display an image.

Abstract: A method and system for localizing a plurality of stationary devices, such as Internet of Things (IoT devices), arranged in an environment is disclosed. A mobile device is configured to survey an environment to generate a three-dimensional map of the environment using simultaneous localization and mapping (SLAM) techniques. The mobile device and the stationary devices are equipped with wireless transceivers, such as Ultra-wideband radios, for measuring distances between the devices using wireless ranging techniques. Based on the measured distances, the mobile device is configured to determine locations of the stationary devices in a reference frame of the three-dimensional map. In some embodiments, the determined locations can be used to enable a variety of spatially aware augmented reality features and interactions between the mobile device and the stationary device.

Abstract: Techniques for providing adaptive assistive technology for assisting users with visual impairment can be used on a computing device. These techniques include displaying content to a user, capturing a series of images or video of the user using a camera, analyzing the series of images or video to determine whether the user is exhibiting behavior or characteristics indicative of visual impairment, and rendering a magnification user interface on the display configured to magnify at least a portion of the content of the display based on a determination that the user is exhibiting behavior or characteristics indicative of visual impairment. The magnification user interface may be controlled based on head and/or eye movements of the user of the computing device.

Abstract: A head-up display of the present disclosure projects a display image on a transparent reflecting member. The head-up display includes: a display device that displays the display image; and a projection optical system that projects the display image displayed on the display device. On an assumption that light reaching a center of a viewpoint region of the observer and corresponding to a center of the virtual image is reference light, the projection optical system includes a prism element that has an incident surface, a reflection surface, and an emitting surface different from the incident surface sequentially in an optical path from the display device. The emitting surface is inclined to the reference light. An inclination amount ?2 of the reference light emitted from the emitting surface with respect to the emitting surface lies in a range of 15°<|?2|<45° in the optical path from the display device.

Abstract: A platform for visualization of traffic information at an observed roadway or traffic intersection converts data collected from sensors for rendering as dynamic animations on a virtual map of the observed roadway or traffic intersection. The platform parses and curates incoming sensor data from either a single or multiple sensors representing one or more objects at the observed roadway or traffic intersection, and translates at least location data of each object for correlation of the object's movement relative to the observed roadway or traffic intersection. The platform then generates dynamic animations of the movement of each object and displays the animations as an overlay on the virtual map.

Abstract: To reduce this amount of bandwidth needed to share 3D map images between mobile devices, according to some embodiments, a user's mobile device (i.e., a host device) may identify its origin in a 3D map and a current virtual camera position relative to the origin based on the physical position of the mobile device. The mobile device may send both the origin and the virtual camera position to another mobile device (i.e., a client device) for use in rendering a corresponding image. Separately, the client device may download the 3D map images from a server, e.g., in preparation for a meeting. In this manner, the host device may send the origin to the client device once, as well as send a data stream of the current virtual camera position for use in accessing the corresponding 3D map images at the client device.

Abstract: A system performs image stabilization of a display in a vehicle, in particular a motor vehicle. The system includes at least one display, in particular a monitor, for visualization; at least one sensor, in particular an acceleration sensor; and a computer unit, in particular an on-board computer. The system is designed to detect, by way of the sensor, a shock to the vehicle, in particular as a result of unevenness of the roadway, and to carry out on the basis thereof, a compensation calculation by use of the computer unit and to output a correction signal to the display, in order to stabilize the visualization on the display.

Abstract: Methods, systems, and devices for dynamic structure and surface environment are described. A columnar structure that may include a tiled surface may be used to create or adjust a surface of physical structure to allow for dynamic columns to provide an augmented physical environment. In some examples, a first plurality of columns may be configured to adjust in a first direction from a first position to a second position, an actuator in contact with some of the columns may be configured to cause the columns to adjust in the first direction from the first position to the second position; and a controller configured to receive information associated with position information of some of the columns and may communicate with the actuator.

Abstract: This application describes a head-mounted display (HMD) for use in virtual-reality (VR) environments. The systems and methods described herein may determine information about a real-world environment surrounding the user, a location of the user within the real-world environment, and/or a pose of the user within the real-world environment. Such information may allow the HMD to display images of the real-world environment in a pass-through manner and without detracting the user from the VR environment. In some instances, the HMD may pass-through images of the real-world environment based on one or more triggering events.

Abstract: An augmented-reality system is combined with a surveying system to make measurement and/or layout at a construction site more efficient. A reflector can be mounted to a wearable device having an augmented-reality system. A total station can be used to track a reflector, and truth can be transferred to the wearable device while an obstruction is between the total station and the reflector. Further, a target can be used to orient a local map of a wearable device to an environment based on a distance between the target and the wearable device.

Abstract: An apparatus for configuring an avatar responsive to a content having at least one of a video and an audio signal includes an authoring unit configured to detect one or more events in a content comprising at least one of a video and an audio signal, categorise one or more of the detected events, and generate an event track for the content, the event track comprising one or more of the categorised events associated with a respective time; a selecting unit configured to select a configuration of an avatar to correspond to a respective categorised event of the event track; and an output generator configured to generate control data to configure an avatar in response to a selected configuration.

Abstract: A method, device, and computer-readable storage medium with instructions for controlling a display of an augmented-reality head-up display device for a transportation vehicle. A position of the transportation vehicle is determined relative to a map; at least one reference point is extracted from the map, the at least one reference point is obtained from an area within a visual range of a driver of the transportation vehicle; transforming the at least one reference point into transportation vehicle coordinates; generating a virtual object for display by the augmented-reality head-up display device, considering the at least one transformed reference point; and outputting the virtual object for display by the augmented-reality head-up display device.

Abstract: A system and method for generating a full three-dimensional (3D) digital geometry for an ear provides a 3D reconstruction model that not only includes the outer area of an ear, but also the inner canal area up to the second bend. The system includes at least one remote server and a PC device. The remote server manages and processes data needed for the 3D model for an ear. The PC device allows a user to access the system and method. The remote server processes a series of video frames to generate outer ear 3D data points. Full ear geometry 3D data points are generated by comparing the outer ear 3D data points with a plurality of ear impressions. Canal 3D data points are then adjusted with a tragus angle for accuracy. The 3D reconstruction model that includes the outer ear area and inner canal area is finally generated.

Abstract: There is provided an information processing system capable of appropriately assisting in creation of a marker, an information processing method, and a program. The information processing system includes an acquisition part configured to acquire a recognition result of a marker that a user is making, and a display control part configured to cause a display face to display assistance information for assisting in creation of the marker depending on the recognition result in association with the marker in process of creation.