Abstract: An information processing apparatus that constructs a virtual space by acquiring a plurality of images obtained by observing, at different times, a reality space in which one or more subjects are present, and arranging a plurality of unit volume elements at positions determined depending on a subject captured in each image of the plurality of images.

Abstract: Methods and user interfaces are provided for the display of data comprising series of data over time, with particular application to medical laboratory results and prescriptions of medication. A user may view multiple results simultaneously in a single display, with the abilities to zoom the time scale in and out and to select the time period for which results are displayed. Multiple displayed items of data may be selected for simultaneous display along a common time axis in a zoomable graph, facilitating interpretation of relationships between and/or among data items.

Abstract: Firmware interfaces scale a fixed-font utilized by the firmware interfaces to display glyphs of the fixed-font at a native resolution or a preferred resolution of a display. A conversion factor is generated for scaling the glyphs of the font using the native resolution or the preferred resolution. The glyphs may be scaled using the conversion factor. The scaled glyphs may be stored and utilized to display text of the firmware interface in the native resolution or the preferred resolution.

Abstract: A device including a storage medium storing instructions, and at least one processor configured to execute the stored instructions to perform operations is provided. The operations include displaying on a display screen an interactive scene containing an augmented reality element, receiving input to change display of the interactive scene, and receiving a request to simulate the capturing of image data representing the interactive scene. The operations further include determining a position of the augmented reality element relative to a region defined on the display screen, simulating the capturing of the image data representing the interactive scene, and providing, based on the determined position, an indication of whether the simulation has succeeded.

Abstract: A non-transitory computer readable medium having program instructions configured to cause a computing device to execute an interface editor that performs the following operations: rendering through a head-mounted display (HMD) a view of a three-dimensional virtual space, the interface editor being configured to enable placement of user interface elements in the virtual space to define a virtual reality user interface for an interactive application; wherein the interface editor is configured to define within the virtual space a central zone and a lateral zone for placement of the user interface elements; receiving, by the interface editor, input indicating an attempt to move a given user interface element from the central zone to the lateral zone; responsive to receiving the input, generating, by the interface editor, a counteractive response that opposes the attempt to move the given user interface element from the central zone to the lateral zone.

Abstract: An aspect of the disclosure provides a processing method for display data applied in a computing device, which processing method includes: determining a region of interest in the display area of the computing device; compressing data of an image in the display area; and transmitting data of an image of the region of interest and the compressed image data in the display area. The disclosure further provides a corresponding processing device and display device.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: In one embodiment, a method includes identifying an emotion associated with an identified first object in one or more input images, selecting, based on the emotion, a mask from a set of masks, where the mask specifies one or more mask effects, and for each of the input images, applying the mask to the input image. Applying the mask includes generating graphical features based on the identified first object or a second object in the input images according to instructions specified by the mask effects, and incorporating the graphical features into an output image. The emotion may be identified based on graphical features of the identified first object. The graphical features of the identified object may include facial features. The selected mask may be selected from a lookup table that maps the identified emotion to the selected mask.

Abstract: A position/posture acquiring unit of image generating apparatus acquires information on the position and posture of the head of a user. A view screen control unit sets a view screen according to the point of view of a user. An original image operating unit disposes an original image in a virtual space and moves the position thereof in response to movement of the point of view of the user. In addition, the original image operating unit calculates the amount of displacement of pixels in such a manner that an object looks fixed. Thereby, the original image operating unit sets a reference vector for each pixel of the image plane. The original image operating unit decides the reference vector by interpolation regarding a pixel for which the reference vector is not set. A displayed image generating unit carries out mapping of the original image onto the view screen by using the obtained reference vectors to generate a displayed image. An output unit outputs the displayed image.

Abstract: An action evaluation apparatus 10 includes: an action detection unit 11 that detects an action of a target person; an action evaluation unit 12 that determines whether or not the detected action matches a specific action set in advance; and a visual representation addition unit 13 configured to, if it is determined by the action evaluation unit 12 that the detected action matches the specific action, specify a part of the person associated with the specific action in advance and add a visual representation to the part associated with the specific action on the person or an object representing the person displayed on a screen.

Abstract: A method of exchanging audio-visual communication information between users includes detecting using an image capturing device associated with a wearable communication device, a mirror or image reflecting surface disposed in an environment of a first user, detecting a boundary of the mirror or image reflecting surface in response to the mirror being detected in the environment of the first user, selecting a portion of a first image displayed on the mirror or image reflecting surface within the boundary of the mirror or image reflecting surface, and displaying the portion of the first image as an overlay on a second image to a second user. A corresponding system and computer-readable device are also disclosed.

Abstract: A method for aligning an image on a mobile device disposed within a head-mounted display (HMD) housing includes: detecting a request to align an image on a touchscreen of a mobile device; detecting, on the touchscreen, a first detected location corresponding to a first touchscreen input event; determining a first displacement of the first detected location with respect to a first target location of the first touchscreen input event; and transposing the image on the touchscreen based on the first displacement. A virtual reality system includes: a mobile device having a touchscreen configured to display an image; and a HMD housing having a first contact configured to generate a first input event at a first location on the touchscreen when the mobile device is disposed within the HMD housing.

Abstract: An information processing system includes an attribute-information acquisition unit and an identification unit. The attribute-information acquisition unit acquires an attribute of an object that is present in a real space in accordance with information regarding the object an object image of which is captured. The identification unit identifies an image that is a virtual image associated with the attribute acquired by the attribute-information acquisition unit, the image being to be combined with the object image.

Abstract: A system, method and non-transitory computer-readable storage medium used to control the display of a display device. Controlling of the display device includes receiving data including a plurality of data points, each of the data points including a value along a first axis and a value along a second axis, dividing the data into a plurality of bins along the first axis, wherein the data is divided based on a physical attribute of the display device, determining, for one of the bins, whether an alternative data representation should be used, and displaying a plot of the data, wherein the alternative data representation is used for the one of the bins when it is determined that the alternative data representation should be used, wherein line plotting is used for the one of the bins when it is determined that the alternative data representation should not be used.

Abstract: A device connectable to a near eye display or to a virtual reality headset and to a portable computing platform having a processor is provided herein. The device may include: an illuminator configured to illuminate a proximity of a user wearing the headset or the near eye display with patterned light; and an TR camera configured to capture reflections of said patterned light coming from at least one object located in the proximity of the user, wherein the processor is configured to: establish data and power connection between the device and said poliable computing platform and said near eye display; and generate a depth map of said object based on the reflections.

Abstract: A method for aligning a patient implant, the method comprising the steps of: generating a digital implant model of the patient implant; determining a desired alignment of the patient implant based on predetermined alignment data; imaging an operative area of the patient to create patient-specific implant reference data; creating a virtual overlay of the digital implant model in the determined desired alignment relative to the patient-specific implant reference data; and operatively aligning the patient implant using the virtual overlay. A patient implant system to implement the method is also provided.

Abstract: A computer-implemented method of manipulating some portion of a 3D representation of a scene from a reference view direction using a touch-sensitive display unit that includes identifying, by the touch-sensitive display unit, the portion of the 3D representation of the scene to be translated; generating and displaying on some portion of a display device of the touch-sensitive display unit a second 3D representation of the scene from an auxiliary view direction that may be selectively adjustable; and using the second 3D representation of the scene to translate the portion of the 3D representation of the scene.

Abstract: Disclosed is a method including receiving visual input comprising a human within a scene, detecting a pose associated with the human using a trained machine learning model that detects human poses to yield a first output, estimating a shape (and optionally a motion) associated with the human using a trained machine learning model associated that detects shape (and optionally motion) to yield a second output, recognizing the scene associated with the visual input using a trained convolutional neural network which determines information about the human and other objects in the scene to yield a third output, and augmenting reality within the scene by leveraging one or more of the first output, the second output, and the third output to place 2D and/or 3D graphics in the scene.

Abstract: Optimizations are provided for late stage reprojection processing for a multi-layered scene. A multi-layered scene is generated. Late stage reprojection processing is applied to a first layer and different late stage reprojection processing is applied to a second layer. The late stage reprojection processing that is applied to the second layer includes one or more transformations that are applied to the second layer. After the late stage reprojection processing on the various layers is complete, a unified layer is created by compositing the layers together. Then, the render the unified layer is rendered.

Abstract: A computer-implemented method, computer program product, and computing system is provided for interacting with images having similar content. In an embodiment, a method may include identifying a plurality of photographs as including a common characteristic. The method may also include generating a flipbook media item including the plurality of photographs. The method may further include associating one or more interactive control features with the flipbook media item.