Abstract: An information processing device for drawing an object arranged in a three-dimensional virtual space, in an expression viewed from a virtual camera, the object including a field object associated with a two-dimensional plane defined by a first axis and a second axis, and a specific object arranged on the field object, the device including: a change processing unit changing a region of the field object falling within a viewing angle of the virtual camera; and a deformation processing unit deforming the field object, in which in a case where the region is changed by the change processing unit, the deformation processing unit makes a deformation mode of the field object different when it is determined that the specific object is positioned in the region after being changed and when it is determined that the specific object is not positioned in the region after being changed.

Abstract: Embodiments of the present disclosure relate to techniques for providing an augmented reality experience for virtual desktops. In particular, certain embodiments relate to acquiring, by a computing device one or more images from a client device and determining, by the computing device, that the one or more images contain an artifact to be augmented. Further, certain embodiments involve acquiring, by the computing device, a screen buffer from a virtual desktop or application running on it and applying, by the computing device, a geometric transformation to the screen buffer. Further, certain embodiments relate to augmenting, by the computing device, the one or more images by inserting the screen buffer onto the artifact, resulting in one or more augmented images. Further, certain embodiments relate to providing, by the computing device, the one or more augmented images to the client device in order to provide a user of the client device with the augmented reality experience.

Abstract: The invention relates to a method for 3D reconstruction of an object comprising the following steps: generating a plurality of images of an object by at least one camera; extracting features of the object from the plurality of images; generating a cloud of three dimensional points arranged in a three dimensional model representing the object; identifying the images each of which comprises at least one of a subset of said features; determining a first set of three dimensional points corresponding to the subset of said features and a second set of three dimensional points; determining a mathematical equation which corresponds to a predefined three dimensional geometric structure as a building block of the object by means of the first set and the second set of the three dimensional points; and rendering a three dimensional model of the object by means of at least the predefined three dimensional geometric structure.

Abstract: An ophthalmologic apparatus comprises eye information obtaining portions, each of the eye information obtaining portions corresponding to each of subject eyes of a subject and configured to obtain information on each of the subject eyes; imaging portions, each of the imaging portions corresponding to each of the eye information obtaining portions and configured to capture a subject eye image of each of the subject eyes; a reference calculator configured to obtain a three-dimensional reference position in each of the subject eye images captured by each of the imaging portions; an inclination calculator configured to obtain inclination information indicating inclination of relative positions of the subject eyes from the obtained three-dimensional reference positions in the subject eye images; and a notification portion configured to notify the obtained inclination information.

Abstract: In some implementations, a device may determine dimensions of an installation area in a real-world environment and may obtain information identifying dimensions of an installation template associated with installing an equipment in the real-world environment. The device may determine a scale for displaying augmented reality representations associated with installing the equipment, based on the dimensions of the installation area and the dimensions of the installation template. The device may identify, based on information identifying an installation point of the installation template, a virtual installation point associated with installing the equipment in the installation area. The user device may display an augmented reality representation of the virtual installation point to enable a depiction of a corresponding real installation point in the installation area. The augmented reality representation may be displayed based on the scale and a distance from the user device to the installation area.

Abstract: The method performed at an electronic device including one or more processors, a non-transitory memory, and a depth sensor includes: obtaining a task associated with a physical object within a physical environment; obtaining depth information, via the depth sensor, associated with the physical environment; determining one or more measurements for the physical object based at least in part on the depth information; obtaining a graphical overlay based at least in part on the task and the one or more measurements for the physical object; and causing presentation of the graphical overlay adjacent to a representation of the physical object, wherein the representation is obtained using sensor readings of the physical object.

Abstract: One variation of a method includes: accessing a 2D color image recorded by a 2D color camera and a 3D point cloud recorded by a 3D depth sensor at approximately a first time, the 2D color camera and the 3D depth sensor defining intersecting fields of view and facing outwardly from an autonomous vehicle; detecting a cluster of points in the 3D point cloud representing a continuous surface approximating a plane; isolating a cluster of color pixels in the 2D color image depicting the continuous surface; projecting the cluster of color pixels onto the plane to define a set of synthetic 3D color points in the 3D point cloud, the cluster of points and the set of synthetic 3D color points representing the continuous surface; and rendering points in the 3D point cloud and the set of synthetic 3D color points on a display.

Abstract: A system, apparatus and method, the system comprising: a scanning device for obtaining three dimensional (3D) information about a cavity surrounding a user, the scanning device comprising a localization and mapping device and an inertial measurement unit; an image capture device for capturing images within the cavity; a processor for receiving the information collected by the scanning device and generating a model of the cavity based on the information; and a display device adapted to display to the user a representation of the model of the cavity, and a route taken by the user within the cavity, wherein the scanning device and the display device are adapted to be attached to at least one wearable item, thereby enabling the user to advance with free hands within the cavity.

Abstract: This size measuring system has: a size measuring instrument 10 which has, disposed on the surface thereof, a plurality of identifiable markers and which is attached to the body of a user when measuring the size of the body of the user; a measurement terminal 20 which measures the size of the body of the user by photographing the user having the size measuring instrument 10 attached thereto; a business operator terminal 30 which is operated by a provider providing the size measuring instrument 10; and a product data management server 40 which stores therein a database of product data including size information of products, such as garments to be worn by the user.

Abstract: Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

Abstract: Under an embodiment of the invention, an image capturing and processing system creates 3D image-based rendering (IBR) for real estate. The system provides image-based rendering of real property, the computer system including a user interface for visually presenting an image-based rendering of a real property to a user; and a processor to obtain two or more photorealistic viewpoints from ground truth image data capture locations; combine and process two or more instances of ground truth image data to create a plurality of synthesized viewpoints; and visually present a viewpoint in a virtual model of the real property on the user interface, the virtual model including photorealistic viewpoints and synthesized viewpoints.

Abstract: Various examples are provided for obtaining body measurements of a user, predicting body measurements of a user, and/or the like. Examples include a coded dimensioning garment having a stretchable fabric that conforms to a wearer's body without substantial compression or distortion of the skin. The garment can include measurement markings of known sizes at one or more known locations on the fabric. Methods are provided for predicting body measurements from a user. Image(s) of a user wearing the garment in a reference pose are captured and can be uploaded to a body measurement application. The real-world dimensions can be converted to pixel dimensions in the same ratio as the real world dimensions and inputted into a prediction model to generate measurements from areas of interest on the user.

Abstract: This disclosure describes efficient communication of surface texture data between system on a chip (SOC) integrated circuits. An example system includes a first integrated circuit, and at least one second integrated circuit communicatively coupled to the first integrated circuit by a communication interface. The first integrated circuit, upon determining that surface texture data of a frame to be rendered for display by the second SoC integrated circuit is to be updated, (a) transmits the surface texture data in one or more update packets to the second integrated circuit using the communication interface, and (b) transmits a command to the second integrated circuit indicating that the surface texture data of the frame has been updated using the communication interface.

Abstract: Systems and methods of generating ground truth datasets for producing virtual reality (VR) experiences, for testing simulated sensor configurations, and for training machine-learning algorithms. In one example, a recording device with one or more cameras and one or more inertial measurement units captures images and motion data along a real path through a physical environment. A SLAM application uses the captured data to calculate the trajectory of the recording device. A polynomial interpolation module uses Chebyshev polynomials to generate a continuous time trajectory (CTT) function. The method includes identifying a virtual environment and assembling a simulated sensor configuration, such as a VR headset. Using the CTT function, the method includes generating a ground truth output dataset that represents the simulated sensor configuration in motion along a virtual path through the virtual environment.

Abstract: A method, an apparatus, a device and a storage medium for three-dimensional reconstruction are provided. The method may include: acquiring a sequence of RGBD images of a target; determining a set of first three-dimensional key points of the target on each RGBD image for the each RGBD image in the sequence of the RGBD images; transferring the set of the first three-dimensional key points to a camera coordinate system to obtain a set of second three-dimensional key points of the target in the camera coordinate system; calculating an Euler angle of the each RGBD image based on the set of the second three-dimensional key points; selecting an RGBD image based on the Euler angle; and performing three-dimensional reconstruction of the target based on the selected RGBD image to obtain a three-dimensional model of the target.

Abstract: In an image processing system, artist user interface provides for user input of specifications for an inserted object, specified in frame space. The inserted objects can be specified in frame space but can be aligned with object points in a virtual scene space. For other frames, where the object points move in the frame space, the object movements are applied to the inserted object in the frame space. The alignment can be manual by the user or programmatically determined.

Abstract: Methods and apparatus relating to techniques for avoiding cache lookup for cold cache. In an example, an apparatus comprises logic, at least partially comprising hardware logic, to receive a completion acknowledgment from the plurality of graphics processing units and in response to a determination that the workload is finished, to terminate one or more communication connections on the interconnect bridge. Other embodiments are also disclosed and claimed.

Abstract: Presented is a convolutional neural network (CNN) model for fingernail tracking, and a method design for nail polish rendering. Using current software and hardware, the CNN model and method to render nail polish runs in real-time on both iOS and web platforms. A use of Loss Mean Pooling (LMP) coupled with a cascaded model architecture simultaneously enables pixel-accurate fingernail predictions at up to 640×480 resolution. The proposed post-processing and rendering method takes advantage of the model's multiple output predictions to render gradients on individual fingernails, and to hide the light-colored distal edge when rendering on top of natural fingernails by stretching the nail mask in the direction of the fingernail tip. Teachings herein may be applied to track objects other than fingernails and to apply appearance effects other than color.

Abstract: Systems and methods for psycho-signal processing. According to an aspect, a method includes receiving a visual representation of a subject. The method also includes performing a structured motion operation on the received visual representation to generate a modified visual representation of the subject. The method further includes presenting, via a user interface, the modified visual representation.

Abstract: An information processing apparatus includes a detector and a command unit. The detector detects movement of a user using a display device based on an image photographed by the display device that displays a virtual-space image in such a manner as to be overlapped with a real space and that has a photographing function. The command unit commands the display device to display, as the virtual-space image, relevant information related to input information input to an input target at a position near the input target based on the detected movement of the user.