Abstract: In the disclosed systems and methods for competitive scene completion, an application displays an initial scene of a first scene completion challenge and displays within the initial scene a plurality of markers. Each of the markers has corresponding predefined designated coordinates and corresponds to a furnishing unit type. The application also displays virtual furnishing units that match the furnishing unit type of a corresponding marker. User selection of virtual furnishing units results in display of a three-dimensional rendition of the selected units at corresponding coordinates within the scene, thereby creating an augmented scene that comprises the initial scene with three-dimensional renditions of selected virtual furnishing units. The augmented scene or user selections of virtual furnishing units is submitted to a remote server and the user is provided with a reward.

Abstract: An electronic device may identify a marker in an image based on an input to the image displayed on the display, identify at least one object associated with the marker using marker information of the identified marker, display the identified at least one object on the display as recommendation contents associated with the marker, and map at least part of the at least one object to the marker based on an input to generate augmented reality contents.

Abstract: A method for creating a 3D image is described. The method includes receiving a first 2D image and a second 2D image, identifying a plurality of first feature points in the first 2D image and a corresponding plurality of second feature points in the second 2D image, estimating a plurality of distances based on corresponding ones of the plurality of first feature points and based on corresponding ones of the plurality of second feature points, determining a mean and a standard deviation of inverses of the plurality of distances that were estimated, generating a baseline initialization coordinates based on the mean and the standard deviation of inverses of the plurality of distances, generating the 3D image based on the baseline initialization coordinates, and providing the 3D image for display. Related systems, devices and computer program products are also described.

Abstract: Provided is a method, computer program product, and virtual reality (VR) system for altering a VR simulation based on the physical capabilities of a user. A processor may receive one or more personal health factors corresponding to a user. The processor may prepare a VR simulation for a rendering. The processor may identify one or more physical characteristics of the user from the personal health factors. The processor may determine if the one or more physical characteristics affect the interaction of the user within the VR simulation. The processor may modify, in response to determining the one or more physical characteristic affect the interaction of the user within the VR simulation, user input options for interacting with the VR simulation. The processor may modify the rendering of the VR simulation in a display of a VR device based on the modified user input options.

Abstract: A first part of a 3-dimensional object is generated for display and displayed on a display device. The first part has at least a base interface and a first interface. The displayed first part is caused to change shape. A second part of the 3-dimensional object is generated for display, the second part having at least a base interface. The second part is translated and oriented so that the base interface of the second part mates with the first interface of the first part when the second part is displayed on the display device. The second part is displayed on the display device with the base interface of the second part mating with the first interface of the first part.

Abstract: An augmented reality, mixed reality or virtual reality device is used to create occupational knowledge documentation, such as instruction and/or repair documentation for industrial equipment or processes. The device can be configured to capture time-synchronized data during a session in which an expert person, wearing or holding the device, performs a task to be documented. The data can include, for example, video data captured by a camera, audio data captured by a microphone within audio proximity of the camera, motion data captured by an inertial measurement unit physically fixed relative to the camera, and spatial data relating to locations of at least one of the plurality of objects within the field of view of the camera, wherein the spatial data is generated by one or more spatial sensors. The captured data can be automatically processed and used to render instruction on an augmented reality, mixed reality or virtual reality device.

Abstract: A method performed by an electronic device is described. The method includes receiving first optical data and first depth data corresponding to a first frame. The method also includes registering the first depth data to a first canonical model. The method further includes fitting a three-dimensional (3D) morphable model to the first optical data. The method additionally includes registering the 3D morphable model to a second canonical model. The method also includes producing a 3D object reconstruction based on the registered first depth data and the registered 3D morphable model.

Abstract: Computer processor hardware receives settings information for a first image. The first image includes a set of multiple display elements. The computer processor hardware receives motion compensation information for a given display element in a second image to be created based at least in part on the first image. The motion compensation information indicates a coordinate location within a particular display element in the first image to which the given display element pertains. The computer processor hardware utilizes the coordinate location as a basis from which to select a grouping of multiple display elements in the first image. The computer processor hardware then generates a setting for the given display element in the second image based on settings of the multiple display elements in the grouping.

Abstract: A method, system, and computer program, for providing the virtual object in the virtual or semi-virtual environment, based on a characteristic associated with the user. In one example embodiment, the system comprises at least one computer processor, and a memory storing instructions that, when executed by the at least one computer processor, perform a set of operations comprising determining the characteristic associated with the user in the virtual or semi-virtual environment with respect to a predetermined reference location in the environment, and providing a virtual object based on the characteristic.

Abstract: In one embodiment, a computing system may determine an orientation in a three-dimensional (3D) space and generate a plurality of coordinates in the 3D space based on the determined orientation. The system may access pre-determined ray trajectory definitions associated with the plurality of coordinates. The system may determine visibility information of one or more objects defined within the 3D space by projecting rays through the plurality of coordinates, wherein trajectories of the rays from the plurality of coordinates are determined based on the pre-determined ray trajectory definitions. The system may then generate an image of the one or more objects based on the determined visibility information of the one or more objects.

Abstract: A face image processing method includes: performing face detection on a to-be-processed image, to obtain at least one face region image included in the to-be-processed image and face key point information in the at least one face region image; and processing, for the at least one face region image, an image corresponding to a first region and/or an image corresponding to a second region in the face region image at least according to the face key point information in the face region image, wherein the image corresponding to the second region and the image corresponding to the first region are at least partially non-overlapping.

Abstract: A display control apparatus includes a reception unit configured to receive a virtual viewpoint in accordance with user operation, and a display controller configured to perform control such that a first virtual viewpoint image generated based on the virtual viewpoint and a second virtual viewpoint image having a virtual imaging range larger than a virtual imaging range of the first virtual viewpoint image are displayed on a display screen.

Abstract: A design engine analyzes a complex polygonal mesh to identify regions of that mesh that can be simplified. The design engine then replaces those identified regions with simplified geometry that is more easily fabricated using traditional techniques. The remaining complex regions of the mesh are fabricated using additive fabrication techniques. The design engine interacts with both a traditional fabrication device and an additive fabrication device to fabricate the simplified and complex regions of the mesh, respectively. In this manner, a hybrid 3D structure is generated that includes both simplified geometry and complex geometry.

Abstract: In one aspect, there is provided a system including at least one data processor and at least one memory. The at least one memory may store instructions that cause operations when executed by the at least one data processor. The operations may include retrieving a set of authentic base class images from a database. The operations may further include generating, based on the set of authentic base class images, a three dimensional mesh of the base class. The operations may further include retrieving a set of authentic novel class images. The operations may further include generating, at a first neural network and based on the three dimensional mesh and the set of authentic novel class images, a set of synthetic novel class images. The operations may further include training a second neural network based on the set of synthetic novel class images.

Abstract: User interface systems for sterile fields and other working environments are disclosed herein. In some embodiments, a user interface system can include a projector that projects a graphical user interface onto a data board or other substrate disposed within a working environment. The system can also include a camera or other sensor that detects user interaction with the data board or substrate. Detected user interactions can be processed or interpreted by a controller that interfaces with equipment disposed outside of the working environment, thereby allowing user interaction with such equipment from within the working environment. The data board can be an inexpensive, disposable, single-use component of the system that can be easily sterilized or another component suitably prepared for use in a sterile field.

Abstract: A system comprises an obtainment unit that obtains virtual viewpoint information relating to a position and direction of a virtual viewpoint; a designation unit that designates a focus object from a plurality of objects detected based on at least one of the plurality of images captured by the plurality of cameras; a decision unit that decides an object to make transparent from among the plurality of objects based on a position and direction of a virtual viewpoint that the virtual viewpoint information obtained by the obtainment unit indicates, and a position of the focus object designated by the designation unit; and a generation unit that generates, based on the plurality of captured images obtained by the plurality of cameras, a virtual viewpoint image in which the object decided by the decision unit is made to be transparent.

Abstract: A method for generating synthetic data is provided. The method includes retrieving, from a database, a set of authentic base class images. The method further includes generating a three dimensional mesh of a base class. The method further includes retrieving, from the database, a set of textual descriptions. The method further includes retrieving a set of authentic novel class images. The method further includes generating, at a first neural network, a set of synthetic novel class images, the generating based on at least the three dimensional mesh, the set of textual descriptions, and/or the set of authentic novel class images. The method further includes training, based on at least the set of synthetic novel class images, a second neural network, the second neural network ranking the set of synthetic novel class images and outputting a set of highest ranked synthetic images from the set of synthetic novel class images.

Abstract: In the disclosed systems and methods for competitive scene completion, in conjunction with a scene completion challenge, an image of an initial scene and a plurality of markers are displayed. For each user marker selection, virtual furnishing units corresponding to the unit type are displayed. User unit selection results in display of a three-dimensional graphic of the selected virtual furnishing unit at the corresponding coordinates within the scene, thereby creating an augmented scene that comprises the initial scene with three-dimensional graphics of selected virtual furnishing units. The augmented scene is submitted to a remote server. The user is provided with a reward that consists of credits. Responsive to user selection to access the store, a user interface for the store is displayed within the application. Visual representations of tangible products are displayed. The credits are configured for use towards purchase of the tangible products.

Abstract: A colored three-dimensional point cloud is encoded in at least two depth and texture images. The proposed method and device use inverse project pixels of the first image and inverse project pixels to the second image. When the inverse projecting of a first pixel of the first image and the inverse projecting of a second pixel of the second image refer to a common generated point, that is two 3D points closer to each other than the imprecision due to the encoding and compression of the images, the color value of the pixel of first and second pixels having the lowest local depth variance is attributed to the common generated point.

Abstract: An anatomic structure of interest is contoured in 3D source data by selecting a first subset of data in a first image slice, which has a first orientation in the source data. A first set of instructions identifies a first edge (E1) of the anatomic structure of interest in the first image slice. Then, a second subset of data is selected in a second image slice, which has a second orientation in the source data. A second set of instructions identifies a second edge (E2) of the anatomic structure of interest in the second image slice. A three-dimensional shell (3DS) is calculated based on the first and second edges (E1; E2) and the source data (SD). The three-dimensional shell (3DS) represents an approximation of a delimiting surface that separates the anatomic structure of interest from adjoining tissues in the 3D source data.