Abstract: In some implementations, a method performed by data processing apparatuses includes receiving map data that identifies a layout of physical objects within a physical area, identifying contiguous groups of the physical objects as composite objects, selecting bounding algorithms to use for generating graphical shapes for the composite objects, generating graphical shapes by applying the selected bounding algorithms to the composite objects, and testing the graphical shapes against one or more criteria. For candidate graphical shapes that fail a test, a new bounding algorithm can be selected and the generating and the testing can be repeated using the new bounding algorithm. A simplified graphical map can be output that represents the physical objects within the physical area using the graphical shapes.

Abstract: Disclosed herein is a microparticle analyzing apparatus including a detecting portion configured to simultaneously detect a fluorescence generated from a microparticle in plural wavelength regions and a displaying portion configured to display thereon detection results in the plural wavelength regions in a form of a spectrum.

Abstract: A mechanism is described for facilitating smart point cloud reconstruction of objects in visual scenes in computing environments. An apparatus of embodiments, as described herein, includes one or more processors including one or more graphics processors, and photo-consistency logic to perform line searches on cloud points of an object to enhance photo-consistency between multiple camera views associated with a visual hull encompassing the object in a scene captured by multiple cameras coupled to the one or more processors. The apparatus may further include refinement and application logic to perform a final reconstruction of the object based on the enhanced photo-consistency, where the scene having the reconstructed object is displayed at a display device.

Abstract: To provide masks for augmented reality (AR) effects in real-time, the embodiments described herein capture a plurality of images of an environment that includes one or more real-world objects after initiating an AR session with an AR device located in the environment. Upon detecting a trigger to generate an AR effect targeting a first real-world object of the one or more real-world objects, a first virtual representation of the first real-world object is generated, based on the plurality of images of the environment, and a second virtual representation of a second real-world object of the one or more real-world objects is generated based on the plurality of images of the environment, wherein the second real-world object is at least partially occluded by the first real-world object.

Abstract: Systems and methods for inserting and transforming content are provided. For example, the inserted content may include augmented reality content that is inserted into a physical space or a representation of the physical space such as an image. An example system and method may include receiving an image and identifying a physical location associated with a display management entity within the image. The example system and method may also include retrieving content display parameters associated with the display management entity. Additionally, the example system and method may also include identifying content to display and displaying the content using the display parameters associated with the display management entity.

Abstract: An augmented-reality system interacts with a physical object that has been embossed or otherwise labeled with one or more bar-code identifiers. The system extracts data from each identifier and uses each element of extracted data to select a computer-generated texture or object. When displaying the augmented-reality environment to a user, the system either replaces the physical object with the computer-generated object or applies the computer-generated texture to a region of a rendered surface of the computer-generated object. The application's selection of computer-generated objects or textures may be modified at any time by a user command, a context-sensitive or environmental factor, an occurrence of a certain virtual event within the augmented-reality environment, or a configuration setting.

Abstract: Provided is a display device including a first display unit, a second display unit arranged on a back side of the first display unit, a generation unit configured to perform predetermined image processing on first image data to generate second image data, and a control unit configured to select one of a plurality of display modes including a first display mode on which the first display unit displays an image based on the first image data and the second display unit displays an image based on the second image data, and a second display mode on which the first display unit and the second display unit display the image based on the first image data.

Abstract: The disclosure relates to a method and an apparatus for controlling a field of view of an augmented reality (AR) device. The method includes receiving, by an AR device, an instruction for starting a target application; determining, by the AR device, a preset field of view corresponding to the target application in response to receiving the instruction for starting the target application; and adjusting, by the AR device, a current field of view based on the preset field of view.

Abstract: In one embodiment, a method includes displaying a first virtual content to a first user in a virtual area, the virtual area comprising one or more second virtual content, inferring an intent of the first user to interact with the first virtual content based on one or more of first user actions or contextual information, and adjusting one or more configurations associated with one or more of the second virtual content based on the inferring of the intent of the first user to interact with the first virtual content.

Abstract: Disclosed is an electronic device that includes a display, a memory, and a processor configured to combine a plurality of images based on an execution of a plurality of applications so that the plurality of images is displayed in a single screen form, identify coordinate information of a display area of each of a first image and a second image on the screen based on the first image and second image belonging to the plurality of images and being updated, store the first image and the second image in a contiguous address of the memory, and transmit the coordinate information of the display area of each of the first image and the second image and the stored first image and second image to the display.

Abstract: Provided is a display apparatus including an image forming optical system configured to form an image to be displayed, an eyepiece optical system configured to provide the image formed by the image forming optical system to a pupil of an observer, and an image shifting optical system disposed on an optical path between the image forming optical system and the eyepiece optical system, the image shifting optical system being configured to shift the image formed by the image forming optical system in a direction perpendicular to an optical axis, wherein the image shifting optical system includes a first optical member having a first focal length and a second optical member having a second focal length, and wherein a distance between the first optical member and the second optical member along the optical axis is equal to a sum of the first focal length and the second focal length.

Abstract: Disclosed is a hybrid approach to rendering transparent or translucent objects, which combines object-space ray tracing with texture-space parametrization and integration. Transparent or translucent objects are first parameterized using two textures: (1) a texture that stores the surface normal at each location on the transparent or translucent object, and (2) a texture that stores the world space coordinates at each location on the transparent or translucent object. Ray tracing can then be used to streamline and unify the computation of light transport inside thick mediums, such as transparent or translucent objects, with the rest of the scene. For each valid (e.g., visible) location on the surface of a transparent or translucent object, the disclosed embodiments trace one or more rays through such objects and compute the resulting lighting in an order-independent fashion. The results are stored in a texture, which is then applied during the final lighting stage.

Abstract: An information processing device including a GPU comprises: a retrieval unit that retrieves an instruction set including a first source code block, a plurality of second source code blocks obtained by tuning the first source code block for each of a plurality of GPUs of different types, and attribute information of the GPUs respectively corresponding to the plurality of second source code blocks; a selection unit that selects, from among the first source code block and the plurality of second source code blocks included in the instruction set, a source code block to be executed by the GPU on a basis of attribute information of the GPU; a compilation unit that compiles the selected source code block into a data format that can be interpreted by the GPU; and a control unit that causes the GPU to execute compiled code.

Abstract: Disclosed is an apparatus and method of providing an image processing. An image processing method according to the present disclosure includes: obtaining at least one of image information and depth information of an omni-directional video; and mapping the obtained information to a three-dimensional coordinate system based on a particular three-dimensional figure.

Abstract: Embodiments are generally directed to generating novel images of an object having a novel viewpoint and a novel lighting direction based on sparse images of the object. A neural network is trained with training images rendered from a 3D model. Utilizing the 3D model, training images, ground truth predictive images from particular viewpoint(s), and ground truth predictive depth maps of the ground truth predictive images, can be easily generated and fed back through the neural network for training. Once trained, the neural network can receive a sparse plurality of images of an object, a novel viewpoint, and a novel lighting direction. The neural network can generate a plane sweep volume based on the sparse plurality of images, and calculate depth probabilities for each pixel in the plane sweep volume. A predictive output image of the object, having the novel viewpoint and novel lighting direction, can be generated and output.

Abstract: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor to execute the instructions to perform operations that include receiving data representing a character in multiple variants of a font. Operations also include, for each font variant, dividing the character into segments, identifying one of the segments, for each font variant, as representing an equivalent portion of the character, and, determining one minimum number of curve control points for representing each of the identified segments. Operations also include determining a representation of each of the identified segments that uses the determined one minimum number of control points, and, storing data that represents the determined representations of the identified segments for later retrieval of the character in one or more of the multiple variants of the font.

Abstract: A scene presented by a headset is adjusted to correct for distortion from optical errors of an optics block in the headset. To correct for the distortion, the scene is pre-distorted when presented based on previously modeled distortion of the optics block, so distortion from the optics block corrects the pre-distortion. To model the distortion, the headset displays calibration image including features and images of the calibration image are captured from multiple positions. Differences between locations of features in the calibration images and locations of corresponding features in captured images of the calibration image are identified and a distortion correction is determined based on the differences.

Abstract: Particular embodiments may access one or more images configured to be used for generating an artificial reality (AR) effect. For each image, one or more compressed images may be generated using different compression settings, respectively. For each compressed image, a quality score may be computed based on that compressed image and the associated image from which the compressed image is generated. For each image, a desired quality threshold may be determined, and an optimal compression setting for that image may be determined based on the desired quality threshold and quality scores associated with the one or more compressed images generated from that image, wherein the optimal compression setting corresponds to one of the plurality of different compression settings. Each of the one or more images may be compressed using the associated optimal compression setting to generate and output one or more optimally-compressed images.

Abstract: Embodiments of the present disclosure are directed to methods and computer systems for converting datasets into three-dimensional (“3D”) mesh surface visualization, displaying the mesh surface on a computer display, comparing two three-dimensional mesh surface structures by blending two primary different primary colors to create a secondary color, and computing the distance between two three-dimensional mesh surface structures converted from two closely-matched datasets. For qualitative analysis, the system includes a three-dimensional structure comparison control engine that is configured to convert dataset with three-dimensional structure into three-dimensional surfaces with mesh surface visualization. The control engine is also configured to assign color and translucency value to the three-dimensional surface for the user to do qualitative comparison analysis. For quantitative analysis, the control engine is configured to compute the distance field between two closely-matched datasets.

Abstract: In accordance with various embodiments, a method is performed at an electronic device including a display device and one or more input devices. The method includes displaying, on the display device, a first graphing area presenting a plot of a first set of data points for a first variable versus a first set of data points for a second variable. The method includes displaying, on the display device, an indication of a relationship between the first variable and the second variable. The method includes detecting, via the one or more input devices, a user input indicative of change to the relationship between the first variable and the second variable. The method includes determining, based on the changed relationship between the first variable and the second variable, a second set of data points. The method includes displaying, on the display device, a second graphing area presenting a plot of the second set of data points.