Abstract: Described are techniques for producing a three-dimensional model of a scene from one or more two dimensional images. The techniques include receiving by a computing device one or more two dimensional digital images of a scene, the image including plural pixels, applying the received image data to scene generator/scene understanding engine that produces from the one or more digital images a metadata output that includes depth prediction data for at least some of the plural pixels in the two dimensional image and that produces metadata for a controlling a three-dimensional computer model engine, and outputting the metadata to a three-dimensional computer model engine to produce a three-dimensional digital computer model of the scene depicted in the two dimensional image.

Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.

Abstract: A method, device, and computer-readable storage medium for generating a proxy mesh. The method includes: receiving an input polygonal mesh that includes multiple sub-meshes, each of which is a polygonal mesh, where the input polygonal mesh is a computer representation of a three-dimensional (3D) object; generating a voxel volume representing the input polygonal mesh, wherein the voxel volume comprises voxels that approximates a shape of the 3D object, wherein a first set of voxels of the voxel volume includes voxels that are identified as boundary voxels that correspond to positions of polygons of the multiple sub-meshes of the input polygonal mesh; determining a grouping of two or more sub-meshes that together enclose one or more voxels of the voxel volume other than the voxels in the first set of voxels; and generating a proxy mesh corresponding to the input polygonal mesh based on the grouping of two or more sub-meshes.

Abstract: An apparatus and method for efficient ray tracing. For example, one embodiment of an apparatus comprises: a general purpose processor to generate a plurality of ray streams; a first hardware queue to receive the ray streams generated by the general purpose processor; a graphics processing unit (GPU) comprising a plurality of execution units (EUs) to process the ray streams from the first hardware queue; a second hardware queue to store graphics processing jobs submitted by the GPU; the general purpose processor to process the jobs submitted by the GPU and share results with the GPU.

Abstract: Processing of commands at a graphics processor are controlled by receiving input data and generating a command for processing at the graphics processor from the input data, wherein the command will cause the graphics processor to write out at least one buffer of data to an external memory, and submitting the command to a queue for later processing at the graphics processor. Subsequent to submitting the command, but before the write to external memory has been completed, further input data is received and it is determined that the buffer of data does not need to be written to external memory. The graphics processor is then signalled to prevent at least a portion of the write to external memory from being performed for the command.

Abstract: An apparatus includes: an object data storage section that stores polygon identification data for polygons of an object to be displayed; a reference image data storage section that stores data of reference images each representing an image when a space including the object to be displayed is viewed from one of a plurality of prescribed reference viewing points, and further stores polygon identification data corresponding to each reference image; a viewing point information acquisition section that acquires information relating to a viewing point; a projection section that represents on a plane of a display image the position and shape of an image of the object when the space is viewed from the viewing point; a pixel value determination section that determines the values of pixels constituting the image of the object in the display image, using the values of the pixels representing the same image in one or more of the plurality of reference images; and an output section that outputs the data of the display ima

Abstract: An object shaping method is provided and includes: a data reading stage of reading a three-dimensional object data representing a three-dimensional object to be shaped, a slice data generating stage of generating a slice data representing a cross section of the three-dimensional object, and an object shaping stage of shaping the three-dimensional object in accordance with the slice data. In the slice data generating stage, pieces of slice data representing shapes and colors of the three-dimensional object at a plurality of different positions set in a layer-stacking direction are generated. A color adjustment process is executed at a time of generating the slice data associated with at least part of the plurality of different positions in the layer-stacking direction. The color adjustment process is a process for moderating variability of color appearance to the eye along an outer surface shape of the three-dimensional object shaped in the object shaping stage.

Abstract: Systems and methods for optimizing a model file include an occlusion reduction process. The occlusion reduction process includes acts of: i) identifying one or more points on a mesh section of a model, ii) determining an occlusion value for each of the one or more points on the surface of the mesh section by performing a ray cast rendering of each of the one or more points, iii) determining whether the one or more occlusion values meet or exceed a predetermined occlusion threshold value, and iv) removing the mesh section from the model. Systems and methods for optimizing a model file may include other optimization processes, such as an instancing step, a selective decimation step, a texture reduction step, and/or a texture formatting step.

Abstract: The disclosure is directed to embodiments for producing high-quality images simulating the application of a material (e.g., virtual cosmetics) to a person's body. Example implementations can generate an augmented image displaying a virtual cosmetic layer (e.g., lipstick) on a person's face. For instance, a computing system can obtain an image depicting the face and identify a region for applying the cosmetic. The system can use augmented reality and/or image filtering to process the image into datasets that can be combined with material data related to the virtual cosmetic to generate augmented image(s) simulating application of the material.

Abstract: A map constructing method adopted by a map constructing apparatus and includes steps of: continually obtaining colored image and depth-image information by an image sensor and a depth sensor of the map constructing apparatus while the map constructing apparatus is moving; recognizing the colored image for determining whether a dynamic object exists; labelling an object area corresponding to the location of the dynamic object if the dynamic object exists in the colored image; mapping the object area to a depth-image coordinate adopted by the depth-image information, searching for a corresponding position of the object area in the depth-image information and filtering the object area from the depth-image information for generating an adjusted depth-image information; and, inputting the adjusted depth-image information to a map constructing algorithm for establishing map data.

Abstract: A display apparatus mountable on a mobile object, which: obtains a display location and a movement direction of a virtual object to be displayed in a display area of the display apparatus so as to be overlaid in a real world, the virtual object to be moved relative to movement of the mobile object; estimates a time it will take for the virtual object to move from the display location to a border of the display area, or a distance between the display location of the virtual object and the border of the display area, each based on the display location and the moving direction of the virtual object; determines a display form of the virtual object based on the estimated time or the estimated distance; and causes the virtual object be displayed in the determined display form, such that the virtual object changes the display form while moving in the display area.

Abstract: Logically-defined pixel interfaces and video frame transfer techniques are provided herein. In one example, a method includes receiving a video frame representing source pixels, where the video frame comprises logical pixels that each represent more than one source pixel according to a selected sizing and metadata that indicates the selected sizing for the logical pixels and indicators of which pixels included in the video frame comprise the logical pixels. The method also includes interpreting the metadata for the logical pixels to map each of the logical pixels across more than one output pixel according to the selected sizing and the indicators included in the metadata.

Abstract: The present invention relates to vascular treatment outcome visualization. To provide an enhanced possibility to check that a vascular treatment has been correctly performed, it is proposed to provide (112) a first image data (114) of a region of interest of a vascular structure at a first point in time, and to provide (116) at least one second image data (118) of the region of interest of the vascular structure at a second point in time, wherein a vascular treatment has been applied to the vascular structure between the first point in time and the second point in time. Further, the first and the at least one second image data are combined (120) generating a joint outcome visualization image data (122) and the joint outcome visualization image data is displayed (124).

Abstract: Systems and methods for optimizing a model file include an occlusion reduction process. The occlusion reduction process includes acts of: (i) identifying points on a mesh section of a model, (ii) casting a set of rays toward the points, (iii) determining a number of rays that reach the points without being occluded by a portion of the model or a portion of another object, (iv) determining occlusion values for the points based on the number of rays that reach the points without being occluded; (v) determining whether the occlusion values for the points satisfy a predetermined occlusion threshold value; (vi) removing the mesh section from the model in response to determining that the occlusion values satisfy the predetermined occlusion threshold value, and (vii) refraining from removing the mesh section from the model in response to determining that the occlusion values fail to satisfy the predetermined occlusion threshold value.

Abstract: A method for rendering a non-photorealistic (NPR) content from a set (SI) of at least one image of a same scene is provided. The set of images (SI) is associated with a depth image comprising a set of regions. Each region corresponds to a region of a given depth. The method for rendering a non-photorealistic content includes generation of a segmented image having at least one segmented region generated with a given segmentation scale. The at least one segmented region corresponds to at least one region of the set of regions. A binary edge image is generated in which at least one binary edge region is generated with a given edge extraction scale, the at least one binary edge region corresponding to at least one region of the set of regions. The non-photorealistic content is rendered by combining the segmented image and the binary edge image.

Abstract: Techniques are disclosed for converting image frames from one color space to another while predicting artistic choices that a director, colorist, or others would make. In one configuration, a color conversion application receives image frames, an indication of color spaces to convert between, and metadata associated with the image frames and/or regions therein. The conversion application determines a global, base color conversion for the image frames using a predefined color space transformation. Then, the conversion application (optionally) extracts image regions depicting objects of interest in the image frames, after which the color conversion application processes each of the extracted image regions and the remaining image frames (after the extracted regions have been removed) using one or more functions determined using machine learning. The processed extracted regions and remainders of the image frames are then combined by the color conversion application for output.

Abstract: Methods and systems may provide for an apparatus having a graphics processing unit (GPU) and a non-volatile memory dedicated to the GPU. If a request for content is detected, a determination may be made as to whether the non-volatile memory contains the content.

Abstract: Embodiments of the disclosure provide a display method, a display device, an electronic device and a computer readable storage medium. A plurality of second image data groups are obtained by performing color separation and sorting on the first image data of each layer pixel according to color information. Each of the second image data groups is synthesized, so as to obtain a plurality of synthesized layer data for the plurality of colors, and the plurality of synthesized layer data are sequentially displayed in the preset order of the colors.

Abstract: A curve sampling technique for generating transformed digital visual content is leveraged in a digital medium environment. Initially, a curve sampling system obtains digital visual content, e.g., images and videos. The curve sampling system generates transformed digital visual content by transforming one or more pixels of the digital visual content using a lookup table that is derived from samples of a curve taken at evenly spaced intervals along a y-axis of a graph of the curve. Broadly speaking, the curve defines how to transform a visual characteristic of the pixels in order to achieve a desired digital visual content transformation. Additionally, the curve sampling may correspond to one step in a series of steps for transforming colors of digital visual content. Indeed, such transformations may involve multiple curve sampling steps.

Abstract: Systems and methods for adjusting a display size of a map overlay. A mapping application generates for display a virtual map in an overlay area that does not obstruct important portions of displayed content. As the mapping application receives location information, the mapping application adjusts the size of the virtual map overlay such that relevant landmarks are shown on the virtual map and important portions of the displayed content are not obstructed.