Abstract: Systems, methods, and computer program products are described that implement obtaining, at an electronic computing device and for at least one image of a scene rendered in an Augmented Reality (AR) environment, a scene lighting estimation captured at a first time period. The scene lighting estimation may include at least a first image measurement associated with the scene. The implementations may include determining, at the electronic computing device, a second image measurement associated with the scene at a second time period, determining a function of the first image measurement and the second image measurement. Based on the determined function, the implementations may also include triggering calculation of a partial lighting estimation update or triggering calculation of a full lighting estimation update and rendering, on a screen of the electronic computing device and for the scene, the scene using the partial lighting estimation update or the full lighting estimation update.

Abstract: Methods, devices, media, and other embodiments are described for generating pseudorandom animations matched to audio data on a device. In one embodiment a video is generated and output on a display of the device using a computer animation model. Audio is detected from a microphone of the device, and the audio data is processed to determine a set of audio characteristics for the audio data received at the microphone of the device. A first motion state is randomly selected from the plurality of motion states, one or more motion values of the first motion state are generated using the set of audio characteristics, and the video is updated using the one or more motion values with the computer animation model to create an animated action within the video.

Abstract: A mobile device executes an augmented reality (AR) software application that detects an orientation of a client device. The AR software application projects a line from a reference position on the client device to a physical object. The AR software application identifies a first location on the physical object that intersects with the line. The AR software application determines an x-coordinate and a y-coordinate of a portion of the physical object included in an image displayed on the client device based on the first location. The AR software application receives a z-coordinate of the portion of the physical object. In response to receiving user input via the client device, the AR software application anchors an augmented reality object at a second location that corresponds to the x-coordinate, the y-coordinate, and the z-coordinate. The orientation of the augmented reality object corresponds to the orientation of the client device.

Abstract: An intra-oral scanning device and system are augmented to provide an active delete (or filter) tool. The tool automatically detects and deletes unwanted items and artifacts capturing as the scan is being done. The technique provides a better user experience by automatically removing items the deletion of which that may otherwise be time-consuming, frustrating, or impossible for the user to delete any other way.

Abstract: Disclosed is an electronic device. There electronic device according to an embodiment includes: a memory; and a processor electronically connected to the memory, wherein the processor can be configured to recognize a face region from an image, check first skin probability data, corresponding to a region to be corrected, on the basis of a first skin color distribution including a skin color distribution stored in association with a plurality of races, first color data of the face region, and a second color data of the region to be corrected which is in the image and includes the face region, determine a category of the face region on the basis of the first color data of the face region, and correct the color, of the region to be corrected, on the basis of the determined category and the first skin probability data. Various other embodiments understood from the specification are also possible.

Abstract: A plurality of pieces of serial data are supplied to a liquid crystal display device from an outside. An SI signal selection circuit switches processing target data to be captured between one piece of serial data included in the plurality of pieces of serial data and the plurality of pieces of serial data in accordance with a serial data selection signal. The processing target data captured by the SI signal selection circuit is converted into parallel data by a data conversion circuit. In accordance with one clock pulse of a serial clock, serial-parallel conversion processing is performed in parallel on a plurality pieces of serial data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for scalable three-dimensional (3-D) object recognition in a cross reality system. One of the methods includes maintaining object data specifying objects that have been recognized in a scene. A stream of input images of the scene is received, including a stream of color images and a stream of depth images. A color image is provided as input to an object recognition system. A recognition output that identifies a respective object mask for each object in the color image is received. A synchronization system determines a corresponding depth image for the color image. A 3-D bounding box generation system determines a respective 3-D bounding box for each object that has been recognized in the color image. Data specifying one or more 3-D bounding boxes is received as output from the 3-D bounding box generation system.

Abstract: In a method for increasing accuracy of augmented reality information presented to a user navigating a real-world mapped environment, a specific object within a field of view of a camera of the user's mobile device is identified, at least by predicting an object type by a machine learning model processing images captured by the camera, and identifying a node that corresponds to the object type within a map database representing the mapped environment. A location associated with the node is retrieved from the map database, and is used to update or confirm one or more estimated locations of the mobile device. Digital information is caused to be superimposed on a real-world view presented to the user via a display of the mobile device, the digital information being selected based at least in part on the updated or confirmed one or more estimated locations of the mobile device.

Abstract: A method and apparatus for rendering a computer-generated image using a stencil buffer is described. The method divides an arbitrary closed polygonal contour into first and higher level primitives, where first level primitives correspond to contiguous vertices in the arbitrary closed polygonal contour and higher level primitives correspond to the end vertices of consecutive primitives of the immediately preceding primitive level. The method reduces the level of overdraw when rendering the arbitrary polygonal contour using a stencil buffer compared to other image space methods. A method of producing the primitives in an interleaved order, with second and higher level primitives being produced before the final first level primitives of the contour, is described which improves cache hit rate by reusing more vertices between primitives as they are produced.

Abstract: An image processing method includes generating an initial representation of a three-dimensional environment using a three-dimensional array of elements having a first spatial resolution with respect to the three-dimensional environment; generating a distance field, DF, representation from the initial representation, the DF representation including a three-dimensional array of distance values having a second spatial resolution with respect to the three-dimensional environment; and applying a data compression process to the DF representation to generate a data-compressed DF representation.

Abstract: An apparatus may obtain, by a processor, target object data formatted based on a first format. The target object data may include a plurality of element resources for a three dimensional model. The first format comprising a file format for transmission of three-dimensional model data. The apparatus may obtain, by the processor, configuration information associated with the target object data. The apparatus may generate, by the processor, a data packet of a second format based on the target object data and the configuration information. The apparatus may provide, by the processor, the data packet to a terminal device.

Abstract: Described are systems and method directed to generation of a dimensionally accurate three-dimensional (“3D”) body model of a body, such as a human body, based on two-dimensional (“2D”) images of that body. A user may use a 2D camera, such as a digital camera typically included in many of today's portable devices (e.g., cell phones, tablets, laptops, etc.) and obtain a series of 2D body images of their body from different directions with respect to the camera. The 2D body images may then be used to generate a plurality of predicted body parameters corresponding to the body represented in the 2D body images. Those predicted body parameters may then be further processed to generate a dimensionally accurate 3D model of the body of the user.

Abstract: A method preserves shapes in a solid model when distributing material during topological optimization. A 3D geometric model of a part having a boundary shape is received. The geometric model is pre-processed to produce a variable-void mesh and to produce a frozen mesh representing the boundary shape. The geometric model is apportioned into a plurality of voxels, and a density value is adjusted for each voxel according to an optimization process. An iso-surface mesh is extracted from the voxel data, and a mesh Boolean intersection is derived between the extracted iso-surface mesh and the variable-void mesh. A mesh Boolean union between the mesh Boolean intersection and the frozen mesh.

Abstract: This patent discloses a method of creating a computer-generated patient specific image to help improve communication amongst health care workers and in between health care workers and patients. Medical data including images, and terminology from a multiple sources is inputted and a computer generated patient specific image is created and optimized for physician-to-physician or physician-to-patient communication.

Abstract: A method and system for providing optimized digital drawings are provided. The method and system include receiving a request to perform a transformation operation on a digital drawing to optimize the digital drawing, providing a tool for selecting an area of the digital drawing to perform the transformation operation on, receiving a selection of the selected area of the digital drawing, transforming the selected area of the digital drawing to optimize the digital drawing, and displaying the transformed area of the digital drawing. The method may also include receiving an input for a digital drawing, identifying the input as related to coloring a portion of the digital drawing, identifying one or more boundary lines for the portion of the digital drawing, determining if the input includes a stroke that extends outside the one or more boundary lines, and removing a section of the stroke that extends outside the boundary lines.

Abstract: An apparatus and method is disclosed including circuitry configured to provide virtual reality video content in a virtual space, circuitry configured to determine selection of an object of interest in the virtual space, and circuitry configured to scale a representation of a user in the virtual space based at least on a distance V in the virtual space between the user and the object of interest.

Abstract: Embodiments disclosed herein describe systems, methods, and products that train one or more neural networks and execute the trained neural network across various applications. The one or more neural networks are trained to optimize a loss function comprising a pixel-level comparison between the outputs generated by the neural networks and the ground truth dataset generated from a bubble view methodology or an explicit importance maps methodology. Each of these methodologies may be more efficient than and may closely approximate the more expensive but accurate human eye gaze measurements. The embodiments herein leverage an existing process for training neural networks to generate importance maps of a plurality of graphic objects to offer interactive applications for graphics designs and data visualizations.

Abstract: A method preserves shapes in a solid model when distributing material during topological optimization. A 3D geometric model of a part having a boundary shape is received. The geometric model is pre-processed to produce a variable-void mesh and to produce a frozen mesh representing the boundary shape. The geometric model is apportioned into a plurality of voxels, and a density value is adjusted for each voxel according to an optimization process. An iso-surface mesh is extracted from the voxel data, and a mesh Boolean intersection is derived between the extracted iso-surface mesh and the variable-void mesh. A mesh Boolean union between the mesh Boolean intersection and the frozen mesh.

Abstract: A SIMD processing unit processes a plurality of tasks which each include up to a predetermined maximum number of work items. The work items of a task are arranged for executing a common sequence of instructions on respective data items. The data items are arranged into blocks, with some of the blocks including at least one invalid data item. Work items which relate to invalid data items are invalid work items. The SIMD processing unit comprises a group of processing lanes configured to execute instructions of work items of a particular task over a plurality of processing cycles. A control module assembles work items into the tasks based on the validity of the work items, so that invalid work items of the particular task are temporally aligned across the processing lanes. In this way the number of wasted processing slots due to invalid work items may be reduced.

Abstract: A system for obtaining image content includes a receiving unit configured to receive video frames generated during the execution of a video game at a video game playing device, a monitoring unit operable to detect at least some of the video frames as corresponding to a loading screen, a content unit configured to obtain pre-generated image content for displaying in place of or addition to the video frames identified as corresponding to loading screens, a control unit configured to receive an input from the monitoring unit, and in response said input, select pre-generated image content for displaying in place of or in addition to the video frames detected as corresponding to a loading screen, and a display unit operable to display the selected pre-generated image content in place of or in addition to the video frames detected as corresponding to a loading screen.