Abstract: According to various implementations, a method is performed at a first electronic device with a non-transitory memory and one or more processors. The method includes determining a reference location in a three-dimensional space based on a feature. The feature is generated by a second electronic device. The method includes obtaining, for the reference location, first reference coordinates in an augmented reality coordinate system of the first electronic device and second reference coordinates in an augmented reality coordinate system of the second electronic device. The method includes determining a coordinate transformation based on a function of the first reference coordinates and the second reference coordinates. The method includes synchronizing an augmented reality coordinate system of the first electronic device with an augmented reality coordinate system of the second electronic device using the coordinate transformation.

Abstract: A method of rendering an object is provided. The method comprises: encoding a feature vector to each point in a point cloud for an object, wherein the feature vector comprises an alpha matte; projecting each point in the point cloud and the corresponding feature vector to a target view to compute a feature map; and using a neural rendering network to decode the feature map into a RGB image and the alpha matte and to update the feature vector.

Abstract: Certain embodiments involve a graphics manipulation application using brushstroke parameters that include a maximum alpha-deposition parameter and a fractional alpha-deposition parameter. For instance, the graphics manipulation application uses an alpha flow increment computed from the maximum alpha-deposition parameter and the fractional alpha-deposition parameter to compute an output canvas color. In some embodiments, if the current canvas opacity exceeds or equals the maximum alpha-deposition parameter, the current canvas opacity is selected as the output canvas opacity. Otherwise, the graphics manipulation application computes the output canvas opacity by increasing the current canvas opacity based on the alpha flow increment. The graphics manipulation application updates a canvas portion affected by a brushstroke input to include the output canvas opacity and the output canvas color.

Abstract: A system and method for hologram synthesis and processing capable of synthesizing holographic 3D data and displaying (or reconstructing) a full 3D image at high speed using a deep learning engine. The system synthesizes or generates a digital hologram from a light field refocus image input using the deep learning engine. That is, RGB-depth map data is acquired at high speed using the deep learning engine, such as a convolutional neural network (CNN), from real 360° multi-view color image information and the RGB-depth map data is used to produce hologram content. In addition, the system interlocks hologram data with user voice recognition and gesture recognition information to display the hologram data at a wide viewing angle and enables interaction with the user.

Abstract: A method, a system, and a computing device for reconstructing three-dimensional planes are provided. The method includes the following steps: obtaining a series of color information, depth information and pose information of a dynamic scene by a sensing device; extracting a plurality of feature points according to the color information and the depth information, and marking part of the feature points as non-planar objects including dynamic objects and fragmentary objects; computing point cloud according to the unmarked feature points and the pose information, and instantly converting the point cloud to a three-dimensional mesh; and growing the three-dimensional mesh to fill vacancy corresponding to the non-planar objects according to the information of the three-dimensional mesh surrounding or adjacent to the non-planar objects.

Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.

Abstract: A system including an avatar generation engine (AGE) (607) and a method for automatically generating an avatar with pronounced features are provided. The AGE (607) extracts a primary image of a primary component, for example, a face component, and a secondary image of a secondary component, for example, a hair component, from an input image of a target object. The AGE (607) normalizes and processes the primary image for extracting a feature image corresponding to a feature indicating a distinct characteristic of the target object. The AGE (607) processes the extracted feature image for graphically pronouncing the features. The AGE (607) generates a primary canvas including a predicted tone of the primary component. The AGE (607) generates an avatar with pronounced features by merging a primary graphical image generated by merging the primary canvas with the graphically pronounced features, with a secondary graphical image of the secondary component.

Abstract: A display device including a housing; a display unit accommodated in the housing; and a control unit configured to cause the display unit to operate in a speaker mode to play a song while the display unit is fully inserted in the housing, receive an image display command, according to the image display command, withdraw the display unit and display a first content corresponding to the image display command in a first region of the display unit, and display a second content of an audio controller for controlling the speaker mode in a second region of the display unit.

Abstract: There are disclosed various methods, apparatuses and computer program products for volumetric video encoding and decoding. In some embodiments of a method for encoding, one or more patches comprising information of a three-dimensional scene are obtained. An attribute parameter set is formed on the basis of visual properties of a surface of an object in the three-dimensional scene. Also an indication that the attribute parameter set relates to visual properties of the surface of the object and an indication on a range for which the attribute parameter set is valid.

Abstract: A system may receive captured content identifying a first face of a user of a user device and media content identifying a second face of a person. The system may process the captured content and the media content, using a first machine learning model, to determine embeddings for the captured content and to identify landmarks in the media content. The system may combine the captured content with the media content, based on the landmarks and the embeddings, to generate combined content and to segment a combined face of the combined content, to replace the second face of the media content with the combined face, and to generate new media content that includes the combined face. The system may process the new media content, with a second machine learning model, to blend the combined face in the new media content and to generate final media content.

Abstract: A method that simulates a response of a target person to one or more simulation inputs comprises: contacting a body of a first test subject with a force-sensing probe; measuring a first force applied by the probe to the body of the first test subject; obtaining a first relative movement comprising a first movement of the probe relative to the body of the first test subject; determining one or more model parameters associated with the body of the first test subject based on the measured first force and the first relative movement; incorporating the one or more model parameters into a target model of at least a portion of a body of a target person; obtaining a simulation input for application to the target model; and simulating a response of the target person in response to the simulation input using the target model.

Abstract: An image processor includes a parking area line detection portion configured to detect a parking area line from an image acquired by an imaging device, a parking frame setting portion configured to set a parking frame based on the detected parking area line, a parking frame selection portion configured to calculate a length ratio of adjacent first and second sides of the set parking frame, determine the parking frame as a display target when the length ratio falls within a predetermined range, and not to determine the parking frame as the display target when the length ratio falls outside the predetermined range, and a display control portion configured to control a display portion for displaying a parking frame image showing the parking frame determined as the display target by the parking frame selection portion so as to keep superimposing the parking frame image onto the image.

Abstract: Disclosed is a system to add photorealistic detail and motion to an image based on a first material property associated with a first set of data points of an incomplete first object, and a second material property associated with a second set of data points of an incomplete second object in the image. The system may generate first artificial data points amongst the first set of data points that completes a first arrangement defined for the first material property, and may generate second artificial data points amongst the second set of data points that completes a second arrangement defined for the second material property. The system may then output an enhanced image of the completed first object based on first set of data points and the first artificial data points, and of the completed second object based on the second set of data points and the second artificial data points.

Abstract: A surveying data processing device includes a point cloud data acquiring unit, a three-dimensional model acquiring unit, a first correspondence relationship determining unit, an extended three-dimensional data generating unit, and a second correspondence relationship determining unit. The point cloud data acquiring unit acquires first point cloud data obtained by laser scanning, at a first viewpoint, and acquires second point cloud data obtained by laser scanning, at a second viewpoint. The three-dimensional model acquiring unit acquires data of a three-dimensional model. The first correspondence relationship determining unit obtains a correspondence relationship between the first point cloud data and the three-dimensional model. The extended three-dimensional data generating unit generates extended three-dimensional data in which the first point cloud data is extended, on the basis of the correspondence relationship.

Abstract: Disclosed is a gamification system for overlaying user-controlled graphical targeting elements over a real-time video feed of an instrument being inspected, and providing interactive controls for firing virtual weapons or other graphical indicators to designate and/or record the presence of contaminants, defects, and/or other issues at specific locations within or on the instrument. The system may receive and present images of the instrument under inspection in a graphical user interface (“GUI”). The system may receive user input that tags a particular region of a particular image with an issue identifier, and may generate a visualization that is presented in conjunction with the particular image in the GUI in response to receiving the input. The visualization corresponds to firing of a virtual weapon and other gaming visuals associated with tagging the particular region of the particular image with the issue identifier.

Abstract: Rendering system combines point sampling and volume sampling operations to produce rendering outputs. For example, to determine color information for a surface location in a 3-D scene, one or more point sampling operations are conducted in a volume around the surface location, and one or more sampling operations of volumetric light transport data are performed farther from the surface location. A transition zone between point sampling and volume sampling can be provided, in which both point and volume sampling operations are conducted. Data obtained from point and volume sampling operations can be blended in determining color information for the surface location. For example, point samples are obtained by tracing a ray for each point sample, to identify an intersection between another surface and the ray, to be shaded, and volume samples are obtained from a nested 3-D grids of volume elements expressing light transport data at different levels of granularity.

Abstract: Aspects relate to tracing rays in 3-D scenes that comprise objects that are defined by or with implicit geometry. In an example, a trapping element defines a portion of 3-D space in which implicit geometry exist. When a ray is found to intersect a trapping element, a trapping element procedure is executed. The trapping element procedure may comprise marching a ray through a 3-D volume and evaluating a function that defines the implicit geometry for each current 3-D position of the ray. An intersection detected with the implicit geometry may be found concurrently with intersections for the same ray with explicitly-defined geometry, and data describing these intersections may be stored with the ray and resolved.

Abstract: Disclosed is a rigging system for animating the detached and non-uniformly distributed data points of a point cloud. In response to a selection of a region of space in which a first set of data points are located, the system may identify commonality in the positional or non-positional elements of a first subset of the first set of data points, and may determine that a second subset of the first set of data points lack the commonality. The system may refine the first set of data points to a second set of data points that includes the first subset of data points and that excludes the second subset of data points. The system may link the second set of data points to a bone of a skeletal framework, and may animate the second set of data points based on an animation that is defined for the bone.

Abstract: A method for hair rasterization includes receiving hair data of hair strands, each hair strand including one or more hair segments; determining a first set of hair segments that is not fully occluded by one or more opaque objects; classifying each hair segment in the first set of hair segments into buckets corresponding to one or more tiles of pixels that the hair segment overlaps and one or more clusters arranged by depth per tile; for each tile, rasterizing the hair segments included in a first cluster for the tile, the first cluster for the tile being the cluster that is nearest to a location of a camera that includes at least one hair segment, and accumulating color and opacity for each pixel of the tile based on rasterizing the hair segments included in the first cluster; and combining the tiles that include rasterized hair segments into a hair overlay.

Abstract: According to some embodiments, a system, method and non-transitory computer-readable medium are provided comprising a 3D building modeling module; a memory for storing program instructions; a 3D building modeling processor, coupled to the memory, and in communication with the 3D building modeling module and operative to execute program instructions to: receive a region of interest; receive an image of the region of image from a data source; generate a surface model based on the received image including one or more buildings; generate a digital height model; decompose each building into a set of shapes; apply a correction process to the set of shapes; execute a primitive classification process to each shape; execute a fitting process to each classified shape; select a best fitting model; and generate a 3D model of each building. Numerous other aspects are provided.