Abstract: A system and method for hologram synthesis and processing capable of synthesizing holographic 3D data and displaying (or reconstructing) a full 3D image at high speed using a deep learning engine. The system synthesizes or generates a digital hologram from a light field refocus image input using the deep learning engine. That is, RGB-depth map data is acquired at high speed using the deep learning engine, such as a convolutional neural network (CNN), from real 360° multi-view color image information and the RGB-depth map data is used to produce hologram content. In addition, the system interlocks hologram data with user voice recognition and gesture recognition information to display the hologram data at a wide viewing angle and enables interaction with the user.

Abstract: A method, a system, and a computing device for reconstructing three-dimensional planes are provided. The method includes the following steps: obtaining a series of color information, depth information and pose information of a dynamic scene by a sensing device; extracting a plurality of feature points according to the color information and the depth information, and marking part of the feature points as non-planar objects including dynamic objects and fragmentary objects; computing point cloud according to the unmarked feature points and the pose information, and instantly converting the point cloud to a three-dimensional mesh; and growing the three-dimensional mesh to fill vacancy corresponding to the non-planar objects according to the information of the three-dimensional mesh surrounding or adjacent to the non-planar objects.

Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.

Abstract: A system including an avatar generation engine (AGE) (607) and a method for automatically generating an avatar with pronounced features are provided. The AGE (607) extracts a primary image of a primary component, for example, a face component, and a secondary image of a secondary component, for example, a hair component, from an input image of a target object. The AGE (607) normalizes and processes the primary image for extracting a feature image corresponding to a feature indicating a distinct characteristic of the target object. The AGE (607) processes the extracted feature image for graphically pronouncing the features. The AGE (607) generates a primary canvas including a predicted tone of the primary component. The AGE (607) generates an avatar with pronounced features by merging a primary graphical image generated by merging the primary canvas with the graphically pronounced features, with a secondary graphical image of the secondary component.

Abstract: There are disclosed various methods, apparatuses and computer program products for volumetric video encoding and decoding. In some embodiments of a method for encoding, one or more patches comprising information of a three-dimensional scene are obtained. An attribute parameter set is formed on the basis of visual properties of a surface of an object in the three-dimensional scene. Also an indication that the attribute parameter set relates to visual properties of the surface of the object and an indication on a range for which the attribute parameter set is valid.

Abstract: A method that simulates a response of a target person to one or more simulation inputs comprises: contacting a body of a first test subject with a force-sensing probe; measuring a first force applied by the probe to the body of the first test subject; obtaining a first relative movement comprising a first movement of the probe relative to the body of the first test subject; determining one or more model parameters associated with the body of the first test subject based on the measured first force and the first relative movement; incorporating the one or more model parameters into a target model of at least a portion of a body of a target person; obtaining a simulation input for application to the target model; and simulating a response of the target person in response to the simulation input using the target model.

Abstract: An image processor includes a parking area line detection portion configured to detect a parking area line from an image acquired by an imaging device, a parking frame setting portion configured to set a parking frame based on the detected parking area line, a parking frame selection portion configured to calculate a length ratio of adjacent first and second sides of the set parking frame, determine the parking frame as a display target when the length ratio falls within a predetermined range, and not to determine the parking frame as the display target when the length ratio falls outside the predetermined range, and a display control portion configured to control a display portion for displaying a parking frame image showing the parking frame determined as the display target by the parking frame selection portion so as to keep superimposing the parking frame image onto the image.

Abstract: Disclosed is a system to add photorealistic detail and motion to an image based on a first material property associated with a first set of data points of an incomplete first object, and a second material property associated with a second set of data points of an incomplete second object in the image. The system may generate first artificial data points amongst the first set of data points that completes a first arrangement defined for the first material property, and may generate second artificial data points amongst the second set of data points that completes a second arrangement defined for the second material property. The system may then output an enhanced image of the completed first object based on first set of data points and the first artificial data points, and of the completed second object based on the second set of data points and the second artificial data points.

Abstract: A surveying data processing device includes a point cloud data acquiring unit, a three-dimensional model acquiring unit, a first correspondence relationship determining unit, an extended three-dimensional data generating unit, and a second correspondence relationship determining unit. The point cloud data acquiring unit acquires first point cloud data obtained by laser scanning, at a first viewpoint, and acquires second point cloud data obtained by laser scanning, at a second viewpoint. The three-dimensional model acquiring unit acquires data of a three-dimensional model. The first correspondence relationship determining unit obtains a correspondence relationship between the first point cloud data and the three-dimensional model. The extended three-dimensional data generating unit generates extended three-dimensional data in which the first point cloud data is extended, on the basis of the correspondence relationship.

Abstract: Rendering system combines point sampling and volume sampling operations to produce rendering outputs. For example, to determine color information for a surface location in a 3-D scene, one or more point sampling operations are conducted in a volume around the surface location, and one or more sampling operations of volumetric light transport data are performed farther from the surface location. A transition zone between point sampling and volume sampling can be provided, in which both point and volume sampling operations are conducted. Data obtained from point and volume sampling operations can be blended in determining color information for the surface location. For example, point samples are obtained by tracing a ray for each point sample, to identify an intersection between another surface and the ray, to be shaded, and volume samples are obtained from a nested 3-D grids of volume elements expressing light transport data at different levels of granularity.

Abstract: Aspects relate to tracing rays in 3-D scenes that comprise objects that are defined by or with implicit geometry. In an example, a trapping element defines a portion of 3-D space in which implicit geometry exist. When a ray is found to intersect a trapping element, a trapping element procedure is executed. The trapping element procedure may comprise marching a ray through a 3-D volume and evaluating a function that defines the implicit geometry for each current 3-D position of the ray. An intersection detected with the implicit geometry may be found concurrently with intersections for the same ray with explicitly-defined geometry, and data describing these intersections may be stored with the ray and resolved.

Abstract: Disclosed is a rigging system for animating the detached and non-uniformly distributed data points of a point cloud. In response to a selection of a region of space in which a first set of data points are located, the system may identify commonality in the positional or non-positional elements of a first subset of the first set of data points, and may determine that a second subset of the first set of data points lack the commonality. The system may refine the first set of data points to a second set of data points that includes the first subset of data points and that excludes the second subset of data points. The system may link the second set of data points to a bone of a skeletal framework, and may animate the second set of data points based on an animation that is defined for the bone.

Abstract: A method for hair rasterization includes receiving hair data of hair strands, each hair strand including one or more hair segments; determining a first set of hair segments that is not fully occluded by one or more opaque objects; classifying each hair segment in the first set of hair segments into buckets corresponding to one or more tiles of pixels that the hair segment overlaps and one or more clusters arranged by depth per tile; for each tile, rasterizing the hair segments included in a first cluster for the tile, the first cluster for the tile being the cluster that is nearest to a location of a camera that includes at least one hair segment, and accumulating color and opacity for each pixel of the tile based on rasterizing the hair segments included in the first cluster; and combining the tiles that include rasterized hair segments into a hair overlay.

Abstract: According to some embodiments, a system, method and non-transitory computer-readable medium are provided comprising a 3D building modeling module; a memory for storing program instructions; a 3D building modeling processor, coupled to the memory, and in communication with the 3D building modeling module and operative to execute program instructions to: receive a region of interest; receive an image of the region of image from a data source; generate a surface model based on the received image including one or more buildings; generate a digital height model; decompose each building into a set of shapes; apply a correction process to the set of shapes; execute a primitive classification process to each shape; execute a fitting process to each classified shape; select a best fitting model; and generate a 3D model of each building. Numerous other aspects are provided.

Abstract: Provided are a method for drawing a motion track, an electronic device and a storage medium. The method includes the following steps: multiple video frames are acquired, where the multiple video frames includes a current video frame and at least one video frame before the current video frame (S110); a display position of a target motion element in each video frame and a display position of a background pixel point in each video frame are identified (S120); a display position of the target motion element of each video frame in the current video frame is calculated (S130); an actual motion track of the target motion element is drawn in the current video frame according to the display position of the target motion element of each video frame in the current video frame, and the current video frame in which the drawing is completed is displayed (S140).

Abstract: 3D printing slicing methods, apparatuses, devices, and storage mediums are disclosed. In an embodiment, a 3D printing slicing method includes the following steps: (1) acquiring a 3D model and a target texture picture; (2) obtaining a first model and obtaining a first picture; (3) establishing a mapping set between the first model and the first picture; (4) slicing a target layer of the first model by a slice plane to obtain at least one intersection point; (5) looking up at least one mapping point corresponding to the at least one intersection point in the first picture according to the mapping set, and obtaining corresponding outer contour points by revising coordinates of the at least one intersection point; and (6) obtaining an outer contour boundary line of the target layer by connecting the outer contour points successively.

Abstract: A method includes determining a first brightness level of a first video frame and a second brightness level of a second video frame, the second video frame immediately following the first video frame. In response to determining that the second brightness level differs from the first brightness level by at least a predetermined amount, the method includes modifying the brightness of the second video frame and a predetermined number of successive frames to provide successive fractional increments of brightness between the first brightness level and the second brightness level.

Abstract: The present disclosure describes a system for fast generation of ray traced reflections of virtually augmented objects into a real-world image, specifically on reflective surfaces. The system utilizes a standard raster graphics pipeline.

Abstract: Some embodiments provide a method that provides tools for defining a scene including media objects in a multi-dimensional space. The method provides a set of user interface tools for adjusting a region of focus for rendering the space from a particular location within a particular field of view. In some embodiments, the region of focus is a first region in the space within the particular field of view and the space further includes a second region outside of the region of focus within the particular field of view. In some embodiments, the method also provides a set of effects for applying to the second region but not the first region to visually indicate the first region as the region of focus within the space and the second region as a region outside of the region of focus within the space.

Abstract: Disclosed herein are methods and systems that allow users to report traffic violations and obtain information concerning reported violations using mobile devices. In one embodiment, a method comprises receiving, at a server, one or more images or videos captured by a mobile device of an offending vehicle committing a potential traffic violation and an extended metadata tag; storing the one or more images or videos and the extended metadata tag as unstructured content in a content lake; generating database tables on top of the content lake; receiving a request from another mobile device to view traffic violation content; querying the database tables and retrieving at least one of the one or more images or videos of the offending vehicle committing the potential traffic violation from the content lake; and generating a GUI to be displayed via the other mobile device showing the traffic violation content.