Abstract: Techniques are described for building extrusion in an electronic map. A client map application receives geographic location information, such as from a user input. The client map application retrieves electronic map data representing a specific building at a location indicated by the received geographic location information. The client map application generates an extruded building graphical element illustrating the specific building in three dimensions based on the retrieved electronic map data representing the specific building. The client map application renders an electronic map representing electronic map data according to a first style. The electronic map also includes the extruded building graphical element such that the specific building is rendered in three dimensions according to a second style.

Abstract: One or more image and/or depth cameras capture images and/or depths of a physical environment over time. A computer system processes the images to create a static 3-dimensional (3D) model representing stationary structure and a dynamic 3D model representing moving or moveable objects within the environment. The system visually overlays the dynamic 3D model over the static 3D model in a user interface. Through the user interface, a user can create virtual spatial interaction sensors, each of which is defined by a volume of space within the environment. A virtual spatial interaction sensor can be triggered, based on analysis of the dynamic 3D model by the computer system, whenever a moveable object within the environment intersects the defined volume of the sensor. Times and durations of intersections can be logged and used for process refinement.

Abstract: This application provides an image processing method performed by an electronic device. The method includes: acquiring a diffuse reflection map and a shadow map of a three-dimensional (3D) model of an object, wherein the 3D model is constructed from a plurality of photos of the object within a predefined lighting environment; acquiring a shadow texel in a shadow region of the diffuse reflection map according to a corresponding shadow region in the shadow map; querying an average color lookup table according to spatial coordinate information of the shadow texel for an average brightness difference corresponding to the shadow texel; and determining restoration color information according to the average brightness difference, and restoring color information of the shadow texel according to the restoration color information. In this way, shadow in the diffuse reflection map of the 3D model can be effectively removed or at least attenuated.

Abstract: In one aspect, an example method includes (i) obtaining video that depicts an area across multiple frames of the video, wherein the area is part of a scene of the video, and wherein the area is suitable for having an object inserted therein; (ii) detecting the area within the obtained video and determining area characteristic data associated with the detected area; (iii) determining scene attribute data associated with the scene; (iv) using at least the determined area characteristic data and the determined scene attribute data as a basis to select an object from among a set of multiple candidate objects; (v) inserting into the detected area the selected object to generate video that is a modified version of the obtained video; and (vi) outputting for presentation the generated video.

Abstract: Implementations relate to a computer-implemented method to display a rigid body object within a virtual environment. Some implementations include receiving a model representation of the rigid body object, wherein the model representation includes a plurality of constraints for the rigid body object; splitting the rigid body object into two or more splinters based on the model representation, obtaining a modified representation of the rigid body object based on a modified rigid body object formed by connecting each of the two or more splinters to one or more other splinters by one or more rigid joints, determining an input state of the rigid body object in the virtual environment, solving a set of equations based on the input state and the modified representation of the rigid body object to determine an updated state of the rigid body object.

Abstract: Determining the occlusions or shadows for an area light within a scene is difficult, especially realistic shadowing in large and dynamic scenes. The disclosure provides an adaptive occlusion sampling process that uses voxel cone tracing to distribute the voxel tracing cones on the surface of area lights to obtain samples for shadowing in computer generated images or scenes. A method of adaptive occlusion sampling from a rectangular area light is disclosed that can be used to provide realistic shadowing in a computer generated scene. A process to compute a shadow of an area light within a scene is also disclosed herein that includes obtaining samples, employing voxel cone tracing, from a light surface of the area light based on sample points of a sampling grid created from sample patterns that are based on a determined number of cones.

Abstract: A system may receive imaging data generated by an imaging device directed at a heart. The system may receive a first input operation indicative of a selected time-frame. The system may display images of the heart based on the intensity values mapped to the selected time-frame. The system may receive, based on interaction with the images, an apex coordinate and a base coordinate. The system may calculate, based on the apex coordinate and the base coordinate, a truncated ellipsoid representative an endocardial or epicardial boundary of the heart. The system may generate a four-dimensional mesh comprising three-dimensional vertices spaced along the mesh. The system may overlay, on the displayed images, markers representative of the vertices. The system may receive a second input operation corresponding to a selected marker. The system may enhance the mesh by adjusting or interpolating vertices across multiple time-frames.

Abstract: Disclosed herein are aspects for resituating virtual cameras and avatars in a virtual environment. An aspect begins by rendering the virtual environment, including a first avatar and a second avatar. The virtual environment is rendered on a first device, belonging to a first user, and from a perspective of a first virtual camera controlled by the first user. The first avatar represents the first user at a location of the first virtual camera. The second user views the virtual environment from a perspective of a second virtual camera at a location of the second avatar. The aspect proceeds by repositioning the first virtual camera and the first avatar to a first location and resituating the second avatar to a second location. The aspect concludes by sending a message instructing a second device, belonging to the second user, to resituate the second virtual camera to the second location.

Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements able to be intersected by a ray. The system iteratively obtains ray requests, each of which identifies a ray and a node against which the ray is to be tested, and performs intersection testing based on the ray requests. The number of ray requests obtained in each iteration reduces responsive to an amount of memory occupied by information relating to the rays (undergoing intersection testing) increasing.

Abstract: A method for providing a relightable avatar of a subject to a virtual reality application is provided. The method includes retrieving multiple images including multiple views of a subject and generating an expression-dependent texture map and a view-dependent texture map for the subject, based on the images. The method also includes generating, based on the expression-dependent texture map and the view-dependent texture map, a view of the subject illuminated by a light source selected from an environment in an immersive reality application, and providing the view of the subject to an immersive reality application running in a client device. A non-transitory, computer-readable medium storing instructions and a system that executes the instructions to perform the above method are also provided.

Abstract: A method of generating point cloud data from a laser scanning device, retaining a scanner pattern based on point cloud data, and generating an abbreviated mesh from the point cloud such that it can be faithfully restored to the original point cloud. The point cloud data must be structured such that azimuth, elevation, and range data can be extracted. The abbreviated mesh version of the point cloud is generated utilizing selected azimuth, elevation, and range data. Scanner patterns are generated utilizing the azimuth and elevation data. To faithfully regenerate the point cloud data from the abbreviated mesh, the mesh and the scanner pattern are cross referenced such that the regenerated point cloud has minimal data loss.

Abstract: A hardware-based traversal coprocessor provides acceleration of tree traversal operations searching for intersections between primitives represented in a tree data structure and a ray. The primitives may include triangles used in generating a virtual scene. The hardware-based traversal coprocessor is configured to properly handle numerically challenging computations at or near edges and/or vertices of primitives and/or ensure that a single intersection is reported when a ray intersects a surface formed by primitives at or near edges and/or vertices of the primitives.

Abstract: The present invention relates to the technical field of two-dimensional (2D)/three-dimensional (3D) modeling, and in particular to a method, system, and device for combining models in a virtual scene, and a medium. The method of the present invention includes: placing a first model into a second model; determining a filling space and a removing space of the first model; filling an overlapping space between the first model and the second model with the second model, and filling the filling space of the first model with the second model; and removing the second model with which the removing space of the first model is filled, wherein when the overlapping space between the first model and the second model is filled with the second model, and the filling space of the first model is filled with the second model, the removing space of the first model is filled with the second model. The present invention simplifies a workflow of a scene designer, reduces repetitive work, and achieves a desired effect of the models.

Abstract: The present invention relates to a method for arranging one or more functional elements in a room, comprising the steps of: a) three-dimensional acquisition of the room or of a part of the room by means of a scanner, b) definition of a grid based on the acquisition according to step a), c) definition of grid points of the room in the grid established according to step b), d) definition of at least one grid point of one or more functional elements, and e) virtual arrangement of the one or more functional elements in the room at at least one location, at which at least one grid point of the room and at least one grid point of the functional element coincide.

Abstract: An improved virtual environment creation and testing process can be achieved by a combination of spatial partitioning and reverse tree generation. The reverse tree may be representative of the virtual environment and may be generated starting from a smallest portion or zone of the virtual environment (represented as a leaf node) and expanding up towards a root node representative of the entire virtual environment. Advantageously, the system can add new zones to the virtual environment and representative tree data structure that are external to the existing virtual environment without generating a new tree data structure. Thus, the computing resources utilized by the system disclosed herein may be significantly reduced compared to existing processes while improving the flexibility of the spatial partitioning and tree generation process thereby enabling spatial partitioning to be performed in real or near real time as a developer authors the virtual environment.

Abstract: A system and method for providing image guidance for placement of one or more medical devices at a target location. The system can be used to determine one or more affected regions corresponding to the operation of one or more medical devices and display at least a portion of the one or more affected regions. The affected regions can correspond to predicted affected regions and/or dynamic affected regions and can be based at least in part on a variance parameter of the medical device.

Abstract: Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within a virtual environment. Various methods for efficient modeling, rendering, and shading are disclosed herein.

Abstract: A method is performed at a computing system for automatically generating an occluder, the method includes receiving an input model of the visual three-dimensional structure, the input model having a plurality of faces. The method includes generating an initial occluder by simplifying the input model into a plurality of candidate patches in a patch-based coarse mesh. The method includes comparing a first two-dimensional area occluded by the input model of the visual three-dimensional structure and a second two-dimensional area occluded by the initial occluder along the first view direction to determine a first quality metric based on a first number of pixels that are blocked by the input model that is also blocked by the initial occluder. The method includes removing a plurality of faces from the initial occluder while maintaining the first quality metric above a first threshold to form the occluder for the visual three-dimensional structure.

Abstract: There is described a method of rasterizing a computer model. One or more non-linear expressions of code are identified in a fragment shader. The one or more non-linear expressions of code are transformed into one or more linear expressions of code. The one or more linear expressions of code are transferred from the fragment shader to a vertex shader. The computer model is then rasterized by executing, on the computer model, code comprised in the vertex shader, including the transferred one or more linear expressions of code.

Abstract: Dynamically customized animatable 3D models of virtual characters (“avatars”) are generated in real time from multiple inputs from one or more devices having various sensors. Each input may comprise a point cloud associated with a user's face/head. An example method comprises receiving inputs from sensor data from multiple sensors of the device(s) in real time, and pre-processing the inputs for determining orientation of the point clouds. The method may include registering the point clouds to align them to a common reference; automatically detecting features of the point clouds; deforming a template geometry based on the features to automatically generate a custom geometry; determining a texture of the inputs and transferring the texture to the custom geometry; deforming a template control structure based on the features to automatically generate a custom control structure; and generating an animatable object having the custom geometry, the transferred texture, and the custom control structure.