Abstract: The present disclosure provides a method, a device, a terminal, a system and a vehicle for visualization of vehicle's blind spot. The method includes: acquiring real-time image data in front of the vehicle; creating a Three-Dimension (3D) map with the acquired image data; determining a current location of the vehicle in the 3D map; acquiring the relative location information between the driver and the sight-blocking object that blocks the vision of the driver; determining the blind spot in the vision of the driver in connection with structure information of the sight-blocking object and the relative location information between the driver and the sight-blocking object that blocks the vision of the driver; and determining environmental information of the blind spot in the vision in accordance with the 3D map, the current location of the vehicle in the 3D map and the blind spot in the vision of the driver.

Abstract: Systems, apparatuses and methods may provide away to render edges of an object defined by multiple tessellation triangles. More particularly, systems, apparatuses and methods may provide a way to perform anti-aliasing at the edges of the object based on a coarse pixel rate, where the coarse pixels may be based on a coarse Z value indicate a resolution or granularity of detail of the coarse pixel. The systems, apparatuses and methods may use a shader dispatch engine to dispatch raster rules to a pixel shader to direct the pixel shader to include, in a tile and/or tessellation triangle, one more finer coarse pixels based on a percent of coverage provided by a finer coarse pixel of a tessellation triangle at or along the edge of the object.

Abstract: A display apparatus comprises an image sensor and a control circuitry. The image sensor captures a 360° image of a real-world environment and the control circuitry detects at least one light source in the captured 360° image and determines a plurality of lighting parameters of the detected light source. A lighting condition caused by the light source in the real-world environment is reproduced on a three-dimensional (3D) model based on the determined plurality of lighting parameters. The 3D model along with 360° media content that includes at least the captured 360° image is rendered at the display apparatus such that the reproduced light condition is visible on the rendered 3D model. A minimum deviation is exhibited in representation of a light reflection caused by the light source on the rendered 3D model during visualization of the 3D model at the display apparatus in presence of the light source.

Abstract: A video stream of a scene for a virtual reality or augmented reality experience may be captured by one or more image capture devices. Data from the video stream may be retrieved, including base vantage data with base vantage color data depicting the scene from a base vantage location, and target vantage data with target vantage color data depicting the scene from a target vantage location. The base vantage data may be reprojected to the target vantage location to obtain reprojected target vantage data. The reprojected target vantage data may be compared with the target vantage data to obtain residual data. The residual data may be compressed by removing a subset of the residual data that is likely to be less viewer-discernable than a remainder of the residual data. A compressed video stream may be stored, including the base vantage data and the compressed residual data.

Abstract: Methods and devices for rendering graphics in a computer system include a graphical processing unit (GPU) with a flexible, dynamic, application-directed mechanism for varying the rate at which fragment shading is performed for rendering an image to a display. In particular, the described aspects include determining, at a rasterization stage, map coordinates based on coarse scan converting a primitive of an object, the map coordinates indicating a location on a sampling rate parameter (SRP) map of a fragment within the primitive of the object, and identifying a lookup value for the fragment within the primitive of the object based at least on map coordinates, and calculating a respective fragment variable SRP value for the fragment within the primitive of the object based at least on the lookup value.

Abstract: A method of producing vertically or forward projecting three-dimensional images using virtual 3D models, wherein said 3D models are created by the simultaneous localization and depth-mapping of the physical features of real objects. A camera is used to take a first image from a first perspective, and a subsequent image from a subsequent perspective, wherein the autofocus system provides a first set of depth mapping data and a subsequent set of depth mapping data. The first set of depth mapping data and the subsequent set of depth mapping data are used to generate a disparity mapping. A virtual 3D model is created from the disparity mapping. The virtual 3D model is imaged to obtain images that can be viewed as three-dimensional. Enhanced 3D effects are added to the virtual 3D model that cause aspects of the image to appear to extend above, or in front of, the display medium.

Abstract: Systems and methods for navigating a user in a three-dimensional model of a property are disclosed. An exemplary system includes a storage device configured to store data associated with a plurality of point positions. Each point position corresponds to a camera position at which images of the property are captured by the camera. The system further includes at least one processor configured to determine connectivity among the point positions and determine a plurality of candidate routes connecting a first introduction position and a second introduction position. Each candidate route links a subset of the point positions based on the connectivity. The at least one processor is further configured to select a route from the candidate routes and sequentially display views corresponding to the point positions on the selected route. The views at each point position are rendered from the images captured at the camera position corresponding to the point position.

Abstract: A medical navigation system for displaying a three dimensional (3D) surface video of a target is provided. The medical navigation system comprises a 3D imaging device, a camera, a display, and a controller electrically coupled to the 3D imaging device, the camera, and the display. The controller has a processor coupled to a memory. The controller is configured to perform calibration of input devices; acquire 3D depth data of the target from a signal generated by the 3D imaging device; construct a 3D surface contour of the target based on the 3D depth data; acquire a video stream of the target from a signal generated by the camera; generate a 3D surface video based on the 3D surface contour and the video stream; and display the 3D surface video on the display.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program executable by at least one processing unit of a device. The program receives data associated with a visual presentation that includes several visual elements. The program also identifies a first set of visual elements in the several visual elements having a first type and a second set of visual elements in the several visual elements having a second type. The program further renders the first set of visual elements in a first layer of the visual presentation using a first rendering engine. The program also renders the second set of visual elements in a second layer of the visual presentation using a second rendering engine.

Abstract: A virtual reality or augmented reality experience of a scene may be presented to a viewer using layered data retrieval and/or processing. A first layer of a video stream may be retrieved, and a first viewer position and/or orientation may be received. The first layer may be processed to generate first viewpoint video of the scene from a first virtual viewpoint corresponding to the first viewer position and/or orientation. The first viewpoint video may be displayed for the viewer. Then, a second layer of the video stream may be retrieved, and a second viewer position and/or orientation may be received. The second layer may be processed to generate second viewpoint video of the scene from a second virtual viewpoint corresponding to the second viewer position and/or orientation, with higher quality than the first viewpoint video. The second viewpoint video may be displayed for the viewer.

Abstract: Examples of systems and methods for non-facial animation in facial performance driven avatar system are generally described herein. A method for facial gesture driven body animation may include capturing a series of images of a face, and computing facial motion data for each of the images in the series of images. The method may include identifying an avatar body animation based on the facial motion data, and animating a body of an avatar using the avatar body animation.

Abstract: A digital dental mesh segmentation method and a digital dental mesh segmentation device are provided. The digital dental mesh segmentation method includes: receiving a digital dental mesh, including a plurality of teeth; inserting a tooth interface separator at a tooth interface of the digital dental mesh, the tooth interface separator being at a first location; receiving a three-dimensional movement signal and a three-dimensional rotation signal to move and rotate the tooth interface separator from the first location to a second location; and segmenting the digital dental mesh according to the tooth interface separator at the second location to obtain an independent digital teeth model.

Abstract: Provided is an apparatus for managing image data, by which the image data transferred to a mobile device from an image capturing device connected to the mobile device is managed. The apparatus may include a first controller located in a native layer for communicating with a java layer, a second controller located in a java layer for communicating with the native layer, and a plurality of ring-buffer type shared memories in which the image data transferred from the image capturing device is stored. The first controller may store the image data in the shared memory at a first state according to the order of the shared memories and may change the state information of the shared memory to a second state when the image data is completely stored. The second controller may read the image data stored in the shared memories at the second state according to the order of the shared memories and may change the state information of the shared memory to the first state when the image data is completely read.

Abstract: The present invention is directed to a system comprising providing means for providing numbers to user, comprising display means for displaying said provided numbers, each number having a value, wherein the system furthermore comprises determination means which is adapted to calculate the size of the number dependent on said value and/or wherein the determination means is adapted to calculate the depth of the color of the number or the depth of the color of background of the number dependent on said value, wherein the determination means is further adapted to elect the size of the number the larger the larger the value of the number is and/or to elect the depth of the color the larger the larger the value of the number is, and wherein the display means is adapted to display the number in the determined size and/or to display the color in the determined depth.

Abstract: An example technique for generating slice data from a voxel representation can include obtaining a shape specification of the 3-D object. The example technique for generating slice data from a voxel representation can also include obtaining a material specification of the 3-D object. The example technique for generating slice data from a voxel representation can also include merging the shape specification and the material specification to create a voxel representation of the 3-D object, wherein each voxel in the voxel representation includes a plurality of data types. The example technique for generating slice data from a voxel representation can also include generating slice data from the voxel representation, wherein the slice data provides a higher resolution than that provided by the voxel representation using the plurality of data types.

Abstract: An exemplary virtual reality system accesses first and second image datasets representative of first and second captured images depicting a real-world scene from first and second vantage points. The system recognizes a pre-modeled object within both the first and second captured images, and determines first and second confidence metrics representative of objective degrees to which the system accurately recognizes the pre-modeled object within the first and second captured images, respectively. The system further generates, a third image dataset representative of a rendered image based on the first and second image datasets. The rendered image includes a depiction of the pre-modeled object within the real-world scene from a third vantage point, and the generating comprises prioritizing, based on a determination that the second confidence metric is greater than the first confidence metric, the second image dataset over the first image dataset for the depiction of the pre-modeled object.

Abstract: Example systems and methods are disclosed for generating facial expressions in an avatar-based user interface for a computing device. An example system may include a digital camera, a display device and a user interface application. The digital camera may be configured to capture image data of a user over time. The user interface application may be stored on a non-transitory computer-readable medium and executable by a processor, and may include: an expression feature extractor configured to process the image data of the user to generate a plurality of facial expression descriptor vectors, a sketch generation module configured to use a first conditional deep convolutional generative adversarial network (DC-GAN) model to generate an expressive facial sketch image of an avatar based on the plurality of facial expression descriptor vectors, and an image generation module configured to use a second conditional DC-GAN model to generate a facial expression image from the expressive facial sketch image.

Abstract: Embodiments presented herein provide techniques for creating and simplifying a cell and portal graph. The simplified cell and portal graph may be used to make a conservative determination of whether an element of geometry is visible for a given view frustum (and therefore needs to be rendered). That is, the simplified cell and portal graph retains the encoded visibility for given set of geometry. The simplified cell and portal graph provides a “conservative” determination of visibility as it may indicate that some objects are visible that are not (resulting in unneeded rendering), but not the other way around. Further, this approach allows cell and portal graphs to be generated dynamically, allowing the cell and portal graphs to be used for scenes where the geometry can change (e.g., as 3D world of a video game).

Abstract: One embodiment of the invention disclosed herein provides techniques for transferring attributes from a source animated character to a target character. A character attribute transfer system identifies a first set of markers corresponding to the source animated character. The character attribute transfer system identifies a second set of markers corresponding to the target character. The character attribute transfer system generates a geometric correspondence between the source animated character and the target character based on the first set of markers and the second set of markers independent of differences in geometry between the source animated character and the target character. The character attribute transfer system transfers a first attribute from the source animated character to the target character based on the geometric correspondence.

Abstract: In one embodiment, a system automatically generates a retrofit device based on a three-dimensional (3D) model of a legacy device. In operation, a physical design engine generates component instances based on legacy interface instances included in the legacy device. The physical design engine then generates an enclosure model that specifies an enclosure that houses the component instances. The physical design engine also generates computer code that is associated with a programmable instance as well as relatively simple assembly instructions for assembling a retrofit device that includes the enclosure, the legacy device, the component instances, and the programmable instance. Notably an user may configure an automated fabrication tool to generate the enclosure. Consequently, the system provides an automated design process for retrofitting legacy devices that does not rely on the user possessing any significant technical expertise.