Abstract: An embodiment of a parallel processor apparatus may include a sample pattern selector to select a sample pattern for a pixel, and a sample pattern subset selector communicatively coupled to the sample pattern selector to select a first subset of the sample pattern for the pixel corresponding to a left eye display frame and to select a second subset of the sample pattern for the pixel corresponding to a right eye display frame, wherein the second subset is different from the first subset. Other embodiments are disclosed and claimed.

Abstract: A graphics processor architecture provides for scan conversion and ray tracing approaches to visible surface determination as concurrent and separate processes. Surfaces can be identified for shading by scan conversion and ray tracing. Data produced by each can be normalized, so that instances of shaders, being executed on a unified shading computation resource, can shade surfaces originating from both ray tracing and rasterization. Such resource also may execute geometry shaders. The shaders can emit rays to be tested for intersection by the ray tracing process. Such shaders can complete, without waiting for those emitted rays to complete. Where scan conversion operates on tiles of 2-D screen pixels, the ray tracing can be tile aware, and controlled to prioritize testing of rays based on scan conversion status. Ray population can be controlled by feedback to any of scan conversion, and shading.

Abstract: Methods, apparatus, devices, and systems for three-dimensional (3D) displaying objects are provided. In one aspect, a method includes obtaining data including respective primitive data for primitives corresponding to an object, determining an electromagnetic (EM) field contribution to each element of a display for each of the primitives by calculating an EM field propagation from the primitive to the element, generating a sum of the EM field contributions from the primitives for each of the elements, transmitting to each of the elements a respective control signal for modulating at least one property of the element based on the sum of the EM field contributions, and transmitting a timing control signal to an illuminator to activate the illuminator to illuminate light on the display, such that the light is caused by the modulated elements of the display to form a volumetric light field corresponding to the object.

Abstract: Cell-based augmented reality (AR) content positioning systems may include a reference grid of cells, each of which includes a 32-bit intracellular coordinate system based on a respective reference point of the cell. Cell topology is selected such that the intracellular coordinate systems may utilize single-precision floating point numbers while retaining the ability to define content positions with, e.g., millimeter-level precision. Accordingly, rendering of AR content may be performed at a high precision using 32-bit devices and methods.

Abstract: Systems and methods relate to receiving a plurality of video streams captured of a subject by a plurality of video cameras, each video stream including video frames time-synchronized according to a shared frame rate, each video camera having a known vantage point in a predetermined coordinate system; obtaining at least one three-dimensional (3D) mesh of the subject at the shared frame rate, the 3D mesh time-synchronized with the video frames of the video streams, the at least one mesh including a plurality of vertices with known locations in the predetermined coordinate system; calculating one or more lists of visible-vertices at the shared frame rate, each list including a subset of the plurality of vertices of the at least one 3D mesh of the subject, the subset being a function of the location of the known vantage point associated with at least one of the plurality of video cameras; generating one or more time-synchronized data streams at the shared frame rate, the one or more time-synchronized data streams

Abstract: Methods, apparatus, devices, and systems for three-dimensional (3D) displaying objects are provided. In one aspect, a method includes obtaining data including respective primitive data for primitives corresponding to an object, determining an electromagnetic (EM) field contribution to each element of a display for each of the primitives by calculating an EM field propagation from the primitive to the element, generating a sum of the EM field contributions from the primitives for each of the elements, transmitting to each of the elements a respective control signal for modulating at least one property of the element based on the sum of the EM field contributions, and transmitting a timing control signal to an illuminator to activate the illuminator to illuminate light on the display, such that the light is caused by the modulated elements of the display to form a volumetric light field corresponding to the object.

Abstract: Described are examples for determining an effective color space of a display. A two-dimensional parametric surface that intersects a color volume defined for the display can be defined for at least one color volume vertex. A flat bitmap to which the two-dimensional parametric surface is mapped can be displayed, on the display, for the at least one color volume vertex. A selection of a point on the flat bitmap that corresponds to a perceived maximum color can be received for the at least one color volume vertex. The effective color space of the display can be determined based at least in part on the perceived maximum color selected for the at least one color volume vertex.

Abstract: A computer-implemented method for cognitive rendering of inputs received by a virtual reality (VR) system includes: receiving sensor data from at least one sensor of the VR system, the sensor data corresponding to one or more behaviors exhibited by a user of the VR system; comparing the sensor data to a predetermined list of expected behaviors; and determining the sensor data identifies an unexpected behavior in response to determining, based on the comparison, the behavior is not one of the expected behaviors. Various embodiments of the general inventive concept described above are presented in the form of methods, systems, and computer program products, all generally relating to real-time detection/anticipation of unexpected behaviors exhibited by a user but not relevant to a VR experience, and avoiding the rendering of movements, speech, etc. that are part of the unexpected behavior in order to improve the immersive nature of the VR experience.

Abstract: There is provided a display control device including an image acquiring section configured to acquire a moving image shot from a viewpoint changing from moment to moment, a spatial position specifying section configured to specify a spatial position in a first frame of the moving image, and a display control section configured to display the moving image, in such a manner to maintain the spatial position in a predetermined state in a second frame after the first frame.

Abstract: The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor.

Abstract: A three-dimensional (3D) object is configured for presentation on a display screen. Object data representing a model of a 3D object is received at a graphics processing unit. The object data includes a plurality of interrelated polygons. Coordinates for one or more clipping boundaries are also received at the graphics processing unit. The clipping boundaries definer a presentation region that overlaps at least in part with visible portions of the display screen. Using a geometry shader, per-polygon clipping is performed on each polygon of the object data that intersects with at least one clipping boundary. Only portions of the 3D object that lie within the presentation region are then presented on the display screen.

Abstract: A mixed reality system including a display and camera is configured to receive video of a physical scene from the camera and construct a 3D model of the physical scene based on the video. Spatial sensing provides pose (position and orientation) updates corresponding to a physical pose of the display. First user inputs allow a user to define an input path. The input path may be displayed as a graphic path or line. The input path is mapped to a 3D path in the 3D model. Second user inputs define animation features in association with the 3D path. Animation features include an object (e.g., a character), animation commands, etc. The animation commands may be manually mapped to points on the 3D path and executed during an animation of the object guided by the 3D path.

Abstract: Three-dimensional (3D) depth imaging systems and methods are disclosed for assessing an orientation with respect to a container. A 3D-depth camera captures 3D image data of a shipping container. A container feature assessment application determines a representative container point cloud and (a) converts the 3D image data into 2D depth image data; (b) compares the 2D depth image data to one or more template image data; (c) performs segmentation to extract 3D point cloud features; (d) determines exterior features of the shipping container and assesses the exterior features using an exterior features metric; (e) determines interior features of the shipping container and assesses the interior features using an interior features metric; and (f) generates an orientation adjustment instruction for indicating to an operator to orient the 3D-depth camera in a second direction for use during a shipping container loading session, wherein the second direction is different than the first direction.

Abstract: A graphics processing apparatus comprises fragment generating circuitry to generate graphics fragments corresponding to graphics primitives, thread processing circuitry to perform threads of processing corresponding to the fragments, and forward kill circuitry to trigger a forward kill operation to prevent further processing of a target thread of processing corresponding to an earlier graphics fragment when the forward kill operation is enabled for the target thread and the earlier graphics fragment is determined to be obscured by one or more later graphics fragments. The thread processing circuitry supports enabling of the forward kill operation for a thread including at least one forward kill blocking instruction having a property indicative that the forward kill operation should be disabled for the given thread, when the thread processing circuitry has not yet reached a portion of the thread including the at least one forward kill blocking instruction.

Abstract: Methods and systems for volumetric segmentation of structures in planar medical images. One example method includes displaying a first planar medical image. The method further includes receiving a user input indicating a line segment in the first planar medical image. The method also includes determining an inclusion region using the line segment. The inclusion region consists of a portion of the structure. The method further includes determining a containment region using the line segment. The containment region includes the structure. The method also includes determining a background region using the line segment. The background region excludes the structure. The method further includes determining a three dimensional (3D) contour of the structure using the inclusion region, the containment region, and the background region. The method also includes determining a long axis of the structure using the 3D contour. The method further includes outputting a dimension of the long axis.

Abstract: A technique is provided to facilitate visual recognition of deviations and misalignments in a superposed image. The superposed image is generated by superposing laser scanning point clouds on a panoramic image, which is obtained by stitching base images that are taken from different points of view. The panoramic image can include deviations between the base images. The superposed image can include misalignments between the point cloud image and the panoramic image. A display controlling device for a survey image includes a panoramic image generating unit that generates a panoramic image by stitching multiple still images, an image and point-cloud-image superposing unit that superposes laser scanning point clouds on the panoramic image, and a point-cloud-image transparency adjuster that adjusts a transparency of the image of the laser scanning point clouds to cause the laser scanning point clouds to be visually recognized while the underlying panoramic image is also visually recognized.

Abstract: In one embodiment, a method includes receiving an audio signal comprising a plurality of speech units, processing the audio signal to associate each of the speech units with a corresponding lip animation, determining pitch information associated with each of the plurality of speech units, processing the pitch information of each of the plurality of speech units to associate at least one of the speech units with a facial-component animation, and presenting the audio signal with a displayed animation of a face, wherein the animation of the face displays the lip animation associated with each of the speech units and the facial-component animation associated with the at least one speech unit. The animation of the face may be displayed in real time with the audio signal. The facial component animation may include animation of the lips, eyebrows, eyelids, and other portion of the upper face.

Abstract: Methods of and systems for executing a simulation of a constrained multi-body system. The method comprises, using a physics engine, simulating the constrained multi-body system, wherein: the constrained multi-body system comprises articulated constraints, the articulated constraints are associated with a geometric stiffness matrix; the geometric stiffness matrix defining a geometric stiffness; a diagonal approximation of the geometric stiffness matrix is generated; and the diagonal approximation is used as part of a stability analysis in which damping is automatically adjusted so that the damping stabilizes the simulation of the constrained multi-body system.

Abstract: The disclosed technology includes systems and methods for a recursive cell-based hierarchy for data visualization. The technology disclosed relates to a platform for ultrafast, ad-hoc data exploration and faceted navigation on integrated, heterogeneous data sets. The disclosed apparatus and methods for secure isolation of scripting from graphics make it possible to securely share live data as rendered on a live dashboard, for both desktop and mobile application environments, without saving a new state on a server when time data and dashboard elements are updated. The disclosed recursive cell-based hierarchy for data visualization makes it possible to target multiple platforms—generating data visualization representations that can be displayed when rendered natively on both desktop and mobile devices, and when rendered in a browser window.

Abstract: A method for volume ray casting is provided. For each pixel of a 2D image placed in a view plane a ray of sight is projected through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. A plurality of sampling points is determined along each ray of sight such that a distance between two consecutive sampling points is larger at a larger distance to the view plane. At each sampling point a color value and a transparency value is determined in dependence upon voxels in proximity of the sampling point and a lighting calculation, wherein for the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane. For each ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of each ray corresponds to a pixel value of the 2D image.