Abstract: It is presented a method for improving performance of generation of digitally represented graphics. Said method comprises the steps of: selecting (440) a tile comprising fragments to process; executing (452) a culling program for the tile, the culling program being replaceable; and executing a set of instructions, selected from a plurality of sets of instructions based on an output value of the culling program, for each of a plurality of subsets of the fragments. A corresponding display adapter and computer program product are also presented.

Abstract: A method of using a computer to generate virtual autostereoscopic images from a three-dimensional digital data set is provided. The method includes establishing a first point of view and field of view of a subject volume including a region of interest. The method also includes reading at least one scene parameter associated with the field of view of the subject volume. The method also includes determining a second point of view offset some distance and along some vector from the first point of view based on a value derived from at least one scene parameter. The method also includes generating and storing images and relevant metadata from said first and second points of view. The method also includes displaying the stored images by alternatingly displaying stored images from said first and second points of view. The method further includes performing one or more transformations on the alternatingly displayed images.

Abstract: Provided is a rendering method and apparatuses for rendering image data. The rendering method includes generating a primitive list by performing geometry processing on a current tile to be rendered; determining whether the current tile is identical to a previous tile from among tiles included in a previously rendered frame; and in response to the previous tile being identical to the current tile, generating an image of the current tile by re-using an image of the previous tile.

Abstract: Systems, methods, and non-transitory computer-readable media for capturing images with an imaging sensor device using a web browser of a user computer device. A user may use a user computer device to capture (i.e., acquire) images over the web. A web browser of the user computer device is used to access a web site and download a dynamic link library (DLL) to the user computer device. The DLL may be executed in a web browser environment of the user computer device to capture an image via an imaging sensor device.

Abstract: Approaches enable image content (e.g., still or video content) to be displayed in such a way that the image content will appear, to a viewer, to include portions with different locations in physical space, with the relative positioning of those portions being determined at least in part upon a current relative position and/or orientation of the viewer with respect to the device, as well as changes in that relative position and/or orientation. For example, relationship pairs for image content capable of being displayed on a display screen can be determined. Based on the relationship pairs, a node hierarchy that includes position information for planes of content that include the image content can be determined.

Abstract: A method for regional compositing includes compositing a plurality of video planes and at least one graphics plane. Graphics elements of the at least one graphics plane may be stored into a single graphics plane. A rectangle may be associated to one or more graphics elements of the single graphics plane. A Z-order of the plurality of video planes and the at least one graphics plane may be determined according to rectangular regions defined by rectangles associated with graphics elements of the single graphics plane. A pixel-by-pixel Z-order may be performed based on the determined Z-order of the plurality of video planes and the at least one graphics plane.

Abstract: The invention relates to a computer implemented method for preparing content of a document, wherein a document file is received as an input, the content of the document file is parsed, the parsed content data items forming the content of the document file are classified into at least two separate categories. Further, within the method at least one of the following is performed for the classified parsed content data items: rendering the content data items classified in a first category into a raster canvas and storing the rendered content of the raster canvas into a raster image file, generating and storing a meta file comprising at least one preprocessed rendering instruction for at least one content data item classified in a second category. The invention also relates to a system configured to perform the method and a non-transitory computer readable medium storing computer program code.

Abstract: A method, apparatus and computer program product are provided to display objects in an augmented reality interface. In this regard, the method, apparatus, and computer program product may determine a location of a mobile terminal, receive object meshes for one or more objects in geographic proximity to the mobile terminal, remove, using a processor, one or more polygons from the object meshes, and determine occlusion between the location of the mobile terminal and at least one point of interest. The at least one point of interest may be identified as occluded if a line segment between the location and the at least one point of interest intersects with at least one of the object meshes. The method, apparatus, and computer program product may also include causing the at least one point of interest to not be displayed by an augmented reality interface.

Abstract: A method for delivering media from a server to a client device over a network is disclosed. An Virtual-Reality (VR) scene application running on the server generates a virtual VR 3D environment containing 3D models. The server checks the status of each 3D model in a predetermined order, and then, only those 3D models which are not pre-stored in the client device will all be rendered by the server into a left eye frame and a right eye frame of 2D video stream. The server then sends to the client device the frames and meta data of the 3D models which are pre-stored in the client device via the network. The client device uses a combined VR frame of these frames as a background for rendering the 3D models which are pre-stored in the client device so as to generate a mixed VR frame of video stream for output.

Abstract: An image output apparatus and a method of rendering an image thereof are provided. The method includes: a data input configured to receive stroke attribute information; a vertex generator configured to generate a vertex which indicates an outer appearance of a stroke based on the stroke attribute information; an alpha value setter configured to calculate a size of a texture based on the stroke attribute information and set an alpha value that will be stored in the texture; a UV setter configured to set UV information based on the stroke attribute information; a renderer configured to render the stroke based on the vertex, the texture in which the alpha value is stored and the UV information; and an output configured to output the rendered stroke.

Abstract: There is provided a method and apparatus for managing memory in a system for generating 3-dimensional computer images. The image is subdivided into a plurality of rectangular areas. A memory is provided and a page of the memory is allocated for storing object data for objects in the image. Object data for objects in the image are then written to the allocated page of memory. Finally, a bit mask for the allocated page of memory is compiled, the bit mask indicating the rectangular areas having object data stored in the allocated page of memory. A rectangular area of the image can then be rendered by deriving data for display from the object data stored in the memory, for objects in that rectangular area. Once the rectangular area has been rendered, the bit mask for each page of memory which stored, before the step of rendering, object data for that rectangular area, is updated so that the bit mask no longer indicates that rectangular area.

Abstract: A method and system renders a 3D model of a 3D object as an image including image samples. The 3D model is a distance field, and the distance field includes surface cells representing portions of a surface of the 3D object. A set of image samples in the image is determined in an object-order phase for each surface cell. Each surface cell is then processed independent of other surface cells. The processing casts a ray, in an image order phase from each image sample in the set of image samples, through the surface cell to determine a contribution of the surface cell to the image sample, and then the image is rendered.

Abstract: A system and method are that includes a frame and a weapon mount on the frame that receives a weapon mock-up. The system also includes a substantially non-rotatable sensing platform, coupled to the frame, on which a single trainee stands, where rotational pressure applied to the platform by the trainee generates a virtual orientation signal. The system also includes a head-mounted display worn by the trainee that receives a display signal representative of a virtual environment to be simulated to the trainee; and a controller in electrical communication with the sensing platform and the display, wherein the controller receives the virtual orientation signal and generates the display signal in response such that rotational pressure applied to the platform by the trainee results in rotation of the virtual environment displayed to the trainee. A method for the simulation of a single weapon system in a transportable enclosure is also presented.

Abstract: A system that generates interactive intersection areas receives a graphic diagram that includes a plurality of intersecting shapes and intersection areas. The system then creates or receives a definition for each of the shapes and determines a number of possible intersection areas for the diagram. The system defines a clipping path for each possible intersection area and defines a mask for each possible intersection area. The system then draws each intersection area using the defined clipping paths and masks.

Abstract: A system, method, and computer program product are provided for using a bit-count texture format. A rasterized coverage bit mask is received by a texture processing unit from a bit-count format texture map, the rasterized coverage bit mask is converted to a scalar value, and the scalar value is processed while the rasterized coverage bit mask is retained in the bit-count format texture map. The coverage bit mask may be converted by computing a count of samples that are covered by at least one graphics primitive according to the rasterized coverage bit mask.

Abstract: An entertainment displaying system for generating interactive displaying effects corresponding to a real object in view of an observation area is disclosed. The entertainment displaying system includes a tracking module, a computing module and a stereoscopic displaying module. The tracking module is used for tracking a relative position relationship between the real object and the observation area. The computing module is configured for generating a stereoscopic virtual object according to the relative position relationship. The stereoscopic displaying module includes a transparent displaying apparatus and an optical-shielding structure. The transparent displaying apparatus is configured for displaying the stereoscopic virtual object. The optical-shielding structure is disposed adjacent to the transparent displaying apparatus and located between the transparent displaying apparatus and the real object.

Abstract: A method of producing a stereo image from a temporal sequence of digital images, comprising: receiving a temporal sequence of digital images; analyzing pairs of digital images to produce corresponding stereo suitability scores, wherein the stereo suitability score for a particular pair of images is determined responsive to the relative positions of corresponding features in the particular pair of digital image; selecting a pair of digital images including a first image and a second image based on the stereo suitability scores; using a processor to analyze the selected pair of digital images to produce a motion consistency map indicating regions of consistent motion, the motion consistency map having an array of pixels; producing a stereo image pair including a left view image and a right view image by combining the first image and the second image responsive to the motion consistency map; and storing the stereo image pair in a processor-accessible memory.

Abstract: Non-opaque primitives (e.g. translucent or punch-through primitives) often include some fragments which do not need to be treated as non-opaque fragments. For example, some fragments of a translucent primitive may be entirely opaque or entirely transparent. However, typically, the opacity states (e.g. alpha states) of the fragments are not known until texturing has been applied because it is the texture that includes the opacity information (e.g. the alpha values). However, as described herein, an opacity test is performed up front (e.g. before texturing is applied to fragments of a non-opaque primitive) to see if the processing of the fragments can be simplified. For example, if fragments are fully transparent then they may be discarded. As another example, if fragments are fully opaque then they may be handled as if they have an opaque object type such that the subsequent processing of the fragments is simplified.

Abstract: Methods and apparatus for procedural modeling are described for generating procedural models and exploring procedural model space. Common procedural components (models, modules, and methods) and a hierarchical framework are described that may be used to construct hierarchical procedural models. A model may comprise a hierarchy of one or more modules. Each module includes a sequence of methods and an optional geometry for display. A method may be controlled by one or more parameters. The values of the parameters may be specified via curves. A module description may be condensed into a single array of values for parameters of the module. Thus, a model or module may be specified by filling in values for arrays of parameters for the sequence of methods. An interpolation technique for interpolating between models is described in which models are matched according to a cost function so that ancestry is preserved.

Abstract: A method and apparatus includes primitive setup circuitry for determining a plurality of functions for an input graphics primitive, including an edge function associated with each edge of the input graphics primitive and a depth function associated with the input graphics primitive. Rasterization circuitry performs a rasterization operation in order to calculate position data for a plurality of graphics fragments to be used to represent the input graphics primitive. In a default mode of operation, depth bound clipping circuitry performs a depth bound clipping operation by determining, for each graphics fragment in said plurality of graphics fragments, a depth value for said graphics fragment using the depth function, and determining whether said depth value resides within a valid depth range of a view frustum, the graphics fragment being discarded from further processing if its depth value does not reside within said valid depth range.

Abstract: A GPU may determine, based on a visibility stream, whether to execute instructions stored in an indirect buffer. The instructions include instructions for rendering primitives associated with a bin of a plurality of bins and include one or more secondary operations. The visibility stream indicate if one or more of the primitives associated with the bin will be visible in a finally rendered scene. The GPU may, responsive to determining not to execute the instructions stored in the indirect buffer, execute one or more secondary operations stored in a shadow indirect buffer. The GPU may, responsive to determining to execute the instructions stored in the indirect buffer, execute the instructions for rending the primitives associated with the bin of the plurality of bins and executing the one or more secondary operations stored in the indirect buffer.

Abstract: Systems and methods are described including creating a mask that indicates which pixel groups do not need to be loaded from Graphics Memory (GMEM). The mask indicates a pixel group does not need to be loaded from GMEM. The systems and methods may further include rendering a tile on a screen. This may include loading the GMEM based on the indication from the mask and skipping a load from the GMEM based on the indication from the mask.

Abstract: The technology causes disappearance of a real object in a field of view of a see-through, mixed reality display device system based on user disappearance criteria. Image data is tracked to the real object in the field of view of the see-through display for implementing an alteration technique on the real object causing its disappearance from the display. A real object may satisfy user disappearance criteria by being associated with subject matter that the user does not wish to see or by not satisfying relevance criteria for a current subject matter of interest to the user. In some embodiments, based on a 3D model of a location of the display device system, an alteration technique may be selected for a real object based on a visibility level associated with the position within the location. Image data for alteration may be prefetched based on a location of the display device system.

Abstract: The present invention relates to controlling an optical output device for displaying a vehicle surround view containing a vehicle model, the method comprising determining display control information for at least one vehicle component, and controlling the optical output device to display the vehicle surround view such that the vehicle model is adapted to depict the at least one vehicle component according to the display control information.

Abstract: A profiler for a ray tracing renderer interfaces with the renderer to collect rendering information, such as ray definition information, a pixel origin, objects hit, shader invocation, and related rays. In an interface, an artist views a simplified 3-D scene model and a rendered 2-D image. A pixel in the 2-D image is selectable; the profiler responds by populating the simplified 3-D scene with rays that contributed to that pixel. Rays can be displayed in the simplified 3-D scene to visually convey information about characteristics of each ray, such as whether the ray intersected an object, portions of the scene where it is occluded, and a direction. Statistics can be produced by the profiler that convey information such as relative computational complexity to render particular pixels. The profiler can step through multiple passes (e.g., multiple frames and passes of a multipass rendering), and the UI can allow pausing and stepping.

Abstract: A method for delivering media from a server to a client device over a network is disclosed. An application running on the server generates a virtual 3D environment containing 3D models and sounds. The server checks the status of each 3D model or sound in a predetermined order, and then, only those 3D models and sounds which are not pre-stored in the client device will all be rendered by the server into a frame of 2D video stream with sound. The server then sends to the client device the frame and meta data of the 3D models and sounds which are pre-stored in the client device via the network. The client device uses the frame as a background for rendering the 3D models and sounds which are pre-stored in the client device so as to generate a mixed frame of video stream with sound for output.

Abstract: Disclosed is a computer-implemented method for visualizing/rendering a computer model, the computer model comprising a plurality of components wherein the method comprises: storing a plurality of parts of at least one of the plurality of components, each part including geometry information for visualizing/rendering the part, storing information indicative of the position and orientation of a plurality of components in a coordinate system, determining a spatial relationship between individual components, determining for the at least one component a number of stored parts to use for visualizing/rendering the component, based on the determined spatial relationship between the individual components. By using the spatial relationship between the components to determine the number of parts to use for visualizing/rendering a component, knowledge about the geometry of individual components and the connections of the components with other components can be used to find hidden parts that can be removed.

Abstract: A method of determining slope of pixel intensities in an image includes the following steps: (a) receiving, from an imaging device, input pixel samples of a region of interest; (b) forming an impulse response function (IPR) for use in resampling the input pixel samples into output pixel intensities; and (c) calculating a derivative of the IPR. Also included is the step of convolving the derivative of the IPR with the input pixel samples to determine the slope of the output pixel intensities in the region of interest. In addition, the input pixel samples are generated in a first coordinate system by the imaging device, and the output pixel intensities are generated in a second coordinate system.

Abstract: Methods, systems, and computer-storage media for target independent rasterization of an image. The target is the memory allocated for a rendered image within a graphics pipeline. Embodiments of the present invention allow the rasterization process's sampling rate to be specified independently from the memory allocated for the rendered image. Embodiments of the present invention also allow the rasterization process to be executed at a rate that does not correspond to the memory allocated for the rendered target.

Abstract: A method for rendering point cloud using a voxel grid, includes generating bounding box including all the point cloud and dividing the generated bounding box into voxels to make the voxel grid; and allocating at least one texture plane to each of the voxels of the voxel grid. Further, the method includes orthogonally projecting points within the voxel to the allocated texture planes to generate texture images; and rendering each voxel of the voxel grid by selecting one of the texture planes within the voxel by using central position of the voxel and the 3D camera position and rendering using the texture images corresponding to the selected texture plane.

Abstract: A system, method, and computer program product are provided for inputting modified coverage data into a pixel shader. In use, coverage data modified by a depth/stencil test is input into a pixel shader. Additionally, one or more actions are performed at the pixel shader, utilizing the modified coverage data.

Abstract: The early depth test stages 4, 13 of a graphics processing pipeline 1 are configured to broadcast information 9, 10, 11, 14 about fragments, etc., that pass those early depth tests to other stages 3, 4, 6, 12 in the pipeline. The other stages in the pipeline then use the early depth test pass information to determine if the processing of any fragments that they are currently processing can be stopped.

Abstract: Provided are techniques for receiving multiple data streams having different data formats. The multiple data streams are converted into an Extremely Large Complex Object (XLCO) file by forming multiple XLCO segments corresponding to the multiple data streams, wherein different data formats are stored in different XLCO segments, and wherein different XLCO segments are different sizes. The XLCO segments of the XLCO are stored in different physical file systems having different operating systems.

Abstract: An optimized method of processing queries requesting a description of a spatial relationship between a test geometry and a query geometry, such as points, lines, polygons, and collections thereof, is disclosed. A first part of the method finds a first spatial relationship between a minimum bounding rectangle (MBR) of the test geometry and an In-Memory R-tree (IMR-tree) built to describe the query geometry. If the first relationship does not specify the requested description, then a second part of the method uses the IMR-tree of the query geometry to find a second spatial relationship between the test geometry itself and the query geometry. Optimizations are applied to the first part and to the second part. Optimizations in the second part depend on the test geometry.

Abstract: A memory management system for generating 3-dimensional computer images is provided. The memory management system includes a device for subdividing an image into a plurality of rectangular areas, a memory for storing object data pertaining to objects in the image which fall in each rectangular area, a device for storing the object data in the memory, a device for deriving image data and shading data for each rectangular area from the object data, a device for supplying object data for each rectangular area from the respective portion of the memory and, if the rectangular area contains objects also falling in at least one other rectangular area, also from the global list, to the deriving device, and a device for storing the image data and shading data derived by the deriving device for display. The memory includes at least one portion allocated to each rectangular area and at least one portion allocated as a global list.

Abstract: A three-dimensional scene is modeled as a set of layers representing different depths of the scene, and as masks representing occlusions of layers by other layers. The layers are represented as linear combinations of atoms selected from an overcomplete dictionary. An iterative approach is used to alternately estimate the atom coefficients for layers from a light field image of the scene, assuming values for the masks, and to estimate the masks given the estimated layers. In one approach, the atoms in the dictionary are ridgelets oriented at different angles, where there is a correspondence between depth and angle.

Abstract: An approach is provided for grouping and de-overlapping items in a user interface. A display manager determines one or more items for rendering in a user interface. The display manager then causes, at least in part, a determination of one or more rendering locations for one or more representations of the one or more items based, at least in part, on location information associated with the one or more items. The display manager further causes, at least in part, a grouping, a de-overlapping, or a combination thereof of the one or more representations based, at least in part, on an overlapping of the one or more rendering locations. The display manager also causes, at least in part, a rendering of the one or more representations in the user interface based, at least in part, on the grouping, the de-overlapping, or a combination thereof.

Abstract: Techniques are disclosed for dispatching pixel information in a graphics processing pipeline. A fragment processing unit in the graphics processing pipeline generates a pixel that includes multiple samples based on a portion of a graphics primitive received by a thread. The fragment processing unit calculates a set of source values, where each source value corresponds to a different sample of the pixel. The fragment processing unit retrieves a set of destination values from a render target, where each destination value corresponds to a different source value. The fragment processing unit blends each source value with a corresponding destination value to create a set of final values, and creates one or more dispatch messages to store the set of final values in a set of output registers. One advantage of the disclosed techniques is that pixel shader programs perform per-sample operations with increased efficiency.

Abstract: One object of the present invention is to reduce the load on a server and reduce the communication traffic produced in providing online games. In accordance with one aspect, the server can execute a game program including: a game progress module for progressing a game; a generation module for generating, at first time intervals, frame information containing a plurality of drawing commands to be executed on a terminal device to render one frame of a game screen; a determination module for determining whether to send the generated frame information to the terminal device; a compression module for compressing the generated frame information; a sending module for sending to the terminal device the compressed frame information to be sent; and a request module for requesting drawing execution time information from the terminal device at second time intervals.

Abstract: A new hardware architecture defines an indexing and encoding method for accelerating incoherent ray traversal. Accelerating multiple ray traversal may be accomplished by organizing the rays for minimal movement of data, hiding latency due to external memory access, and performing adaptive binning. Rays may be binned into coarse grain and fine grain spatial bins, independent of direction.

Abstract: A system and method is disclosed for extracting a user persona from a video and embedding that persona into a background feed that may have other content, such as text, graphics, or additional video content. The extracted video and background feed are combined to create a composite video that comprises the display in a videoconference. Embodiments cause the user persona to be embedded at preset positions, or in preset formats, or both, depending on the configuration, position, or motion of the user's body.

Abstract: This invention is to provide an image processing apparatus, an image processing method, a program, and a display in which both of a secret image and a public image can be efficiently displayed with high picture quality without reducing contrast of the public image. One of output images is a secret image which displays an input secret image as one of input images in a partial area of a screen, all the output images including the secret image have a relationship to become, when a luminance value of each pixel thereof is totaled, an input public image as one of the input images; and during a period in which at least the secret image is being outputted, shutter glasses disposed between a display to which the image signals are inputted and user's eyes are set to a light transmission state.

Abstract: A three-dimensional computer graphics rendering system allows a tile-based rendering system to operate with a reduced amount of storage required for tiled screen space geometry by using an untransformed display list to represent the screen's geometry.

Abstract: A right virtual camera and a left virtual camera are set on a straight line passing through a reference virtual camera and extending perpendicular to a camera direction of the reference virtual camera, in accordance with the reference virtual camera set within a virtual space. A right background image and a left background image are generated such that the right background image and the left background image have relative relation in accordance with positional relation between the right virtual camera and the left virtual camera.

Abstract: Provided are an apparatus and method for generating an acceleration structure in a ray tracing system. The method of generating an acceleration structure includes splitting, at an acceleration structure generator, a space comprising a three-dimensional (3D) object into a plurality of sub spaces, calculating costs for traversing the plurality of sub spaces based on occlusion information of primitives in the plurality of sub spaces, selecting the plurality of sub spaces that minimize the costs for traversing, and generating an acceleration structure based on setting the selected plurality of sub spaces as nodes.

Abstract: Disclosed is a mesh generating apparatus, method and computer-readable medium, and an image processing apparatus, method and computer-readable medium. A single 3D mesh and a single 3D object model may be generated using a single color image and a single depth image. A plurality of viewpoint images seen from a plurality of viewpoints may be generated from a single 3D object model.

Abstract: A method on a processor customizes a fixation plate for repairing a bone fracture. A digital CAD model of an implant contains smooth analytic geometry representations including NURBS. The CAD geometry is directly manipulated to generate a customized implant CAD model that conforms to the desired region of the bone surface of a patient. Direct manipulation of NURBS geometry is computationally fast and suitable for interactive planning. The patient specific customized implant is produced directly from the generated customized CAD model with a standard CNC machine before surgery. The patient customized implant is implanted in the patient.

Abstract: A line depth augmentation system and method for conversion of 2D images to 3D images. Enables adding depth to regions by altering depth of lines in the regions, for example in cell animation images or regions of limited color range. Eliminates creation of wireframe or other depth models and complex modeling of regions to match the depth of lines therein. Enables rapid conversion of two-dimensional images to three-dimensional images by enabling stereographers to quickly add/alter line depth without artifacts in images for example lines in monochrome regions. Embodiments may output a stereoscopic image pair of images with lines having desired depth, or any other three-dimensional viewing enabled image, such as an anaglyph image. Although the lines may be of a different depth than the region they appear in, the human mind interprets the monochromatic region as having depth associated with the line.

Abstract: A computing device meshes a curved surface into a plurality of triangles, records symbols and coordinate data of three vertexes of each triangle into a data structure of the triangle, and processes the data structures of the triangles by representing vertexes having the same coordinate data with the same symbol. The computing device recognizes inner triangles and surface triangles of the curved surface, deletes the inner triangles of the curved surface, and reads information recorded in the processed data structures of the surface triangles and outputs the surface triangles of the curved surface to a display device.

Abstract: An image processing method includes: determining whether a draw command that is identical to a previous draw command is input; obtaining information about a transparency of a previous frame that is performed with the previous draw command; and performing image processing on a current frame based on the information about the transparency.