Z Buffer (depth Buffer) Patents (Class 345/422)
  • Patent number: 11497998
    Abstract: A social game capable of adding or improving unexpectedness, dramatic impact, and taste when a reward is provided to a player, and hence capable of raising the player's motivation to participate in or continue the game. A unit for storing information related to a game in which multiple players can participate stores a reward providing condition, rewards, and reward box information, and a control unit for accessing information related to the game, performing computation on the game, and displaying images of the game on terminal devices operated by players allocates at least one reward out of the rewards to the reward box, determines whether the reward providing condition is met based on match-up situations or match-up results between players and first game characters in the game, and displays, on the terminal devices, a screen for providing the reward to players based on the determination results.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: November 15, 2022
    Assignee: GREE, Inc.
    Inventor: Naomichi Youda
  • Patent number: 11468621
    Abstract: One embodiment provides for a data processing system comprising a memory module to store a multisample render target, the multisample render target to store multiple sample locations for each pixel in a set of pixels and a general-purpose graphics processor including a hardware graphics rendering pipeline to generate pixel color data to be output to the multisample render target, a multisample antialiasing compressor to request allocation of one or more planes to store color data for a set of sample locations of a pixel in the set of pixels, and a memory allocator to allocate memory to store color data associated with the multisample render target. The memory allocator can merge a memory allocation for multiple pixels having a sample associated with a same color value.
    Type: Grant
    Filed: October 13, 2020
    Date of Patent: October 11, 2022
    Assignee: Intel Corporation
    Inventors: Abhishek R. Appu, Prasoonkumar Surti, Joydeep Ray, Michael J. Norris
  • Patent number: 11468630
    Abstract: The disclosure provides a cloud-based renderer and methods of rendering a scene on a computing system using a combination of raytracing and rasterization. In one example, a method of rendering a scene includes: (1) generating at least one raytracing acceleration structure from scene data of the scene, (2) selecting raytracing and rasterization algorithms for rendering the scene based on the scene data, and (3) rendering the scene utilizing a combination of the raytracing algorithms and the rasterization algorithms, wherein the rasterization algorithms utilize primitive cluster data from the raytracing acceleration structures.
    Type: Grant
    Filed: December 1, 2020
    Date of Patent: October 11, 2022
    Assignee: NVIDIA Corporation
    Inventors: Christoph Kubisch, Ziyad Hakura, Manuel Kraemer
  • Patent number: 11461915
    Abstract: Techniques and systems are provided for determining one or more sizes of one or more objects. For example, a bounding region identifying a first object detected in an image can be obtained. A map including map points can also be obtained. The map points correspond to one or more reference locations in a three-dimensional space. The bounding region identifying the first object can be associated with at least one map point of the map points included in the map. Using the bounding region and the at least one map point, an estimated three-dimensional position and an estimated size of the first object detected in the image can be determined. In some examples, other information can be used to estimate the estimated three-dimensional position and an estimated size of the first object, such as radar information and/or other information.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: October 4, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Jayakrishnan Unnikrishnan, Avdhut Joshi, Shivam Agarwal, Yoga Y Nadaraajan, Amir Salimi, Urs Niesen, Sree Sesha Aravind Vadrevu, Gautam Sachdeva
  • Patent number: 11463678
    Abstract: A system for social interaction using a photo-realistic novel view of an event includes a multi-view reconstruction system for developing transmission data of the event a plurality of client-side rendering devices, each rendering device receiving the transmission data from the multi-view reconstruction system and rendering the transmission data as the photo-realistic novel view. A method of social interaction using a photo-realistic novel view of an event includes transmitting by a server side transmission data of the event; receiving by a first user on a first rendering device the data transmission; selecting by the first user a path for rendering on the first rendering device at least on novel view; rendering by the first rendering device the at least one novel view; and saving by the user on the first rendering device novel view date for the at least one novel view.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: October 4, 2022
    Assignee: INTEL CORPORATION
    Inventors: Oren Haimovitch-Yogev, Matteo Shapira, Aviv Shapira, Diego Prilusky, Yaniv Ben Zvi, Adi Gilat
  • Patent number: 11436789
    Abstract: A system involves determining visually relevant design differences between a first three-dimensional model and a second three-dimensional model. The system has: a model receiving unit configured to receive the first three-dimensional model and the second three-dimensional model; a viewpoint defining unit configured to define one or more viewpoints from which the first three-dimensional model and the second three-dimensional model can be viewed; and a difference determining unit configured to determine visually relevant design differences between the first three-dimensional model and the second three-dimensional model from the one or more viewpoints.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: September 6, 2022
    Assignee: TWIKIT NV
    Inventors: Martijn Joris, Olivier De Deken
  • Patent number: 11430178
    Abstract: A method and system for three-dimensional video content processing is disclosed comprising an operation of receiving first video data representing three-dimensional video content arranged as a plurality of first tiles associated with respective sub-areas of an image. Another operation comprises providing data indicating for each first tile a depth range of video content within said tile. Another operation comprises determining for each first tile a respective volume based on the depth range. Another operation comprises determining a field of view of a user in relation to the first tile volumes. Another operation comprises rendering of the first video data for one or more first tiles only if their determined volume is at least partially within the field of view.
    Type: Grant
    Filed: June 11, 2018
    Date of Patent: August 30, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Johannes Pystynen, Kimmo Roimela, Mika Pesonen, Johannes Rajala
  • Patent number: 11422963
    Abstract: An information handling system includes a compression client, a memory, and a SDXI hardware module. The compression client issues a compression request for a block of data that is uncompressed. The memory has multiple storage locations identified by addresses, which include a source address and a destination address. The SDXI hardware module performs compression of the block of data to create compressed data of the block of data. The SDXI hardware module determines whether an amount of the compression of the block of data is less than a threshold amount of compression. In response to the amount of the compression being less than the threshold amount of compression, the SDXI hardware module disregards the compressed data of the block of data, and utilizes the uncompressed block of data in a source address. The SDXI hardware module updates metadata for the block of data to indicate that data returned to compression client is uncompressed.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: August 23, 2022
    Assignee: Dell Products L.P.
    Inventors: Shyamkumar Iyer, Andrew Butcher, Glen Sescila
  • Patent number: 11423624
    Abstract: An augmented reality (AR) device can be configured to generate a virtual representation of a user's physical environment. The AR device can capture images of the user's physical environment to generate or identify a user's location. The AR device can project graphics at designated locations within the user's environment to guide the user to capture images of the user's physical environment. The AR device can provide visual, audible, or haptic guidance to direct the user of the AR device to explore the user's environment.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: August 23, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Amy Dedonato, James Cameron Petty, Griffith Buckley Hazen, Jordan Alexander Cazamias, Karen Stolzenberg
  • Patent number: 11409276
    Abstract: A program for operating a robot, comprising providing, a user interface for controlling a robot, wherein the user interface is from the perspective of a recording device, applying, an overlay over the robot, wherein the overlay is visible through the user interface, enabling, a user to control the position and orientation of a robot, connecting a user device with a robot, converting a request from a user to alter the position and orientation of the robot, where the request is processed based on the requested position and orientation of the robot based on a target location determined by the recording device, detecting, the updated robot position and orientation through the recording device, and altering, the robot position and orientation based on a request from the user and the preserved overlay of the robot based on the new position and orientation based on the recording device perspective of the robot.
    Type: Grant
    Filed: August 18, 2019
    Date of Patent: August 9, 2022
    Inventor: Michael Isakov
  • Patent number: 11412198
    Abstract: A mechanism is described for facilitating monochrome bit depth coding. The apparatus comprises one or more processors to receive depth data and convert the depth data into color space data, including converting a first segment of the depth data into a monochrome component of the color space data and converting a second segment of the depth data into one or more color components of the color space data.
    Type: Grant
    Filed: April 29, 2019
    Date of Patent: August 9, 2022
    Assignee: Intel Corporation
    Inventors: Jill Boyce, Tzachi Hershkovich, Eyal Ruhm, Tzach Ashkenazi, Eli Turiel, Adam Kaplan
  • Patent number: 11372469
    Abstract: A multiple graphics processing unit (GPU) based parallel graphics system comprising multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation. Each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem. According to the principles of the present invention, pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and the video memory and the pixel processing subsystem in the primary GPU are used to carry out the image recomposition process, without the need for dedicated or specialized apparatus.
    Type: Grant
    Filed: October 14, 2020
    Date of Patent: June 28, 2022
    Assignee: Google LLC
    Inventor: Reuven Bakalash
  • Patent number: 11328481
    Abstract: Various implementations disclosed herein generate a mesh representing the surfaces in a physical environment. The mesh is generated using multi-resolution voxels based on detected depth information, e.g., from a depth camera. The techniques may use multiple hash tables to store the multi-resolution voxel data. For example, the hash tables may store each voxel's 3D position and a truncated signed distance field (TSDF) value corresponding to each voxels' distance to a nearest surface. Each of the multiple hash tables may include data corresponding to a different level of resolution and those resolutions may depend upon distance/noise or other factors. For example, voxels close to a depth camera may have a finer resolution and smaller size compared to voxels that are further from the depth camera. Techniques disclosed herein may involve using a meshing algorithm that combines multi-resolution voxel information stored in multiple hash tables to generate a single mesh.
    Type: Grant
    Filed: January 13, 2021
    Date of Patent: May 10, 2022
    Assignee: Apple Inc.
    Inventors: Maxime Meilland, Andrew Predoehl, Kyle L. Simek, Ming Chuang, Pedro A. Pinies Rodriguez
  • Patent number: 11315289
    Abstract: Apparatuses, methods, and computer programs are disclosed. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: signal a depth start of a patch data unit of a patch of data content based on an identifier of a tile and a patch index; wherein the depth start is used to derive a range of at least one depth value for the patch based on the patch index in a tile having the identifier; and signal a depth threshold of an immersive video extension of the patch data unit; wherein the depth threshold specifies a threshold below which an occupancy value is defined to be unoccupied for the patch based on the patch index.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: April 26, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Kimmo Tapio Roimela, Vinod Kumar Malamal Vadakital, Lauri Ilola
  • Patent number: 11308690
    Abstract: An information processing apparatus includes a processor configured to acquire volume data representing three-dimensional space using multiple voxels, data containing geometric layer and at least one attribute layer, geometric layer formed by geometric voxels included in multiple voxels, each geometric voxels assigned=a three-dimensional shape of a target object, at least one attribute layer formed by attribute voxels included in multiple voxels, each attribute voxels assigned attribute value of target object or attribute value around the target object, at least one attribute layer formed by voxels having multiple resolution levels, attribute, voxel position, and resolution level, and if voxel corresponding to the specified voxel position in an attribute layer corresponding to the attribute in the volume data and to a resolution level coinciding with the resolution level is absent, determine an attribute value of voxel corresponding to the specified voxel position and resolution level in attribute layer.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: April 19, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Yasuyuki Tanaka, Yuki Yokoyama, Tomonari Takahashi
  • Patent number: 11297116
    Abstract: A method and system are provided for hybrid streaming of media content such as video for a computer-based game. In some implementations, a background media content stream includes a background video rendered on a server. The background media content stream is received at a client device. The client device renders one or more three-dimensional objects and forms a composite media stream by combining the background media content stream and the one or more three-dimensional objects. The composite media stream can be output to a display or other external system.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: April 5, 2022
    Assignee: Roblox Corporation
    Inventors: Chetan Ahuja, Daniel G. Gelb, Angelo Pesce, Adam Miller
  • Patent number: 11295524
    Abstract: A graphics processing system includes a tiling unit configured to tile a first view of a scene into a plurality of tiles, a processing unit configured to identify a first subset of the tiles that are associated with regions of the scene that are viewable in a second view, and a rendering unit configured to render to a render target each of the identified tiles.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: April 5, 2022
    Assignee: Imagination Technologies Limited
    Inventors: Simon Fenney, Michael Worcester, Stuart Smith
  • Patent number: 11270494
    Abstract: The present concepts relate to shadow culling when rendering a 3D computer graphics virtual world. A depth buffer may be rendered from the perspective of a camera, and the depth buffer can be used to generate a hit map, which can be used to determine which objects in the world will need shadow tests. When shadow maps are generated by rendering multiple cascades from the perspective of a light, rather than including all objects in a particular cascade into the shadow map, the pixels in the hit map corresponding to an object are checked to determine whether a shadow test will be needed for the object. If the object will not contribute to the main scene, then the object is excluded from the shadow map, thus saving GPU processing resources.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: March 8, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Remi Gillig
  • Patent number: 11231785
    Abstract: A display device includes a display, a bezel disposed along a periphery of the display, a touch sensor disposed inward of the bezel and configured to receive, from a user, a first touch input at a touch location of the touch sensor, and a processor configured to control the display to display a user interface at a first location of the display. The processor is further configured to, in response to the first touch input being received while the user interface is displayed at the first location, determine a user location of the user, based on the touch location at which the first touch input is received, and control the display to move the user interface that is displayed, to a second location of the display, the second location corresponding to the user location that is determined.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: January 25, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Eun Nim Cho, Yu Hyeon Jun
  • Patent number: 11200701
    Abstract: A method, apparatus and computer program product access a video-based point cloud compression coded bitstream. The point cloud compression coded bitstream corresponds to a non-timed video-based point cloud compression representation that comprises one or more video point cloud compression units. The method, apparatus and computer program product encapsulate the one or more video point cloud compression units as one or more video point cloud compression unit items. The method, apparatus and computer program product also cause storage of the one or more video point cloud compression unit items in a file.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: December 14, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Emre Baris Aksu, Miska Matias Hannuksela
  • Patent number: 11195319
    Abstract: In one embodiment, a method includes accessing a distortion mesh defined in a 3D space by a plurality of mesh coordinates that are respectively associated with a plurality of predetermined points in a screen representation, where each mesh coordinate specifies a trajectory for a ray cast from the associated predetermined point into the 3D space; determining a sampling point within the screen representation; selecting a set of mesh coordinates from the plurality of mesh coordinates based on proximities between the sampling point and the predetermined points associated with the set of mesh coordinates; computing a sampling trajectory for the sampling point based on the selected set of mesh coordinates; casting a ray into the 3D space using the sampling trajectory; computing an intersection location between the cast ray and an object in the 3D space; and determining a color value for the sampling point based on the intersection location.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: December 7, 2021
    Assignee: Facebook Technologies, LLC.
    Inventor: Larry Seiler
  • Patent number: 11182952
    Abstract: A method and system is provided for culling hidden objects in a tile-based graphics system before they are indicated in a display list for a tile. A rendering space is divided into a plurality of regions which may for example be a plurality of tiles or a plurality of areas into which one or more tiles are divided. Depth thresholds for the regions, which are used to identify hidden objects for culling, are updated when an object entirely covers a region and in dependence on a comparison between a depth value for the object and the depth threshold for the region. For example, if the depth threshold is a maximum depth threshold, the depth threshold may be updated if an object entirely covers the tile and the maximum depth value of the object is less than the maximum depth threshold.
    Type: Grant
    Filed: April 15, 2020
    Date of Patent: November 23, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Xile Yang, John W. Howson, Simon Fenney
  • Patent number: 11184285
    Abstract: Systems, methods, devices, and non-transitory media of various embodiments enable prioritization of requests for hierarchical level of detail (HLOD) content over a communications network. Various embodiment methods may reduce load time of nodes in the HLOD data structure, such as nodes in the HLOD that may be deemed important, compared to the load time achieved in current methods. Various embodiments may provide methods for prioritizing requests for nodes.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: November 23, 2021
    Assignee: Cesium GS, Inc.
    Inventors: Joshua Lawrence, Omar Shehata, Sean Lilley, Daniel Bagnell, Patrick Cozzi
  • Patent number: 11176734
    Abstract: The present disclosure relates to methods and apparatus for graphics processing. An example method generally includes receiving, at a graphics processing unit (GPU), a plurality of commands corresponding to a plurality of draws across a frame, each of the plurality of commands indicating a depth test direction with respect to a low-resolution depth (LRZ) buffer for the corresponding draw. The method generally includes maintaining, at the GPU, a LRZ status buffer to store a corresponding depth test direction for a first command in time of the plurality of commands processed by the GPU. The method generally includes disabling, at the GPU, use of the LRZ buffer for depth testing for any of the plurality of commands remaining unprocessed after processing a command of the plurality of commands having a different depth test direction than the corresponding depth test direction stored in the LRZ status buffer.
    Type: Grant
    Filed: October 6, 2020
    Date of Patent: November 16, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Srihari Babu Alla, Adimulam Ramesh Babu, Jonnala Gadda Nagendra Kumar, Avinash Seetharamaiah, Tao Wang, Xuefeng Tang, Thomas Edwin Frisinger, Andrew Evan Gruber
  • Patent number: 11138460
    Abstract: An image processing method and apparatus. The image processing method includes: obtaining encoded data of a first region and a neighboring region neighboring to the first region in a two-dimensional planar image, where the two-dimensional planar image is an image obtained by mapping a spherical panorama image, and the first region and the neighboring region have an overlapping region; determining a pixel value of a pixel in an image of the first region; determining a pixel value of a pixel in an image of the neighboring region; and determining a target pixel value of a pixel in the overlapping region based on the pixel value of the pixel of the first region in the overlapping region and the pixel value of the pixel of the neighboring region in the overlapping region.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: October 5, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Jiali Fu, Qingpeng Xie, Yi Song
  • Patent number: 11127194
    Abstract: There is provided an image processing apparatus and an image processing method that are capable of improving the accuracy of a depth image of a 3D model. A depth image generation unit generates a depth image of a plurality of viewpoints for each object included in a 3D model. The present disclosure is applicable to, for example, an encoding device or the like configured to generate a color image and a depth image of each object of each of a plurality of viewpoints on the basis of 3D data of a 3D model, generate an encoded stream by encoding the images, and generate object range information indicating the range of each object.
    Type: Grant
    Filed: October 11, 2017
    Date of Patent: September 21, 2021
    Assignee: SONY CORPORATION
    Inventors: Goh Kobayashi, Junichi Tanaka, Yuichi Araki
  • Patent number: 11107269
    Abstract: Embodiments described herein provide for a technique to improve the culling efficiency of coarse depth testing. One embodiment provides for a graphics processor that includes a depth pipeline that is configured to perform a method to track a history of source fragments that are tested against a destination tile. When a combination of partial fragments sum to full coverage, the most conservative source far depth value is used instead of the previous destination far depth value.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: August 31, 2021
    Assignee: Intel Corporation
    Inventors: Saikat Mandal, Vasanth Ranganathan
  • Patent number: 11107291
    Abstract: Systems and methods are described that obtain depth data associated with a scene captured by an electronic device, obtain location data associated with a plurality of physical objects within a predetermined distance of the electronic device, generate a plurality of augmented reality objects configured to be displayed over a portion of the plurality of physical objects, and generate a plurality of proximity layers corresponding to the at least one scene, wherein a respective proximity layer is configured to trigger display of the auxiliary data corresponding to AR objects associated with the respective proximity layer while suppressing other AR objects.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: August 31, 2021
    Assignee: GOOGLE LLC
    Inventors: Michael Ishigaki, Diane Wang
  • Patent number: 11080925
    Abstract: Briefly, in accordance with one or more embodiments, a processor performs a coarse depth test on pixel data, and performs a final depth test on the pixel data. Coarse depth data is stored in a coarse depth cache, and per pixel depth data is stored in a per pixel depth cache. If a result of the coarse depth test is ambiguous, the processor is to read the per pixel depth data from the per pixel depth cache, and to update the coarse depth data with the per pixel depth data if the per pixel depth data has a smaller depth range than the coarse depth data.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: August 3, 2021
    Assignee: INTEL CORPORATION
    Inventors: Vasanth Ranganathan, Saikat Mandal, Saurabh Sharma, Vamsee Vardhan Chivukula, Karol A. Szerszen, Aleksander Olek Neyman, Altug Koker, Prasoonkumar Surti, Abhishek Appu, Joydeep Ray, Art Hunter, Luis F. Cruz Camacho, Akshay R. Chada
  • Patent number: 11079768
    Abstract: Methods and systems for use of a reference image to detect a road obstacle are described. A computing device configured to control a vehicle, may be configured to receive, from an image-capture device, an image of a road on which the vehicle is travelling. The computing device may be configured to compare the image to a reference image; and identify a difference between the image and the reference image. Further, the computing device may be configured to determine a level of confidence for identification of the difference. Based on the difference and the level of confidence, the computing device may be configured to modify a control strategy associated with a driving behavior of the vehicle; and control the vehicle based on the modified control strategy.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: August 3, 2021
    Assignee: Waymo LLC
    Inventors: David Ian Ferguson, Jiajun Zhu
  • Patent number: 11080928
    Abstract: The present disclosure relates to methods and apparatus for graphics processing. In some aspects, the apparatus can determine a plurality of sub-primitives corresponding to one or more primitives in an image. The apparatus can also determine visibility information for each of the sub-primitives. The visibility information can include information regarding whether the sub-primitive is visible. Further, the apparatus can identify one or more of the sub-primitives as visible based on the visibility information. The apparatus can also determine a sub-primitive visibility stream including the sub-primitives identified as visible. Additionally, the apparatus can render at least one of the sub-primitives identified as visible in the sub-primitive visibility stream. The apparatus can also identify at least one of the sub-primitives as not visible based on the determined visibility information. Moreover, the apparatus can determine to skip rendering the at least one of the sub-primitives identified as not visible.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: August 3, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Gang Zhong, Li Shen
  • Patent number: 11055904
    Abstract: A graphics processor includes a rasteriser, an early depth tester, a renderer, a late depth tester, and a depth test data buffer that stores depth data values for use by the early and late depth testers. When a fragment is to undergo an early depth test to update the depth buffer, it is first determined whether the fragment should undergo the early depth test to update the depth buffer without waiting for any other fragment to undergo a depth test, or whether the result of a late depth test on a fragment that is still to undergo a late depth test should be awaited before performing a depth test to update the depth buffer on the fragment.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: July 6, 2021
    Assignee: Arm Limited
    Inventors: Toni Viki Brkic, Reimar Gisbert Doffinger, Jakob Axel Fries, Sven Uwe Deidersen
  • Patent number: 11050991
    Abstract: An apparatus comprises a store (201) storing images corresponding to different positions and viewing directions for a scene, and associated position parameter vectors for the images where the vector for an image comprises data indicative of a viewing position and a viewing direction. A receiver (205) receives a viewing position parameter vector from a remote client (101). A selector (207) selects a set of images in response to a comparison of the viewing position parameter vector and the associated position parameter vectors. An image synthesizer (209) generates an image from the set of images. A data generator (215) generates a reference position parameter vector for the synthesized image indicating a viewing position and direction for the synthesized image. An image encoder (211) encodes the synthesized image and an output generator (213) generates an output image signal comprising the encoded synthesized image and the reference position parameter vector.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: June 29, 2021
    Assignee: Koninklijke Philips N.V.
    Inventors: Christiaan Varekamp, Patrick Luc Els Vandewalle
  • Patent number: 11042990
    Abstract: Systems and techniques for automatic object replacement in an image include receiving an original image and a preferred image. The original image is automatically segmented into an original image foreground region and an original image object region. The preferred image is automatically segmented into a preferred image foreground region and a preferred image object region. A composite image is automatically composed by replacing the original image object region with the preferred image object region such that the composite image includes the original image foreground region and the preferred image object region. An attribute of the composite image is automatically adjusted.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: June 22, 2021
    Assignee: ADOBE INC.
    Inventors: I-Ming Pao, Sarah Aye Kong, Alan Lee Erickson, Kalyan Sunkavalli, Hyunghwan Byun
  • Patent number: 11030797
    Abstract: Systems and methods for processing primitive fragments in a rasterization phase of a graphics processing system wherein a rendering space is subdivided into a plurality of tiles. The method includes receiving a plurality of primitive fragments, each primitive fragment corresponding to a pixel sample in a tile; determining whether a depth buffer read is to be performed for hidden surface removal processing of one or more of the primitive fragments; sorting the primitive fragments into a priority queue and a non-priority queue based on the depth buffer read determinations; and performing hidden surface removal processing on the primitive fragments in the priority and non-priority queues wherein priority is given to the primitive fragments in the priority queue.
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: June 8, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Robert Brigg, Lorenzo Belli
  • Patent number: 11030783
    Abstract: A graphics processor that performs early depth tests for primitives in respect of patches of a render output, and depth tests for sampling positions of the render output, maintains a per patch depth buffer that stores depth values for patches for use by the patch early depth test and a per sample depth buffer. When processing of a render output is stopped before the render output is finished, the per sample depth values in the per sample depth buffer are written to storage so that those values can be restored, but the per patch depth value information in the per patch depth buffer is discarded. Then, when processing of the render output is resumed, the per sample depth buffer values are loaded into a per sample depth buffer, and the loaded per sample depth buffer values are also used to restore the per patch depth buffer.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: June 8, 2021
    Assignee: Arm Limited
    Inventors: Andreas Due Engh-Halstvedt, Alexander Eugene Chalfin, Frode Heggelund
  • Patent number: 11024077
    Abstract: A global illumination calculation method and apparatus is provided. The method includes: acquiring at least one of SDF information and illumination information corresponding to each of preselected pixels displayed on a screen, and the SDF information and illumination information corresponding to each pixel are stored in a two-dimensional map formed by mapping a three-dimensional map; and performing global illumination calculation according to at least one of the SDF information and the illumination information corresponding to each pixel. The method solves technical problems of global illumination calculation methods in the related art that a large amount of hardware resources are consumed and the presented image effects are not ideal enough.
    Type: Grant
    Filed: August 5, 2016
    Date of Patent: June 1, 2021
    Assignee: NETEASE (HANGZHOU) NETWORK CO., LTD.
    Inventor: Jiancong Huang
  • Patent number: 10987579
    Abstract: A graphics rendering system is disclosed for generating and streaming graphics data of a 3D environment from a server for rendering on a client in 2.5D. 2D textures can be transmitted in advance of frames showing the textures. Data transmitted for each frame can include 2D vertex positions of 2D meshes and depth data. The 2D vertex positions can be positions on a 2D projection as seen from a viewpoint within the 3D environment. Data for each frame can include changes to vertex positions and/or depth data. A prediction system can be used to predict when new objects will be displayed, and textures of those new objects can be transmitted in advance.
    Type: Grant
    Filed: March 28, 2018
    Date of Patent: April 27, 2021
    Assignee: ELECTRONIC ARTS INC.
    Inventors: Igor Borovikov, Mohsen Sardari
  • Patent number: 10936251
    Abstract: Methods, systems, and computer-readable storage media for a storage device to, upon receiving a command from a computing host, determine whether or not the command includes location information targeting a particular portion of a NVM of the storage device, the location information having been retrieved by the computing host from a shadow map and included with the command. Upon determining that the command includes location information, the command is processed by the storage device using the included location information. Upon determining that the command does not include location information, the storage device determines the particular portion of the NVM targeted by the command based on a map stored in a memory of the storage device before processing the command.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: March 2, 2021
    Assignee: Seagate Technology, LLC
    Inventors: Earl T. Cohen, Timothy L. Canepa
  • Patent number: 10922884
    Abstract: An electronic apparatus and method is provided for shape-refinement of a triangular 3D mesh using a modified Shape from Shading (SFS) scheme. The electronic apparatus generates a flat two-dimensional (2D) mesh based on an orthographic projection of an initial three-dimensional (3D) triangular mesh on an image plane that includes a plurality of square grid vertices. The electronic apparatus estimates a final grid depth value for each square grid vertex of the flat 2D mesh based on a modified SFS scheme. The modified SFS scheme corresponds to an objective relationship among a reference grid image intensity value, an initial grid depth value, and a grid albedo value for each square grid vertex of the plurality of square grid vertices. The electronic apparatus estimates a final 3D triangular mesh based on the initial 3D triangular mesh and the estimated final grid depth value.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: February 16, 2021
    Assignee: SONY CORPORATION
    Inventors: Jie Hu, Mohammad Gharavi-Alkhansari
  • Patent number: 10915773
    Abstract: A method is described that includes loading an array of content into a two-dimensional shift register. The two-dimensional shift register is coupled to an execution lane array. The method includes repeatedly performing a first sequence including: shifting with the shift register first content residing along a particular row or column into another parallel row or column where second content resides and performing operations with a particular corresponding row or column of the execution lane array on the first and second content. The method also includes repeatedly performing a second sequence including: shifting with the shift register content from a set of first locations along a resultant row or column that is parallel with the rows or columns of the first sequence into a corresponding set of second locations along the resultant row or column. The resultant row or column has values determined from the operations of the first sequence.
    Type: Grant
    Filed: May 16, 2017
    Date of Patent: February 9, 2021
    Assignee: Google LLC
    Inventors: Edward Chang, Daniel Frederic Finchelstein, Szepo Robert Hung, Albert Meixner, Ofer Shacham
  • Patent number: 10909946
    Abstract: A low power driving method includes receiving a signal for a sub control module from a main control module when an electronic device enters a low power mode. The low power driving method also includes transmitting display data to a display driving module in response to the signal.
    Type: Grant
    Filed: March 19, 2019
    Date of Patent: February 2, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Byeng Sang Jung
  • Patent number: 10888291
    Abstract: A breast imaging device for rotating a radiation detection unit configured to detect radiation irradiated from a radiation generation unit configured to generate the radiation with the radiation detection unit and the radiation generation unit facing each other includes a ray sum image generation unit configured to generate a ray sum image based on an addition value of at least one pixel value in a visual line direction from volume data reconstructed from a projection image output from the radiation detection unit, a maximum intensity projection image generation unit configured to generate a maximum intensity projection image based on the maximum pixel value in the visual line direction from the volume data, and a synthesizing unit configured to synthesize the ray sum image and the maximum intensity projection image.
    Type: Grant
    Filed: August 30, 2018
    Date of Patent: January 12, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tetsuo Shimada, Osamu Tsujii
  • Patent number: 10878626
    Abstract: A graphics processing system comprising: a tiling unit configured to tile a first view of a scene into a plurality of tiles; a processing unit configured to identify a first subset of the tiles that are associated with regions of the scene that are viewable in a second view; and a rendering unit configured to render to a render target each of the identified tiles.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: December 29, 2020
    Assignee: Imagination Technologies Limited
    Inventors: Simon Fenney, Michael Worcester, Stuart Smith
  • Patent number: 10871994
    Abstract: An information processing device includes a data input unit that receives time-series data from an external device, a first processing unit that adds time information to data acquired from the data input unit and processes data to which the time information has been added, on a real-time operating system that performs a process within a specified time period, and a second processing unit that processes data to which the time information has been added, on a non-real-time operating system.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: December 22, 2020
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Osamu Nasu
  • Patent number: 10867444
    Abstract: This application relates generally to augmenting images and videos with dynamic object compositing, and more specifically, to generating synthetic training data to train a machine learning model to automatically augment an image or video with a dynamic object. The synthetic training data may contain multiple data points from thousands of simulated dynamic object movements within a virtual environment. Based on the synthetic training data, the machine learning model may determine the movement of a new dynamic object within new virtual environment.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: December 15, 2020
    Assignee: Adobe Inc.
    Inventors: Bryan Russell, Daniel Kaufman, Carlo Innamorati, Niloy Mitra
  • Patent number: 10864439
    Abstract: A social game capable of adding or improving unexpectedness, dramatic impact, and taste when a reward is provided to a player, and hence capable of raising the player's motivation to participate in or continue the game. A unit for storing information related to a game in which multiple players can participate stores a reward providing condition, rewards, and reward box information, and a control unit for accessing information related to the game, performing computation on the game, and displaying images of the game on terminal devices operated by players allocates at least one reward out of the rewards to the reward box, determines whether the reward providing condition is met based on match-up situations or match-up results between players and first game characters in the game, and displays, on the terminal devices, a screen for providing the reward to players based on the determination results.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: December 15, 2020
    Assignee: GREE, Inc.
    Inventor: Naomichi Youda
  • Patent number: 10861136
    Abstract: An image processing apparatus includes a setting unit configured to set a virtual light source for a captured image; a brightness correction unit configured to correct brightness of a partial region of an object using the virtual light source set by the setting unit; an attribute detection unit configured to detect an attribute of the partial region; a glossy component generation unit configured to generate a glossy component that is to be applied to the partial region, according to the attribute of the partial region detected by the attribute detection unit; and a glossy appearance correction unit configured to correct a glossy appearance of the partial region using the glossy component generated by the glossy component generation unit.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: December 8, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kaori Tajima
  • Patent number: 10825350
    Abstract: A virtual reality (VR) based driving simulation system and method provides hazard perception training and testing. Some embodiments use a personal computing device (e.g., smartphone), a head-mounted VR headset, and a Bluetooth-connected push button keypad or other user input device. An immersive, 3D simulator enables users to experience and learn from hazardous scenarios without risking injury. Performance by a user in perceiving a hazard is compiled as a metric in a user profile stored on a server, and continued training and testing can be conducted with updated scenarios supplied by the server in accordance with the metric associated with a user.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: November 3, 2020
    Assignee: Wichita State University
    Inventor: Rui Ni
  • Patent number: 10818098
    Abstract: According one embodiment, there is provided a drawing method, that comprises: when at least part of a first surface and at least part of a second surface are practically congruent to each other in a three-dimensional coordinate system, assigning each of a first drawing pattern related to the first surface and a second drawing pattern related to the second surface to any one of more than one unit drawing area forming the at least part of the first surface or the at least part of the second surface, drawing the more than one unit drawing area by using the first drawing pattern and the second drawing pattern each assigned to any one of the more than one unit drawing area, and thereby drawing the at least part of the first surface or the second surface.
    Type: Grant
    Filed: January 17, 2018
    Date of Patent: October 27, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Hirokazu Tanaka