Lighting/shading Patents (Class 345/426)
  • Patent number: 10685498
    Abstract: Methods for rendering augmented reality (AR) content are presented. An a priori defined 3D albedo model of an object is leveraged to adjust AR content so that is appears as a natural part of a scene. Disclosed devices recognize a known object having a corresponding albedo model. The devices compare the observed object to the known albedo model to determine a content transformation referred to as an estimated shading (environmental shading) model. The transformation is then applied to the AR content to generate adjusted content, which is then rendered and presented for consumption by a user.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: June 16, 2020
    Assignee: Nant Holdings IP, LLC
    Inventors: Matheen Siddiqui, Kamil Wnuk
  • Patent number: 10685474
    Abstract: The present invention provides a method for repairing incomplete 3D depth image using 2D image information. The method includes the following steps: obtaining 2D image information and 3D depth image information; dividing 2D image information into 2D reconstruction blocks and 2D reconstruction boundaries, and corresponding to 3D reconstruction of blocks and 3D reconstruction boundaries; analyzing each 3D reconstruction block, partitioning into residual-surface blocks and repaired blocks; and proceeding at least one 3D image reconstruction, which extends with the initial depth value of the 3D depth image of each of the residual-surface block and covers all the corresponding repaired block to form a repair block and to achieve the purpose of repairing incomplete 3D depth images using 2D image information.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: June 16, 2020
    Assignee: NATIONAL CENTRAL UNIVERSITY
    Inventors: Yeh-Wei Yu, Chi-Chung Lau, Ching-Cherng Sun, Tsung-Hsun Yang, Tzu-Kai Wang, Jia-Ching Wang, Chien-Yao Wang, Kuan-Chung Wang
  • Patent number: 10679405
    Abstract: Rendering systems that can use combinations of rasterization rendering processes and ray tracing rendering processes are disclosed. In some implementations, these systems perform a rasterization pass to identify visible surfaces of pixels in an image. Some implementations may begin shading processes for visible surfaces, before the geometry is entirely processed, in which rays are emitted. Rays can be culled at various points during processing, based on determining whether the surface from which the ray was emitted is still visible. Rendering systems may implement rendering effects as disclosed.
    Type: Grant
    Filed: August 21, 2018
    Date of Patent: June 9, 2020
    Assignee: Imagination Technologies Limited
    Inventors: Jens Fursund, Luke T. Peterson
  • Patent number: 10679316
    Abstract: Systems, apparatuses, and methods for implementing a single pass stipple pattern generation process are disclosed. A processor initiates parallel execution of a first and second plurality of wavefronts. A first wavefront of the first plurality of wavefronts converts a first local coordinate into a first global coordinate, wherein the first local coordinate corresponds to a first portion of a primitive. Also, a first wavefront of the second plurality of wavefronts applies a first attribute to the first global coordinate prior to a second wavefront, of the first plurality of wavefronts, converting a second local coordinate of a second portion of the primitive into a second global coordinate. The second plurality of wavefronts generate image data based on applying the first attribute to global coordinates generated by the first plurality of wavefronts, and the image data is conveyed for display on a display device.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: June 9, 2020
    Assignee: Advanced Micro Devices, Inc.
    Inventor: Sean M. O'Connell
  • Patent number: 10672177
    Abstract: A graphics processing system performs a final gather process so as to generate final gather lighting data for a scene. The final gather process comprises casting sampling rays from a final gather point within the scene. Radiosity data provided for the scene is sampled using the sampling rays cast from the final gather point. Final gather lighting data is then generated from the sampled radiosity data. The sampling rays are cast from the final gather point in an informed manner based on directional irradiance data provided for the scene. The final gather process can therefore be carried out by the graphics processing system more efficiently and effectively.
    Type: Grant
    Filed: October 18, 2016
    Date of Patent: June 2, 2020
    Assignee: Arm Limiteed
    Inventors: Michel Patrick Gabriel Emil Iwaniec, Matthew James Bentham, Roland Kuck, Derek Andrew Lamberti
  • Patent number: 10671611
    Abstract: A first quicksort is performed in parallel across pairs of partitions of a dataset assigned to respective ones of available processors, including swapping elements of a first partition of a given one of the pairs that are larger than a pivot with elements of a second partition of the given pair that are smaller than the pivot. A second quicksort is performed in parallel across those partitions having elements left unsorted by the first quicksort, and first misplaced elements from a first side of the dataset corresponding to the first partition are swapped with second misplaced elements from a second side of the dataset corresponding to the second partition to produce a first dataset having elements equal to or lower than the pivot and a second dataset having elements equal to or higher than the pivot.
    Type: Grant
    Filed: August 21, 2018
    Date of Patent: June 2, 2020
    Assignee: International Business Machines Corporation
    Inventors: Daniel Brand, Minsik Cho, Ruchir Puri
  • Patent number: 10672178
    Abstract: Circuitry for identifying a closest intersected bounding volume in a target grid in a 3-dimensional scene includes circuitry that generates grid coordinates of candidate x-, y-, and z-planes in the target grid that belong to bounding volumes and which are closest to the ray. Comparator circuitry determines the closest plane among the candidate x-, y-, and z-planes to the ray. Circuitry generates an identifier of the bounding volume using the grid coordinates of the closest plane. The allocation of resources for some components comprising the circuitry is based on the number of planes that define the target grid, and for other components of the circuitry is based on the number of bounding volumes being considered.
    Type: Grant
    Filed: August 8, 2018
    Date of Patent: June 2, 2020
    Inventor: Alvin D. Zimmerman
  • Patent number: 10672185
    Abstract: One aspect of the disclosure provides a method for rendering an image. The method includes: placing primitives of the image in a screen space; binning the primitives into tiles of the screen space that the primitives touch; and rasterizing the tiles at one tile of the tiles at a time. The aforementioned rasterizing includes shading a subset of the primitives binned to the one tile at a first shading rate during a first pass and shading the subset of primitives binned to the one tile at a second shading rate during a second pass, the second shading rate is different from the first shading rate, and the aforementioned placing is performed once while the image is rendered.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: June 2, 2020
    Assignee: Nvidia Corporation
    Inventor: Rahul Sathe
  • Patent number: 10657698
    Abstract: A computing system configured to execute instructions for a first graphical processing unit (GPU) on a second GPU is provided. The computing system may include the second GPU and a processor. The processor may be configured to receive second GPU state data that indicates one or more global properties of the second GPU. The processor may be further configured to receive one or more binary instructions for texture operation configured to be executed on the first GPU. Based on the second GPU state data, the processor may be further configured to apply a texture value patch to the one or more binary instructions. Applying the texture value patch may translate the one or more binary instructions into one or more translated binary instructions configured to be executed on the second GPU.
    Type: Grant
    Filed: January 5, 2018
    Date of Patent: May 19, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Aaron Blake Stover, Matthew Gordon, Eric David Heutchy, Ke Deng, Warren Lee Burch, Roger John Perkins
  • Patent number: 10657724
    Abstract: A method and apparatus for detecting a main lighting direction from the input image, which corresponds to a key light. The system is operative to nm on data-parallel architectures allows for incoming light direction estimation in real-time. More particularly, the method and apparatus detect a key, or principal light direction relative to the position/orientation of an acquisition device. It method involves image analysis to find a maximum intensity value, maximal values filtering, and conversion of the input image position to a direction in space.
    Type: Grant
    Filed: December 20, 2016
    Date of Patent: May 19, 2020
    Assignee: THOMSON Licensing
    Inventors: Gael Sourimant, Eric Hubert, Jean-Eudes Marvie
  • Patent number: 10649521
    Abstract: When the speed of head movement exceeds the processing capability of the system, a reduced depiction is displayed. As one example, the resolution may be reduced using coarse pixel shading in order to create a new depiction at the speed of head movement. In accordance with another embodiment, only the region the user is looking at is processed in full resolution and the remainder of the depiction is processed at lower resolution. In still another embodiment, the background depictions may be blurred or grayed out to reduce processing time.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: May 12, 2020
    Assignee: Intel Corporation
    Inventors: Ravindra A. Babu, Sashank Sms Ms, Satyanantha R. Musunuri, Sagar C. Pawar, Kalyan K. Kaipa, Vijayakumar Balakrishnan, Sameer Kp
  • Patent number: 10649524
    Abstract: One embodiment of a virtual reality apparatus comprises: a graphics processing engine comprising a plurality of graphics processing stages, the graphics processing engine to render a plurality of image frames for left and right displays of a head mounted display (HMD); and foveation control hardware logic to independently control two or more of the plurality of graphics processing stages based on feedback received from an eye tracking module of the HMD, the feedback indicating a foveated region selected based on a current or anticipated direction of a user's gaze, the foveation control hardware logic to cause the two or more of the graphics processing stages to process the foveated region differently than other regions of the image frames.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: May 12, 2020
    Assignee: Intel Corporation
    Inventors: Ingo Wald, Brent E. Insko, Prasoonkumar Surti, Adam T. Lake, Peter L. Doyle, Daniel Pohl
  • Patent number: 10649789
    Abstract: Techniques and computing devices related to modifying images are provided. A computing device can receive an order to modify pixels of an image. The computing device can include at least a pixel processor and software snippets that are executable on the pixel processor. The computing device can determine parameter values based on the order. The computing device can select a set of software snippets from the software snippets based on the parameter values. The computing device can load the set of software snippets onto the pixel processor. The pixel processor can execute the loaded set of software snippets to modify the pixels. The computing device can generate an output that includes a depiction of the image that includes at least one of the modified pixels.
    Type: Grant
    Filed: July 23, 2018
    Date of Patent: May 12, 2020
    Assignee: KYOCERA DOCUMENT SOLUTIONS INC.
    Inventors: Dongpei Su, Thien-Phuc Nguyen Do, Alex Horvath, Kenneth A. Schmidt, Masayoshi Nakamura
  • Patent number: 10643376
    Abstract: A computer-implemented image processing method, system, and computer program product for representation of static objects in a digital target image including a plurality of target pixels. The method includes at least receiving a plurality of digital source images of the static objects, computing diffuse components for target pixels of surface elements by computing for each target pixel of the surface elements a set of diffuse reflection coefficients from a best-fit function when fitted into reflected light intensity values of corresponding source pixels of the source images under different illumination angles, generating normal vectors for the target pixels by using the computed diffuse reflection coefficients, and determining glossy coefficients for the target pixels of the one or more surface elements as the distances between the corresponding best-fit function values and the reflected light intensity values of the corresponding source pixels for the different illumination angles.
    Type: Grant
    Filed: November 14, 2018
    Date of Patent: May 5, 2020
    Assignee: Universität Basel
    Inventors: Andrea Bianco, Peter Fornaro
  • Patent number: 10645366
    Abstract: Described are image and video processing systems and methods for auto re-calibration of stereo camera devices. The auto re-calibration processes described herein transform image data into re-calibration data used to correct calibration errors in real time. The auto re-calibration processes leverage position data shifting, image data filtering, and disparity analysis to generate one or more calibration profiles that track the position of the camera modules included in stereo camera devices. Calibration profiles are then used to generate pixel shift parameters describing how to modify the position of image pixels and or camera modules to improve rectification and projection of 3D images and video frames. Additionally multi-camera systems implementing the auto re-calibration processes are disclosed.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: May 5, 2020
    Inventors: Adam Rowell, Sheldon Fernandes, Han Jin
  • Patent number: 10636201
    Abstract: Systems, methods, and articles of manufacture for real-time rendering using compressed animated light fields are disclosed. One embodiment provides a pipeline, from offline rendering of an animated scene from sparse optimized viewpoints to real-time rendering of the scene with freedom of movement, that includes three stages: offline preparation and rendering, stream compression, and real-time decompression and reconstruction. During offline rendering, optimal placements for cameras in the scene are determined, and color and depth images are rendered using such cameras. Color and depth data is then compressed using an integrated spatial and temporal scheme permitting high performance on graphics processing units for virtual reality applications.
    Type: Grant
    Filed: May 4, 2018
    Date of Patent: April 28, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Kenneth J. Mitchell, Charalampos Koniaris, Malgorzata E. Kosek, David A. Sinclair
  • Patent number: 10628776
    Abstract: A method and a system for calculating a productivity of an industrial system consisting of system modules is provided. A Markov model is stored for each system module, the Markov model indicating the probabilities that a system module is in different operating states and indicating transition rates of state changes between the operating states of the respective system module for each operating state of the respective system module with a different productivity. A Cartesian product is calculated from a first Markov model of a first system module and from a second Markov model of a second system module linked to the first system module. The calculated Cartesian product is then reduced to a Markov model of the combined sub-system. The calculation of the Cartesian product and the subsequent reduction are carried out successively until the combined sub-system forms the entire industrial system.
    Type: Grant
    Filed: June 27, 2014
    Date of Patent: April 21, 2020
    Assignee: SIEMENS AKTIENGESELLSCHAFT
    Inventor: Francesco Montrone
  • Patent number: 10628995
    Abstract: Techniques are disclosed for producing an anti-aliasing effect in the rendering of graphical elements defined based on one or more mathematical functions. In various embodiments an example method may include defining a shape based on one or more functions. A view of the shape is then rendered which includes generating a plurality of fragments corresponding to pixels in a display device through which the view will be displayed. Transparency values are set for fragments corresponding to a boundary of the shape based on the one or more functions defining the shape. The transparency values set for the fragments corresponding to the boundary of the shape result in an anti-aliasing effect when the view of the shape is displayed via the display device.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: April 21, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Tong Chen, Karim Audrey Luccin, Morien Thomas
  • Patent number: 10628992
    Abstract: Systems can identify visible surfaces for pixels in an image (portion) to be rendered. A sampling pattern of ray directions is applied to the pixels, so that the sampling pattern of ray directions repeats, and with respect to any pixel, the same ray direction can be found in the same relative position, with respect to that pixel, as for other pixels. Rays are emitted from visible surfaces in the respective ray direction supplied from the sampling pattern. Ray intersections can cause shaders to execute and contribute results to a sample buffer. With respect to shading of a given pixel, ray results from a selected subset of the pixels are used; the subset is selected by identifying a set of pixels, collectively from which rays were traced for the ray directions in the pattern, and requiring that surfaces from which rays were traced for those pixels satisfy a similarity criteria.
    Type: Grant
    Filed: January 24, 2019
    Date of Patent: April 21, 2020
    Assignee: Imagination Technologies Limited
    Inventors: Gareth Morgan, Luke T. Peterson
  • Patent number: 10621778
    Abstract: A method of generating dynamic user interface effects may include receiving positioning data indicative of a location of the user interface and receiving orientation data indicative of an orientation of the user interface. The method may also include determining a location of a light source relative to the user interface based on the positioning data and the orientation data, and modifying an image on the user interface based on the location of the light source.
    Type: Grant
    Filed: October 28, 2016
    Date of Patent: April 14, 2020
    Assignee: FARADAY & FUTURE INC.
    Inventor: Nicholas William Dazé
  • Patent number: 10621740
    Abstract: A 3D modeling method based on point cloud data for generating 3D object data corresponding to target object (50, 51) includes activating a 3D scanner (2) to obtain 2D images of the target object (50, 51) from different angles and a plurality of depths of the target object (50, 51); generating a plurality of point cloud data (60-64) based on the 2D images and the depths; performing a pre-modeling process on the plural point cloud data (60-64) to filter the plural point data (70-79) not belonging to the target object (50, 51) out of each point cloud data (60-64); and performing a 3D modeling process on the filtered point cloud data (60-64) to generate the 3D object data. The 3D object data generated by the present disclosed example via execution of the pre-modeling process has minimum noise and is appropriate for 3D print.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: April 14, 2020
    Assignees: XYZPRINTING, INC., KINPO ELECTRONICS, INC.
    Inventor: Wei-Ting Chen
  • Patent number: 10614619
    Abstract: In a graphics processing system, a bounding volume (20) representative of the volume of all or part of a scene to be rendered is defined. Then, when rendering an at least partially transparent object (21) that is within the bounding volume (20) in the scene, a rendering pass for part or all of the object (21) is performed in which the object (21) is rendered as if it were an opaque object.
    Type: Grant
    Filed: February 26, 2016
    Date of Patent: April 7, 2020
    Assignee: Arm Limited
    Inventors: Roberto Lopez Mendez, Sylwester Krzysztof Bala, Samuel Paul Laynton
  • Patent number: 10609438
    Abstract: A method (and structure) includes forming a wireless ad hoc network with a plurality of sensors at a first location, the ad hoc network being a localized, decentralized network wherein each participating sensor has an equal status on the network for performing network functions and is free to associate with any other ad hoc network device in a link range of a vicinity of the first location. Data is transmitted from the plurality of sensors via the ad hoc network, for consumption by an at-home user located at a second location different from said first location. Each sensor indicates a location and a directivity of sensing in the vicinity of the first location, so that the plurality of sensors thereby can provide data sufficient for the at-home user to be immersed in an experience at the first location.
    Type: Grant
    Filed: August 13, 2015
    Date of Patent: March 31, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Joel W. Branch, Shang Qing Guo, Jonathan Lenchner, Maharaj Mukherjee
  • Patent number: 10607403
    Abstract: Systems and methods for generating shadows for inserted content are provided. The inserted content may include augmented reality content that is inserted into an image of a physical space. An example method may include determining a location within an image to insert content. For example, the content may include skeletal joints from a skeletal animation system. The example method may further include generating a bounding box on a surface plane based on the skeletal joints and determining a shadow center point location on the surface plane based on the skeletal joints. For example, the surface plane may be identified based on the image. The example method may also include generating a shadow entity on the surface plane based on the bounding box and the shadow center point location and rendering the shadow entity using pixel values determined at least in part based on the shadow center point location.
    Type: Grant
    Filed: October 3, 2018
    Date of Patent: March 31, 2020
    Assignee: GOOGLE LLC
    Inventor: Ivan Neulander
  • Patent number: 10607390
    Abstract: A device driver is configured to identify a group of compute shaders to be executed in multiple traversals of a graphics processing pipeline. Each such compute shader accesses a compute tile of data having particular dimensions. The device driver interoperates with a tiling unit to determines dimension for a cache tile so that an integer multiple of each compute tile will fit evenly within the cache tile. Thus, when executing compute shaders in different traversals of the graphics processing pipeline, the data processed by those compute shaders can be cached in the cache tile between passes.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: March 31, 2020
    Assignee: NVIDIA Corporation
    Inventor: Jeffrey A. Bolz
  • Patent number: 10595824
    Abstract: Disclosed herein is an image processing apparatus. The image processing apparatus collects volume data which relates to an object, generates volume-rendered image data from the collected volume data, acquires a projection image of the object at a position at which virtual illumination is emitted toward the object, based on the volume-rendered image data, and corrects the projection image by using at least one conversion function, thereby obtaining a result image.
    Type: Grant
    Filed: March 27, 2018
    Date of Patent: March 24, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Yun Tae Kim
  • Patent number: 10600232
    Abstract: A texture level of detail (LOD) approximation may be performed utilizing ray differentials and a G-buffer. For example, a scene to be rendered is identified, and a G-buffer of the scene is rendered. Additionally, ray tracing is started for the scene, and during the ray tracing, a ray differential is created by accessing the G-buffer. Further, the created ray differential is appended to a current ray, and the created ray differential is traced.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: March 24, 2020
    Assignee: NVIDIA CORPORATION
    Inventors: Tomas Akenine-Moller, Robert Toth, Magnus Andersson, Jim Kjell David Nilsson
  • Patent number: 10593026
    Abstract: An apparatus includes a first acquisition unit configured to, with a viewpoint set to a position of an object, acquire a plurality of environment maps for each position of light sources, the environment maps being obtained by imaging a surrounding environment from the viewpoint, a second acquisition unit configured to acquire a plurality of captured images for each position of the light sources, the captured images being obtained by imaging from a plurality of directions the object irradiated with light by the light sources, and a determination unit configured to determine reflection characteristics of the object based on the environment maps and the plurality of captured images.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: March 17, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Manabu Ohga
  • Patent number: 10585278
    Abstract: A method of generating a surface model of a physical environment includes obtaining an image of the physical environment. The method also includes generating a planar polygon mesh from at least the image. The method further includes extracting a boundary polygon of the planar polygon mesh. Moreover, the method includes generating a convex hull for the boundary polygon of the surface mesh. In addition, the method includes generating a minimal area oriented boundary polygon from the convex hull. The method may also include generating a maximal area oriented internal polygon inside of the boundary polygon of the planar polygon mesh.
    Type: Grant
    Filed: October 5, 2017
    Date of Patent: March 10, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Victor Ng-Thow-Hing
  • Patent number: 10580195
    Abstract: Various approaches to performing ray-triangle intersection tests for single triangles or clusters of triangles are presented. In some example implementations, the triangles are organized in tetrahedral clusters, and the ray-triangle intersection tests use plane data for sets of planes of the tetrahedral clusters. A triangle can be represented as three bounding planes. Further, in some example implementations, the same three bounding planes of a tetrahedral cluster can be used to represent one, two, or three triangles that define faces of that tetrahedral cluster. With this configuration, overall memory costs are reduced when the same plane data is used to represent multiple triangles, and operations to check for ray-triangle intersections are still computationally efficient.
    Type: Grant
    Filed: November 20, 2017
    Date of Patent: March 3, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: James D. Stanard
  • Patent number: 10580106
    Abstract: A method of rendering a frame on a display device can include the steps of loading a predefined render chunk, wherein said render chunk includes a render primitive for each object to be rendered in the frame, and wherein each render primitive includes a render element for each aspect of the object to be rendered in the frame, and wherein each render element includes assets to be used in rendering that aspect of the object, compiling a render set for each type of aspect to be rendered in the frame, wherein each render set includes all of the render elements from the render chunk which relate to that type of aspect to be rendered, executing a predefined render pipeline including a render routine for each type of aspect to be rendered, wherein the render sets are drawn on by the render routines during execution of the render pipeline, and displaying a rendered frame on the display device from the output of the executed render pipeline.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: March 3, 2020
    Assignee: BASEMARK OY
    Inventors: Teemu Virolainen, Mikko Alaluusua
  • Patent number: 10580210
    Abstract: A method for refocusing, on at least one common point of interest, the rendering of one set of plenoptic video data provided by one plenoptic device belonging to a set of plenoptic devices capturing simultaneously a same scene. According to the present disclosure, said method comprises: obtaining (21) a common 3D reference system used for spatially locating said plenoptic device that has provided said set of plenoptic video data and at least one other device of said set of plenoptic devices, from said at least one common point of interest, determining (22) common refocusing plane parameters in said common 3D reference system, refocusing (23) the rendering of said set of plenoptic video data by converting (231) said common refocusing plane parameters into a rendering refocusing plane of a 3D reference system associated with said plenoptic device.
    Type: Grant
    Filed: December 8, 2016
    Date of Patent: March 3, 2020
    Assignee: INTERDIGITAL CE PATENT HOLDINGS
    Inventors: Pierre Hellier, Valerie Allie, Patrick Perez
  • Patent number: 10582190
    Abstract: A virtual training system includes a 3D scanner in recording space and a camera. A scan of the recording space are received and combined to make a sequence of models of the recording space while a tasks is being performed. The model states are presented in sequence to a trainee in a playback space and the actions of the trainee are detected. Deviation of the trainee or objects in the playback space from the trainer and objects in the recording space may be detected and alerts generated. Scanning of the recording space may be accelerated by making a full scan followed by partial scans. The partial scans may be performed in response to detected movement.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: March 3, 2020
    Assignee: Walmart Apollo, LLC
    Inventors: Donald High, John Paul Thompson, David Winkle, Robert C. Taylor
  • Patent number: 10580201
    Abstract: An apparatus and method for sampling pattern generation in a ray tracing architecture. For example, one embodiment of a graphics processing apparatus comprises: a ray generation circuit to generate a ray stream from one or more image tiles; and a sample pattern generation circuit to generate samples for rays in the ray stream, the samples generated to exhibit at least some randomness across pixels of a given frame but be repeatable across multiple frames.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: March 3, 2020
    Assignee: Intel Corporation
    Inventor: David R. Baldwin
  • Patent number: 10580367
    Abstract: Methods for mapping an image from one dynamic range to another dynamic range are presented. The mapping is based on a sigmoid-like function determined by three anchor points. The first anchor point is determined using the black point levels of a reference and a target display, the second anchor point is determined using the white point levels of the reference and target displays, and the third anchor point is determined using mid-tones information data for the input image and the mid-tones level of the target display. The mid-tones level of the target display is computed adaptively based on a desired range of constant brightness and a mapping function. The mapping function mapping may be piece-wise linear (in the log domain), piece-wise continuous, or a sigmoid. Examples for mapping high dynamic range images to standard dynamic range displays are presented.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: March 3, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Stephen D. Vernon, Robin Atkins
  • Patent number: 10580193
    Abstract: A graphics processing method and apparatus includes determining locations of primitives in a 3-dimensional (3D) space from graphics data for the 3D space in a memory, determining sizes of the primitives, generating Morton codes comprising a piece of information indicating the locations of the primitives and a piece of information indicating the sizes of the primitives, classifying the primitives into bounding boxes using the piece of information indicating the sizes of the primitives, and generating the acceleration structure indicating an inclusion relationship between the bounding boxes.
    Type: Grant
    Filed: January 11, 2017
    Date of Patent: March 3, 2020
    Assignees: SAMSUNG ELECTRONICS CO., LTD., CZECH TECHNICAL UNIVERSITY FACULTY OF ELECTRICAL ENGINEERING
    Inventors: Vlastimil Havran, Marek Vinkler, Jiri Bittner, Wonjong Lee
  • Patent number: 10573066
    Abstract: Systems, apparatuses and methods may provide away to render edges of an object defined by multiple tessellation triangles. More particularly, systems, apparatuses and methods may provide a way to perform anti-aliasing at the edges of the object based on a coarse pixel rate, where the coarse pixels may be based on a coarse Z value indicate a resolution or granularity of detail of the coarse pixel. The systems, apparatuses and methods may use a shader dispatch engine to dispatch raster rules to a pixel shader to direct the pixel shader to include, in a tile and/or tessellation triangle, one more finer coarse pixels based on a percent of coverage provided by a finer coarse pixel of a tessellation triangle at or along the edge of the object.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: February 25, 2020
    Assignee: Intel Corporation
    Inventors: Prasoonkumar Surti, Karthik Vaidyanathan, Murali Ramadoss, Michael Apodaca, Abhishek Venkatesh, Joydeep Ray, Abhishek R. Appu
  • Patent number: 10573078
    Abstract: Disclosed is an improved approach for generated recordings from augmented reality systems from the perspective of a camera within the system. Instead of re-using rendered virtual content from the perspective of the user's eyes for AR recordings, additional virtual content is rendered from an additional perspective specifically for the AR recording. That additional virtual content is combined with image frames generated by a camera to form the AR recording.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: February 25, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Reza Nourai, Michael Harold Liebenow, Robert Blake Taylor, Robert Wyatt
  • Patent number: 10568557
    Abstract: Methods and systems for analyzing involuntary eye movements of a human subject are disclosed. The systems may include means for presenting to the human subject visual content, possibly a video footage, in which some visual stimulus with whom the human subject has some form of relationship on a cognitive or sentiment level is embedded. The generation of the combined video footage is such that the stimulus is briefly presented and masked by the following video footage. The duration of the stimulus is made sufficiently long to invoke a neural response beyond a specified threshold that generates respective ocular effect, and sufficiently short to prevent a controlled eye movement by the human subject. Once measured, the involuntary eye movements are analyzed in view of the respective stimulating portions—e.g., their timing and context, to yield an analysis of the human subject relationship towards the objects presented in the visual stimulating portions.
    Type: Grant
    Filed: February 19, 2018
    Date of Patent: February 25, 2020
    Inventors: Yoram Bonneh, Gal Rosenzweig
  • Patent number: 10561309
    Abstract: An otoscope may project a temporal sequence of phase-shifted fringe patterns onto an eardrum, while a camera in the otoscope captures images. A computer may calculate a global component of these images. Based on this global component, the computer may output an image of the middle ear and eardrum. This image may show middle ear structures, such as the stapes and incus. Thus, the otoscope may “see through” the eardrum to visualize the middle ear. The otoscope may project another temporal sequence of phase-shifted fringe patterns onto the eardrum, while the camera captures additional images. The computer may subtract a fraction of the global component from each of these additional images. Based on the resulting direct-component images, the computer may calculate a 3D map of the eardrum.
    Type: Grant
    Filed: December 20, 2017
    Date of Patent: February 18, 2020
    Assignee: Massachusetts Institute of Technology
    Inventors: Anshuman Das, Ramesh Raskar
  • Patent number: 10559112
    Abstract: A mechanism is described for facilitating hybrid rendering of graphics images in computing environments. A method of embodiments, as described herein, includes detecting the video stream including two-dimensional (2D) images, where the video stream is processed through a graphics pipeline at a computing device. The method may further include performing hybrid combination of a luma (Y)-plane with chrominance (UV)-planes to directly generate a YUV texture, wherein the YUV texture is used to generate three-dimensional (3D) images corresponding to the 2D images.
    Type: Grant
    Filed: June 10, 2016
    Date of Patent: February 11, 2020
    Assignee: INTEL CORPORATION
    Inventors: Tatiana Surazhsky, Uzi Sarel, Jacob Subag
  • Patent number: 10559115
    Abstract: Examples described herein generally relate to generating a visualization of an image. A proprietary structure that specifies ray tracing instructions for generating the image using ray tracing is intercepted from a graphics processing unit (GPU) or a graphics driver. The proprietary structure can be converted, based on assistance information, to a visualization structure for generating the visualization of the image. The visualization of the image can be generated from the visualization structure.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: February 11, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Austin Neil Kinross, Shawn Lee Hargreaves, Amar Patel, Thomas Lee Davidson
  • Patent number: 10559122
    Abstract: A system for, and method of, computing reduced-resolution indirect illumination using interpolated directional incoming radiance and a graphics processing subsystem incorporating the system or the method. In one embodiment, the system includes: (1) a cone tracing shader executable in a graphics processing unit to compute directional incoming radiance cones for sparse pixels and project the directional incoming radiance cones on a basis and (2) an interpolation shader executable in the graphics processing unit to compute outgoing radiance values for untraced pixels based on directional incoming radiance values for neighboring ones of the sparse pixels.
    Type: Grant
    Filed: January 28, 2014
    Date of Patent: February 11, 2020
    Assignee: Nvidia Corporation
    Inventors: Alexey Panteleev, Evgeny Makarov, Sergey Bolotov, Yury Uralsky
  • Patent number: 10553019
    Abstract: In some embodiments, a given frame or picture may have different shading rates. In one embodiment in some areas of the frame or picture the shading rate may be less than once per pixel and in other places it may be once per pixel. Examples where the shading rate may be reduced include areas where there is motion and camera defocus, areas of peripheral blur, and in general, any case where the visibility is reduced anyway. The shading rate may be changed in a region, such as a shading quad, by changing the size of the region.
    Type: Grant
    Filed: January 4, 2017
    Date of Patent: February 4, 2020
    Assignee: Intel Corporation
    Inventors: Karthik Vaidyanathan, Marco Salvi, Robert M. Toth
  • Patent number: 10553011
    Abstract: An image processing system includes first circuitry that controls display of an image of a space, and to render display data of the space on a first display and second circuitry that controls display, on a display surface of a second display, of an image of a material virtually applied to the space, and to render display data of the material. The second circuitry renders the display data of the material based on illumination information, material information including texture information of the material, and a relative positional relationship of a light fixture, the display surface, and a viewer, and controls display of the image of the material using the rendered display data of the material.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: February 4, 2020
    Assignee: TOPPAN PRINTING CO., LTD.
    Inventor: Takayuki Hasegawa
  • Patent number: 10546399
    Abstract: Examples described herein generally relate to rendering digital pencil ink on a display of a computer device. The computer device may render a frame via a graphics queue of a graphics processing unit (GPU). The computer device may fetch updated digital pencil ink input from an input buffer at a designated time before scanning at least a portion of the frame including the digital pencil ink. The computer device may determine a set of input stamps based on the updated digital pencil ink input, each input stamp being associated with stamp properties. A compute shader thread for each block within a portion of the frame may determine whether each of the input stamps intersects the block. At least one compute shader thread for each pixel of a respective block may determine a cumulative effect of each of the input stamps intersecting the respective block on the pixel based on the stamp properties.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: January 28, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Nicholas DeFay Feeney
  • Patent number: 10546422
    Abstract: Methods and systems for providing enhanced augmented reality features and enhancements are disclosed such as an AR support system (100) using lighting units (LU1) in a lighting system (100) to improve performance of augmented reality devices (20). The lighting system (100) may also take advantage of features of the augmented reality devices (20) to improve the safety and performance of the lighting system (100). The lighting units (LU1) include sensors and communication capabilities that detect situations as to when the augmented device would need to be assisted by the lighting network. Finally a method to provide assistance information to the augmented reality device while optimizing energy savings is also described.
    Type: Grant
    Filed: September 4, 2014
    Date of Patent: January 28, 2020
    Assignee: SIGNIFY HOLDING B.V.
    Inventors: Dzmitry Viktorovich Aliakseyeu, Talmai BrandÃO De Oliveira, Hongxin Chen, Philip Steven Newton, Dave Alberto Tavares Cavalcanti, Bartel Marinus Van De Sluis
  • Patent number: 10547713
    Abstract: A system and method for transmitting state based input over a network are presented. Embodiments of the present invention are operable to generate vector data comprising a composite of all state data associated with the state of all user input claims of a client system and transmit the vector data from the client device to a host device over a network. Embodiments of the present invention are further operable at the host device to determine a simulated input state at the client side by performing a comparison of the vector data currently received to a last known vector data and rendering output in response to the comparison.
    Type: Grant
    Filed: November 20, 2012
    Date of Patent: January 28, 2020
    Assignee: NVIDIA CORPORATION
    Inventors: Aleksandar Odorovic, Andrija Bosnjakovic
  • Patent number: 10545999
    Abstract: Disclosed herein is a system and method for generating an enhanced index for documents contained in a knowledge base. Documents or configuration snapshots are tokenized and then passed through a number of filters. The filters modify the token stream to generate an enhanced token stream for the document by removing words from the stream and adding domain level knowledge to the tokens in the stream. The token stream is then added to the index for the document so that searches can be completed against the knowledge base when searches are generated from configuration snapshots or from inputted search queries.
    Type: Grant
    Filed: June 5, 2017
    Date of Patent: January 28, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Navendu Jain, Luhui Hu, Liyuan Zhang, Rahul Potharaju, Vitaly Voloshin, Mingshi Wang, Joseph K. W. Chan
  • Patent number: 10546429
    Abstract: An augmented reality (AR) mirror system is described. In an example, the AR mirror system includes a sensor, a display device, a semi-reflecting surface, a processing system, and computer-readable storage media having instructions stored thereon. The instructions are executable by the processing system to cause display of augmented reality (AR) digital content by the display device to be simultaneously viewable with a reflection of a physical object.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: January 28, 2020
    Assignee: Adobe Inc.
    Inventors: Tenell Glen Rhodes, Jr., Jose Ignacio Echevarria Vallespi, Gavin Stuart Peter Miller