Lighting/shading Patents (Class 345/426)
  • Patent number: 10096088
    Abstract: The disclosure provides an approach for denoising (also referred to as “filtering”) rendered images. In one embodiment, a denoising application takes as input rendered images and feature buffers that encode image information such as surface positions, surface depths, surface normals, surface albedos, and distances to the camera. For each pixel in a received image, the denoising application performs a first-order regression in a predefined neighborhood of the pixel to find a linear combination of pixel features that fits pixel colors in the predefined neighborhood. In such a first-order regression, the local regression weight of each pixel in the neighborhood may be determined using a metric which computes distances based on color values in patches around pixels being compared. In another embodiment, collaborative filtering may be performed in which filtered output from the first-order regression in each neighborhood is averaged with filtered output from overlapping neighborhoods to obtain a final output.
    Type: Grant
    Filed: September 28, 2016
    Date of Patent: October 9, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Benedikt Martin Bitterli, Jan Novák, Fabrice Pierre Armand Rousselle
  • Patent number: 10096296
    Abstract: A method and system for determining a first local time of day for a user device, and determining a first value of a visual aspect of a drop shadow associated with an application window on the display based on of the first local time of day. The drop shadow is displayed in view of the first value, wherein the drop shadow provides a visual appearance that the application window is above a background. A second local time is determined, and a second value of the visual aspect of the drop shadow is determined, wherein the second value is in view of the second local time. The drop shadow is displayed in view of the second value of the aspect such that the drop shadow has a different visual appearance from the first local time to the second local time.
    Type: Grant
    Filed: November 13, 2013
    Date of Patent: October 9, 2018
    Assignee: Red Hat, Inc.
    Inventor: Ray Strode
  • Patent number: 10097799
    Abstract: An image sensor device may include an array of image sensing pixels with adjacent image sensing pixels being arranged in macropixel, and a processor coupled to the array of image sensing pixels. The processor may be configured to receive pixel signals from the array of image sensing pixels, and arrange the received pixel signals into macropixel signal sets for respective macropixels. The processor may be configured to perform, in parallel, an image enhancement operation on the received pixel signals for each macropixel signal set to generate enhanced macropixel signals, and transmit the enhanced macropixel signals.
    Type: Grant
    Filed: April 20, 2018
    Date of Patent: October 9, 2018
    Assignee: STMICROELECTRONICS INTERNATIONAL N.V.
    Inventors: Mahesh Chandra, Brejesh Lall
  • Patent number: 10089780
    Abstract: A processor-based device for displaying simulated or modeled surface appearances based on surface color and surface texture data stored in a data storage. By selecting different combinations of color and texture, different surface appearances may be modeled and displayed. Also, the device may comprise an orientation sensor. Accordingly, the device may additionally consider the orientation of the device when generating surface appearances.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: October 2, 2018
    Assignee: X-Rite, Inc.
    Inventors: Francis Lamy, Jon K Nisper
  • Patent number: 10074212
    Abstract: A method and renderer for a progressive computation of a light transport simulation are provided. The method includes the steps of employing a low discrepancy sequence of samples; and scrambling an index of the low discrepancy sequence independently per region using a hash value based on coordinates of a respective region, wherein for each set of a power-of-two number of the samples, the scrambling is a permutation.
    Type: Grant
    Filed: July 28, 2016
    Date of Patent: September 11, 2018
    Assignee: Nvidia Corporation
    Inventors: Carsten Waechter, Nikolaus Binder
  • Patent number: 10062205
    Abstract: A computer-readable medium storing computer-executable instructions for generating a three-dimensional floor plan of a structure (e.g., a building, vehicle, or other structure) that includes a plurality of walls and at least one window. The three-dimensional floor plan includes internal building data such as height and orientation information for one or more rooms of the structure. The internal building data may include lighting elements and a view from the at least one window. The floor plan also includes external building data such as size, shape, location, and orientation of a second structure adjacent the first structure. The external building data may include points of interest and heavenly bodies. The system may allow a user to view the interior of a particular room and the exterior view from the particular room while manipulating the lighting conditions inside and/or outside of the particular room.
    Type: Grant
    Filed: April 27, 2015
    Date of Patent: August 28, 2018
    Assignee: Trick 3D
    Inventor: Chad E. Eikhoff
  • Patent number: 10055857
    Abstract: A system, method and computer program product to traverse a polygon mesh, partition the polygon mesh into a set of polygon fans based on the traversal order, and tessellate the set of polygon fans into triangles based on the traversal order. This transformation of the polygon mesh into a triangle mesh enables the polygon mesh to be compressed and decompressed using the SC3DMC standard.
    Type: Grant
    Filed: August 29, 2014
    Date of Patent: August 21, 2018
    Assignee: ATI Technologies ULC
    Inventor: Khaled Mammou
  • Patent number: 10055881
    Abstract: A method for virtual, three-dimensional modeling of a subject using a depth-imaging camera operatively coupled to a modeling computer. A brightness image and a coordinate depth image of the subject acquired from each of a plurality of inequivalent vantage points are received from the depth-imaging camera. An angle-dependent reflectance is determined based on the brightness and coordinate depth images acquired from each of the vantage points.
    Type: Grant
    Filed: April 11, 2016
    Date of Patent: August 21, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Monica Stewart, Matthew Adam Simari, Michael Hall
  • Patent number: 10055883
    Abstract: A method, computer readable medium, and system are disclosed for rendering shadows. A frustum projected from a grid cell corresponding to a light source in light-space is defined and a graphics primitive is determined to intersect the frustum. A light-space visibility buffer is accessed to obtain a set of pixel fragment footprints corresponding to the frustum and it is identified whether each pixel fragment footprint of the pixel fragment footprints is shadowed by the graphics primitive.
    Type: Grant
    Filed: January 6, 2016
    Date of Patent: August 21, 2018
    Assignee: NVIDIA CORPORATION
    Inventors: Christopher Ryan Wyman, Aaron Eliot Lefohn, Anjul Patney
  • Patent number: 10043303
    Abstract: Methods and apparatus relating to more efficient ray tracing of instanced geometry are described. In an embodiment, overlapping instances are unbraided, by not instantiating the entire objects, but instantiating multiple sub-BVH nodes of the objects, which improves rendering performance by reducing overlap of BVH nodes. Other embodiments are also disclosed and claimed.
    Type: Grant
    Filed: March 30, 2016
    Date of Patent: August 7, 2018
    Assignee: Intel IP Corporation
    Inventors: Ingo Wald, Sven Woop, Carsten Benthin
  • Patent number: 10038864
    Abstract: A solid-state imaging device including a phase difference pixel that includes a photoelectric conversion unit formed in a semiconductor substrate, a light blocking film that is provided in an insulating layer stacked on the semiconductor substrate, and shields substantially a half of the phase difference pixel from light, with the boundary being the pupil position, and a polarizing structure that polarizes light passing through an opening portion not shielded from light by the light blocking film. The present technology can be applied to solid-state imaging devices capable of image plane phase difference autofocusing, for example.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: July 31, 2018
    Assignee: SONY CORPORATION
    Inventor: Hisashi Akiyama
  • Patent number: 10026145
    Abstract: Techniques for allowing for concurrent execution of multiple different tasks and preempted prioritized execution of tasks on a shader processor. In an example operation, a driver executed by a central processing unit (CPU) configures GPU resources based on needs of a first “host” shader to allow the first shader to execute “normally” on the GPU. The GPU may observe two sets of tasks, “guest” tasks. Based on, for example, detecting an availability of resources, the GPU may determine a “guest” task may be run while the “host” task is running. A second “guest” shader executes on a GPU by using resources that were configured for the first “host” shader if there are available resources and, in some examples, additional resources are obtained through software-programmable means.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: July 17, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Alexei Vladimirovich Bourd, Maxim Kazakov, Chunhui Mei, Sumesh Udayakumaran
  • Patent number: 10019830
    Abstract: A rendering method includes determining frames. The rendering method further includes successively rendering same regions of the frames. In another general aspect, rendering device includes an inter-frame determining unit configured to determine frames. The rendering device further includes a rendering unit configured to successively render same regions of the frames.
    Type: Grant
    Filed: October 15, 2014
    Date of Patent: July 10, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Youngsam Shin, Wonjong Lee, Jaedon Lee
  • Patent number: 10021314
    Abstract: An image processing apparatus comprises: an obtainment unit configured to obtain an image captured in accompaniment of an emission of a predetermined light source; a setting unit configured to set a virtual light source to be applied to the image based on a characteristic of the predetermined light source; and a generation unit configured to generate an image for which a shading state of at least one of a plurality of subjects included in the image is changed due to the virtual light source, wherein the setting unit is configured to set the virtual light source so that a difference between a change of a shading state in a first subject due to the predetermined light source and a change in the shading state in a second subject due to the predetermined light source is reduced.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: July 10, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hiroshi Ogino
  • Patent number: 10013809
    Abstract: Technologies are described for display of a merged image on a display. A processor may receive first data that relates to a first image of a real object and second data that relates to a second image of a virtual object. The second image, if displayed, may overlap, in an overlap region, at least part of the first image if the first image were displayed. The processor may identify an overlap part in the first data that corresponds to the overlap region, clip the overlap part from the first data to produce clipped data, and blur the clipped data to produce blurred data. The processor may subtract the clipped data from the blurred data to produce an additive blur component, add the additive blur component to the second data to produce merged data, and generate the merged image to be displayed on the display based on the merged data.
    Type: Grant
    Filed: March 27, 2017
    Date of Patent: July 3, 2018
    Assignee: EMPIRE TECHNOLOGY DEVELOPMENT LLC
    Inventor: Ezekiel Kruglick
  • Patent number: 10008033
    Abstract: A method, system, and computer program product for performing a lighting simulation are disclosed. The method includes the steps of receiving a three-dimensional (3D) model, receiving a set of probes, where each probe specifies a location within the 3D model and an orientation of the probe, and performing, via a processor, a lighting simulation based on the 3D model, the set of probes, and one or more light path expressions. The light path expressions are regular expressions that represent a series of events, each event representing an interaction of a ray at a location in the 3D model.
    Type: Grant
    Filed: January 2, 2018
    Date of Patent: June 26, 2018
    Assignee: NVIDIA Corporation
    Inventors: Daniel Johannes Seibert, Stefan Radig, Matthias Raab, Carsten Alexander Wächter, Lutz Kettner, Alexander Keller, Dirk Gerrit van Antwerpen
  • Patent number: 10007742
    Abstract: The present invention provides a GPU-based particle flow simulation system and method which includes generating particle information based on particle modeling information inputted from a client terminal, and generating geometric solid information; receiving the particle information and the geometric solid information, determining which GPUs of which computation nodes are to be used based on the number of the particles and the number of idle GPUs in each of the computation nodes; determining which particles are to be processed in which GPUs of which computation nodes based on the determined number of GPUs and a space distribution of the particles, and performing allocation according to the determination result; stimulating particle flow by computing in parallel in the plurality of GPUs a force applied to each particle due to particle collision and thus an acceleration; and presenting a stimulation result.
    Type: Grant
    Filed: May 22, 2013
    Date of Patent: June 26, 2018
    Assignee: INSTITUTE OF MODERN PHYSICS, CHINESE ACADEMY OF SCIENCES
    Inventors: Lei Yang, Ji Qi, Yuan Tian, Xiaofei Gao
  • Patent number: 10007995
    Abstract: A method for obtaining a model of an object surface from a plurality of images of said object, wherein the object is illuminated with one or more illumination sources, the method comprising: •—obtaining a set of images each comprising an array of pixels and representing similar views of an object, wherein the similar views are obtained under different illumination conditions; •—defining a model function that expresses the known pixel intensity values of the images in terms of the following unknown model components: •—a first model component (A) representing the albedo of the object at each pixel location and being the same for the plurality of images and being an albedo value; •—a second model component (L) representing an intensity of illumination for each image and being an illumination source intensity value being the same for all pixels of each image; •—a third model component (V) representing a specific illumination direction and being different for each image and being an illumination vector and being t
    Type: Grant
    Filed: May 22, 2014
    Date of Patent: June 26, 2018
    Assignee: Biomerieux
    Inventors: Lorene Allano, Khrystyna Kyrgyzova
  • Patent number: 10008034
    Abstract: A system, method, and computer program product are provided for computing indirect lighting in a cloud network. In operation, one or more scenes for rendering are identified. Further, indirect lighting associated with the one or more scenes is identified. Additionally, computation associated with the indirect lighting is performed in a cloud network utilizing at least one of a voxel-based algorithm, a photon-based algorithm, or an irradiance-map-based algorithm.
    Type: Grant
    Filed: October 18, 2013
    Date of Patent: June 26, 2018
    Assignee: NVIDIA Corporation
    Inventors: Morgan McGuire, Cyril Jean-Francois Crassin, David Patrick Luebke, Michael Thomas Mara, Brent L. Oster, Peter Schuyler Shirley, Peter-Pike J. Sloan, Christopher Ryan Wyman
  • Patent number: 10008026
    Abstract: Image rendering apparatus for rendering an image from a set of image data representing a volume, the apparatus comprises a rendering unit configured to perform a sampling process that comprises determining values of opacity for a plurality of sample positions along a specified path through the volume; at least one of a) determining values of color/grayscale for the plurality of sample positions along the specified path, b) determining gradient values for a plurality of gradient positions along the specified path; and determining whether there is a transition to or from a high opacity state, and if there is a transition to or from a high opacity state modifying at least pad of the sampling process, wherein the rendering unit is further configured to process the determined values of opacity, color/grayscale and/or gradient to determine a pixel value for a pixel of the image.
    Type: Grant
    Filed: July 19, 2013
    Date of Patent: June 26, 2018
    Assignee: Toshiba Medical Systems Corporation
    Inventors: Andrew Murray, Magnus Wahrenberg
  • Patent number: 10008024
    Abstract: A method for generating one or more two-dimensional texture maps of an object includes receiving an image frame that includes at least a portion of the object from an image capture device. The method also includes determining, at a processor, a color of a particular portion of the object using the image frame and determining a material of the particular portion of the object using the image frame. The method further includes determining at least one other property of the particular portion of the object based on the material. The method also includes generating a pixel value representative of the color of the particular portion of the object and representative of the at least one other property of the particular portion of the object. The method also includes generating at least one two-dimensional texture map based on the pixel value.
    Type: Grant
    Filed: June 8, 2016
    Date of Patent: June 26, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Bijan Forutanpour, Sairam Sundaresan
  • Patent number: 10008025
    Abstract: A rendering system and a rendering method are provided. The rendering method of the rendering system includes: preparing, using an acceleration data structure, data, with respect to at least one object, for performing rendering; dividing, using projection onto a screen, an area into a background area and an object area in order to extract the at least one object; and performing ray-tracing with respect to the object area in order to render the at least one object.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: June 26, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Ievgenii Borodavka, Oleksandr Lisovyi, Dmytro Deineka
  • Patent number: 10001651
    Abstract: A display device includes a first diffraction element configured to diffract image light and a second diffraction element disposed on an optical path between a light source and the first diffraction element. The first and the second diffraction element emit light beams that have highest diffraction efficiencies in one direction when a single wave light enters from directions of normals. If the sum of the number of reflections of light and the number of times of intermediate image generation between the second diffraction element and the first diffraction element is an even number, in the first and the second diffraction element, the directions of the diffraction light having the highest diffraction efficiencies are output when light enters from the directions of the normals are the same with respect to the directions of the normals to the incident planes. If the sum is an odd number, the directions are opposite.
    Type: Grant
    Filed: February 21, 2017
    Date of Patent: June 19, 2018
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Toshiyuki Noguchi, Masatoshi Yonekubo
  • Patent number: 10003790
    Abstract: The invention consists in a method of and a device for adapting 3D content to an observer wearing prescription glasses. The method comprises the step of—providing information about prescription glasses of the observer;—calculating a value representative of the optical deviation created by the glasses from the provided information, for a given direction;—estimating a depth adjustment value as a function of the calculated value and—modifying the depth of the 3D content according to the estimated depth adjustment value.
    Type: Grant
    Filed: June 24, 2013
    Date of Patent: June 19, 2018
    Assignee: Thomson Licensing
    Inventors: Laurent Blonde, Sylvain Thiebaud, Didier Doyen
  • Patent number: 9990762
    Abstract: An image processing apparatus includes a calculator configured to calculate a first difference value between frames in terms of either one or both of a position and a direction of a direct light by comparing a current frame to at least one previous frame, and a determiner configured to determine that an indirect light of the current frame is to be sampled in response to the first difference value being greater than or equal to a threshold.
    Type: Grant
    Filed: November 19, 2015
    Date of Patent: June 5, 2018
    Assignee: Samsung Electronic Co., Ltd.
    Inventors: Minsu Ahn, Seungin Park, Inwoo Ha, Hyong Euk Lee
  • Patent number: 9986225
    Abstract: A computer-implemented method for stereoscopically displaying content includes determining a first position of an object within in a region of display space proximate to a stereoscopic display device and calculating a second position of a virtual object in the region. The method further includes determining an occluded portion of the virtual object that is occluded the object when the virtual object is disposed at the second position and causing the display device to stereoscopically render for display one or more portions of the virtual object that do not include the occluded portion. One advantage of the disclosed method is that a viewer can perform direct touch operations with stereoscopically displayed (3D) content with reduced visual discomfort.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: May 29, 2018
    Assignee: AUTODESK, INC.
    Inventors: Tovi Grossman, George Fitzmaurice, Natalia Bogdan
  • Patent number: 9973744
    Abstract: One exemplary embodiment involves receiving a plurality of three-dimensional (3D) track points for a plurality of frames of a video, wherein the 3D track points are extracted from a plurality of two-dimensional source points. The embodiment further involves rendering the 3D track points across a plurality of frames of the video on a two-dimensional (2D) display. Additionally, the embodiment involves coloring each of the 3D track points wherein the color of each 3D track point visually distinguishes the 3D track point from a plurality of surrounding 3D track points, and wherein the color of each 3D track point is consistent across the frames of the video. The embodiment also involves sizing each of the 3D track points based on a distance between a camera that captured the video and a location of the 2D source points referenced by the respective one of the 3D track points.
    Type: Grant
    Filed: October 19, 2015
    Date of Patent: May 15, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: James Acquavella, David Simons, Daniel M. Wilk
  • Patent number: 9972128
    Abstract: A method for generating a polycube representation of an input object comprises: receiving an input volumetric representation of the input object; deforming the input volumetric representation to provide a deformed object representation; and extracting, by the processor, a polycube representation of the object from the deformed object representation. Deforming the input volumetric representation to provide the deformed object representation comprises effecting a tradeoff between competing objectives of: deforming the input volumetric representation in a manner which provides surfaces having normal vectors closely aligned with one of the six directions aligned with the set of global Cartesian axes; and deforming the input volumetric representation in a manner which provides low-distortion deformations. Deforming the input volumetric representation to provide the deformed object may be performed iteratively.
    Type: Grant
    Filed: July 22, 2013
    Date of Patent: May 15, 2018
    Assignees: The University of British Columbia, Oregon State University
    Inventors: James Gregson, Alla Sheffer, Eugene Zhang
  • Patent number: 9965834
    Abstract: Provided is an image processing apparatus including a transformation unit that is configured to deform images so that corresponding points in a plurality of images obtained from several viewpoints with respect to the same subject are matched; a separating unit that is configured to separate specular-reflection components from the plurality of images transformed by the transformation unit and create an image from which the specular-reflection component is removed; and an image reconstructing unit that is configured to combine at least one of the specular-reflection components of the plurality of images, separated by the separating unit, and the image from which the specular-reflection component is removed.
    Type: Grant
    Filed: October 28, 2016
    Date of Patent: May 8, 2018
    Assignees: OLYMPUS CORPORATION, NATIONAL UNIVERSITY CORPORATION CHIBA UNIVERSITY
    Inventors: Masao Sambongi, Norimichi Tsumura, Mayu Yokoya
  • Patent number: 9959590
    Abstract: Embodiment described herein combines a caching system with special cache flushing methods aimed at reducing thread divergence across a group of threads in a thread group, in order to synchronize branching paths taken by different threads executing on the same graphics processor execution unit, One embodiment provides for a graphics processing apparatus comprising graphics execution logic to execute one or more threads of a graphics shader program; an occluder cache to store input occluder node data for adaptive graphical effects logic of the graphics shader program; and compression logic to compress input occluder node data stored in the occluder cache. The occluder node data, in one embodiment, includes occlusion data for use with adaptive shadowing or transparency logic.
    Type: Grant
    Filed: March 30, 2016
    Date of Patent: May 1, 2018
    Assignee: Intel Corporation
    Inventors: Filip Strugar, Axel Mamode
  • Patent number: 9960210
    Abstract: The present invention discloses a structure of pixel arrangement and a display device. The structure of pixel arrangement includes a first sub-pixel, and second sub-pixels and third sub-pixels that are provided surrounding the first sub-pixel, the first sub-pixel, portions of the second sub-pixels and portions of the third sub-pixels constituting a virtual rhombus, wherein a center of the first sub-pixel coincides with a center of the virtual rhombus; a center of the second sub-pixel coincides with a first vertex of the virtual rhombus; and a center of the third sub-pixel coincides with a second vertex of the virtual rhombus. Compared with the prior art, the number of sub-pixels required to achieve high resolution display in the present invention is smaller, so that the number of the sub-pixels is decreased.
    Type: Grant
    Filed: July 20, 2015
    Date of Patent: May 1, 2018
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Lujiang Huangfu, Xiaodan Jin, Yinan Liang
  • Patent number: 9953457
    Abstract: A system, method, and computer program product are provided for performing path space filtering. In use, a set of light transport paths associated with a scene is sampled. Additionally, a plurality of vertices associated with the sampled set of light transport paths is selected, where each selected vertex has an associated throughput and light contribution. Further, an averaged light contribution of each of the selected plurality of vertices is determined, utilizing one or more weights. Further still, the averaged light contribution of each of the selected plurality of vertices is combined after multiplying the averaged light contribution of each of the selected vertices by the associated throughput of the vertex.
    Type: Grant
    Filed: January 28, 2014
    Date of Patent: April 24, 2018
    Assignee: NVIDIA Corporation
    Inventors: Alexander Keller, Ken Patrik Dahm, Nikolaus Binder
  • Patent number: 9952868
    Abstract: One embodiment of the present invention sets forth a graphics processing system. The graphics processing system includes a screen-space pipeline and a tiling unit. The screen-space pipeline is configured to perform visibility testing and fragment shading. The tiling unit is configured to determine that a first set of primitives overlaps a first cache tile. The tiling unit is also configured to first transmit the first set of primitives to the screen-space pipeline with a command configured to cause the screen-space pipeline to process the first set of primitives in a z-only mode, and then transmit the first set of primitives to the screen-space pipeline with a command configured to cause the screen-space pipeline to process the first set of primitives in a normal mode. In the z-only mode, at least some fragment shading operations are disabled in the screen-space pipeline. In the normal mode, fragment shading operations are enabled.
    Type: Grant
    Filed: October 1, 2013
    Date of Patent: April 24, 2018
    Assignee: NVIDIA Corporation
    Inventors: Ziyad S. Hakura, Jerome F. Duluk, Jr.
  • Patent number: 9947132
    Abstract: A material representation data structure and a method of representing a material for digital image synthesis. The data structure may be embodied in a graphics processing subsystem, including: (1) a memory configured to store a material representation data structure according to which a material is declaratively represented by a property indicative of an interaction between the material and light, and (2) a processor operable to gain access to the memory and employ the property in a rendering procedure defined independent of the material representation data structure and designed to effect the interaction.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: April 17, 2018
    Assignee: Nvidia Corporation
    Inventors: Lutz Kettner, Hakan Andersson, Michael Beck, Robert Hoedicke, Jan Jordan, Andy Kopra, Steven Parker, Matthias Raab, Daniel Seibert, Rajko Yasui-Schoeffel
  • Patent number: 9940018
    Abstract: A method for creating a boundless projected interactive virtual desktop, wherein the interactive virtual desktop comprises an adjustable image of a projected portion of an area associated with at least one desktop of a computing device is provided. The method may include integrating a projector and a motion sensor into a device. The method may also include capturing at least one of a location, a change in location, a change in direction, or a change in orientation associated with the device. The method may include computing a projected image. The method may also include coordinating the computed projected image across at least one application running in the device. The method may further include projecting a view of a portion of an area associated with the coordinated projected image, wherein the projected view comprises an interactive virtual desktop. The method may additionally include adjusting the projected view based on a criteria.
    Type: Grant
    Filed: August 18, 2015
    Date of Patent: April 10, 2018
    Assignee: International Business Machines Corporation
    Inventor: Jonathan F. Brunn
  • Patent number: 9939925
    Abstract: Example systems and methods of providing a user interface are presented. In one example, a graphical object is displayed on an opaque display component on a user-facing side of a computing device. Using a sensing component of the computing device, movement of a physical pointer controlled by a user is sensed. The physical pointer may be located opposite the user-facing side of the computing device. On the opaque display component, a representation of the physical pointer is displayed during the movement of the physical pointer. The graphical object, as displayed on the opaque display component, is modified based on the sensed movement of the physical pointer during the movement of the physical pointer.
    Type: Grant
    Filed: November 26, 2013
    Date of Patent: April 10, 2018
    Assignee: ADOBE SYSTEMS INCORPORATED
    Inventors: Daichi Ito, Nathan Carr, Naoki Sasaki
  • Patent number: 9933901
    Abstract: Systems, methods, and computer-readable media are provided for enabling efficient control of a media application at a media electronic device by a user electronic device, and, more particularly, for reducing perceived latency of and/or input response time to control data that may be provided by a user electronic device for a media application running on a media electronic device.
    Type: Grant
    Filed: August 24, 2015
    Date of Patent: April 3, 2018
    Assignee: APPLE INC.
    Inventors: Jacques P. Gasselin de Richebourg, Norman N. Wang, James J. Cwik
  • Patent number: 9934153
    Abstract: A patch memory system for accessing patches from a memory is disclosed. A patch is an abstraction that refers to a contiguous, array of data that is a subset of an N-dimensional array of data. The patch memory system includes a tile cache, and is configured to fetch data associated with a patch by determining one or more tiles associated with an N-dimensional array of data corresponding to the patch, and loading data for the one or more tiles from the memory into the tile cache. The N-dimensional array of data may be a two-dimensional (2D) digital image comprising a plurality of pixels. A patch of the 2D digital image may refer to a 2D subset of the image.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: April 3, 2018
    Assignee: NVIDIA Corporation
    Inventors: Jason Lavar Clemons, Chih-Chi Cheng, Daniel Robert Johnson, Stephen William Keckler, Iuri Frosio, Yun-Ta Tsai
  • Patent number: 9934606
    Abstract: A shading rate may be set by analyzing samples within a pixel. Then based on that analysis, a system determines whether to use coarse pixel, pixel or sample shading for a region of pixels. Based on the determined type of shading, the shading rate may be set.
    Type: Grant
    Filed: September 16, 2014
    Date of Patent: April 3, 2018
    Assignee: Intel Corporation
    Inventors: Rahul P. Sathe, Marco Salvi
  • Patent number: 9927882
    Abstract: A graphics processing unit 2 includes a texture pipeline 6 having a first pipeline portion 18 and a second pipeline portion 20. A subject instruction within the first pipeline portion 18 is recirculated within the first pipeline portion 18 until descriptor data to be loaded from a memory 4 by that subject instruction has been cached within a shared descriptor cache 22. When the descriptor has been stored within the shared descriptor cache 22, then the subject instruction is passed to the second pipeline portion 20 where further processing operations are performed and the subject instruction recirculated until those further processing operations have completed. The descriptor data is locked within the shared descriptor cache 22 until there are no pending subject instructions within the texture pipeline 6 which required to use that descriptor data.
    Type: Grant
    Filed: April 30, 2012
    Date of Patent: March 27, 2018
    Assignee: ARM Limited
    Inventors: Andreas Due Engh-Halstvedt, Jorn Nystad
  • Patent number: 9922396
    Abstract: Incremental encoding of Bounding Volume Hierarchies (BVH) enables coarse quantization of bounding volumes, significantly reducing their memory footprint. However, reducing the size of the BVH alone does not yield a comparable reduction in memory bandwidth in some embodiments. While the bounding volumes of the BVH nodes can be aggressively quantized, the size of the child node pointers remains a significant overhead. A two-level clustering method introduces a memory layout and node addressing scheme, which allows the reordering of BVH nodes to reduce their memory footprint in hardware ray tracing systems using reduced precision ray traversal.
    Type: Grant
    Filed: May 18, 2016
    Date of Patent: March 20, 2018
    Assignee: Intel Corporation
    Inventors: Gabor Liktor, Karthik Vaidyanathan
  • Patent number: 9916677
    Abstract: According to one exemplary implementation, a method for use by a global illumination system including a hardware processor includes identifying, using the hardware processor, a first interior vertex of multiple first interior vertices of a light path, the first interior vertices being situated within a volume having a refractive boundary. In addition, the method includes determining, using the hardware processor, a surface vertex of the light path at the refractive boundary, and determining, using the hardware processor, a linear direction from the surface vertex to a light source of the light path. The method also includes determining, using the hardware processor, one or more second interior vertices for completing the light path by constructing a path from the surface vertex to the first interior vertex, based on the linear direction, the surface vertex and the first interior vertex.
    Type: Grant
    Filed: July 26, 2016
    Date of Patent: March 13, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Jan Novak, David Koerner, Wojciech Jarosz, Peter Kutz, Ralf Habel
  • Patent number: 9911200
    Abstract: Relightable free-viewpoint rendering allows a novel view of a scene to be rendered and relit based on multiple views of the scene from multiple camera viewpoints. Image values from the multiple camera viewpoints can be separated into diffuse image components and specular image components, such that an intrinsic color component of a relightable texture can be determined for a specular scene, by using the separated diffuse image components. Furthermore, surface normals of geometry in the scene can be refined by constructing a height map based on a conservative component of an initial surface normal field and then determining the refined surface normals based on the constructed height map.
    Type: Grant
    Filed: November 26, 2014
    Date of Patent: March 6, 2018
    Assignee: Imagination Technologies Limited
    Inventors: James Imber, Adrian Hilton, Jean-Yves Guillemaut
  • Patent number: 9911395
    Abstract: A system and method for generating a corrected input to a display to offset glare is provided. The system determines a location of a user's head and calculates a reflection vector based on a head vector from a device to a point on the user's head. The system identifies light sources using a camera and determines display pixels on a display of the device affected by the reflection of the light sources based on head detection and locations of the light sources. The system dynamically adjusts pixel brightness to account for a detected glare, thus improving the user's experience operating the UI.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: March 6, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Matthew Alan Townsend, Huma Dawood Khatri, Gabrielle Halberg, Bryan Harris, Douglas Sim Dietrich
  • Patent number: 9905028
    Abstract: Embodiments involve simulating sub-surface scattering of illumination for three-dimensional objects. An application determines, for each point defining a simulated three-dimensional surface, a respective first simulated light at the point caused by a simulated light source illuminating the three-dimensional surface. Each first simulated light includes a weighted average of simulated incident light at the point. Each weighted average is determined based on simulated incident light contributions from neighboring points of the three-dimensional surface. The application also determines, for each point, a respective second simulated light at the point. Each second simulated light includes light from the light source that is diffusively reflected at the point.
    Type: Grant
    Filed: December 11, 2013
    Date of Patent: February 27, 2018
    Assignee: Adobe Systems Incorporated
    Inventor: Desmond T. Grenfell
  • Patent number: 9905046
    Abstract: In multi-rate shading, a coarse-rate shading phase is added on top of existing pixel-rate phase to significantly improve performance with minimum impact to image quality. Two shading phases evaluated at different rates may be mapped to one monolithic program running on processor graphics single instruction multiple data (SIMD) engines. In one embodiment, multi-rate shading allows a single rendering pass to execute shading code at one or more different rates: per group of pixels, per pixel, and per sample.
    Type: Grant
    Filed: September 22, 2014
    Date of Patent: February 27, 2018
    Assignee: Intel Corporation
    Inventors: Tomasz Janczak, Prasoonkumar Surti
  • Patent number: 9904971
    Abstract: In a graphics system regions of a frame are analyzed to determine local regions of the frame in which adaptive desampling may be performed. In one implementation a standard sampling scheme includes at least one sample per pixel and regions that are adaptively desampled have one sample for a block of pixels having a size of at least four pixels. A level of detail map is generating to identify regions in which desampling may be performed. The level of detail map may be based on detecting motion, detecting an edge, and detecting a content frequency.
    Type: Grant
    Filed: June 17, 2015
    Date of Patent: February 27, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Christopher T. Cheng, Liangjun Zhang, Santosh Abraham, Ki Fung Chow
  • Patent number: 9900590
    Abstract: The embodiments of the present invention provide a display panel and a driving method thereof, and a display device. The display panel comprises a plurality of pixel groups, each of which comprises four different sub-regions arranging in a matrix with two rows and two columns, each of the sub-regions has one first color subpixel, one second color subpixel, one third color subpixel and one fourth color subpixel arranging in a matrix with two rows and two columns, each row of subpixels in the pixel group consist of one first color subpixel, one second color subpixel, one third color subpixel and one fourth color subpixel, and a first row of subpixels and a fourth row of subpixels in the pixel group have the same arrangement structure of subpixels, and a second row of subpixels and a third row of subpixels in the pixel group have the same arrangement structure of subpixels.
    Type: Grant
    Filed: June 19, 2015
    Date of Patent: February 20, 2018
    Assignees: BOE TECHNOLOGY GROUP CO., LTD., BEIJING BOE DISPLAY TECHNOLOGY CO., LTD.
    Inventors: Junwei Wang, Chunbing Zhang
  • Patent number: 9892323
    Abstract: An augmented reality device based on recognition of a spatial structure includes: a point cloud normal vector extracting unit extracting a normal vector for a point cloud from image data input from a camera; a plane object segmenting unit segmenting a plane in the image data by using the extracted normal vector; a representative plane selecting unit selecting a representative plane among the segmented planes; a spatial structure extracting unit recognizing a spatial structure by using the representative plane; and a virtual object matching unit matching a virtual object in the recognized spatial structure.
    Type: Grant
    Filed: June 17, 2016
    Date of Patent: February 13, 2018
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Hyun Woo Cho, Young Woon Lee, Sung Uk Jung
  • Patent number: 9892548
    Abstract: A method, system, and computer program product for performing a lighting simulation are disclosed. The method includes the steps of receiving a three-dimensional (3D) model, receiving a set of probes, where each probe specifies a location within the 3D model and an orientation of the probe, and performing, via a processor, a lighting simulation based on the 3D model, the set of probes, and one or more light path expressions. The light path expressions are regular expressions that represent a series of events, each event representing an interaction of a ray at a location in the 3D model.
    Type: Grant
    Filed: August 6, 2015
    Date of Patent: February 13, 2018
    Assignee: NVIDIA Corporation
    Inventors: Daniel Johannes Seibert, Stefan Radig, Matthias Raab, Carsten Alexander Waechter, Lutz Kettner, Alexander Keller, Dirk Gerrit van Antwerpen