Lighting/shading Patents (Class 345/426)
  • Patent number: 10139630
    Abstract: An image display device with which it is possible to visually recognize an image while securing the see-through property regardless of eye movements and changes in interpupillary distance, with which it is possible to display a large-size image with high quality, and which is small, has excellent wearability, and has an excellent external appearance.
    Type: Grant
    Filed: September 17, 2015
    Date of Patent: November 27, 2018
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Osamu Yokoyama, Masatoshi Yonekubo, Takashi Takeda, Daisuke Ishida, Mitsutaka Ide, Hidemitsu Sorimachi
  • Patent number: 10140751
    Abstract: During tracing of a primary ray in a 3-D space (e.g., a 3-D scene in graphics rendering), a ray is found to intersect a primitive (e.g., a triangle) located in the 3-D space. Secondary ray(s) may be generated for a variety of purposes. For example, occlusion rays may be generated to test occlusion of a point of intersection between the primary ray and primitive is illuminated by any of the light(s). An origin for each secondary ray can be modified from the intersection point based on characteristics of the primitive intersected. For example, an offset from the intersection point can be calculated using barycentric coordinates of the intersection point and interpolation of one or more parameters associated with vertices defining the primitive. These parameters may include a size of the primitive and differences between a geometric normal for the primitive and a respective additional vector supplied with each vertex.
    Type: Grant
    Filed: August 8, 2013
    Date of Patent: November 27, 2018
    Assignee: Imagination Technologies Limited
    Inventor: Aaron Dwyer
  • Patent number: 10134174
    Abstract: A virtual-reality computing device comprises a pose sensor, a rendering tool, and a display. The pose sensor is configured to measure a current pose of the virtual-reality computing device in a physical space. The rendering tool is configured to receive a holographic animation of a 3D model that includes a sequence of holographic image frames. The rendering tool is also configured to receive a render-baked dynamic lighting animation that includes a sequence of lighting image frames corresponding to the sequence of holographic image frames. The rendering tool also is configured to derive a 2D view of the 3D model with a virtual perspective based on the current pose and texture map a corresponding lighting image frame to the 2D view of the 3D model to generate a rendered image frame of the 2D view with texture-mapped lighting. The display is configured to visually present the rendered image frame.
    Type: Grant
    Filed: June 13, 2016
    Date of Patent: November 20, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Anthony Ambrus, Mike Boulton, Alexander J. Hogan, Jeffrey Kohler
  • Patent number: 10134169
    Abstract: One embodiment of the present invention sets forth a method for accessing texture objects stored within a texture memory. The method comprises the steps of receiving a texture bind request from an application program, wherein the texture bind request includes an object identifier that identifies a first texture object stored in the texture memory and an image identifier that identifies a first image unit, binding the first texture object to the first image unit based on the texture bind request, receiving, within a shader engine, a first shading program command from the application program for performing a first memory access operation on the first texture object, wherein the memory access operation is a store operation or atomic operation to an arbitrary location in the image, and performing, within the shader engine, the first memory access operation on the first texture object via the first image unit.
    Type: Grant
    Filed: August 12, 2010
    Date of Patent: November 20, 2018
    Assignee: NVIDIA CORPORATION
    Inventors: Jeffrey A. Bolz, Patrick R. Brown
  • Patent number: 10127868
    Abstract: A method of controlling an array of electrowetting elements, comprising: receiving first pixel data; selecting, based on the first pixel data and based on a characteristic of the first display effect, a group of subpixels to display the first display effect; and outputting control data for displaying the first display effect using the group of subpixels.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: November 13, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Petrus Maria De Greef, Gor Manukyan
  • Patent number: 10127710
    Abstract: A processor and method for accelerating ray casting are disclosed herein. The processor for accelerating ray casting includes a computation unit, a sorting unit, an allocation unit, and an execution control unit. The computation unit calculates the length information of a section in which a ray corresponding to each of the pixels of a two-dimensional (2D) scene corresponding to a viewpoint intersects an effective volume in order to apply ray casting to the pixel. The sorting unit sorts the ray based on the length information of the section in which the ray intersects the effective volume. The allocation unit allocates the sorted rays to respective thread groups having a parallel multiprocessor structure in order of the sorting. The execution control unit transfers control instructions to the allocated thread groups so that the allocated thread groups execute ray casting for the sorted rays.
    Type: Grant
    Filed: May 31, 2016
    Date of Patent: November 13, 2018
    Assignee: CORELINE SOFT CO., LTD.
    Inventors: Jaeyoun Yi, Ji Min Kim, Jin Kook Kim
  • Patent number: 10127692
    Abstract: A web server receives a request from a client specifying a location and a bounding area. A mapping engine creates a tile grid centered at the specified location. A seed tile is created, including or adjacent to the center location. The web server creates a resource identifier for each tile in the tile grid, and returns the tile grid including the resource identifiers to the client. The resource identifier for each tile includes the location of the seed tile and a position offset for the tile relative to the seed tile, in one embodiment specified in units of northward and eastward movement. The client requests tiles from the system using the resource identifiers previously provided by the system. Upon receiving the request, the mapping engine dynamically renders each requested tile using map data from the map database, and the web server returns the dynamically-generated tiles to the requesting client.
    Type: Grant
    Filed: August 5, 2016
    Date of Patent: November 13, 2018
    Assignee: Uber Technologies, Inc.
    Inventors: Brent Hamby, Geoffrey Rummens Hendrey
  • Patent number: 10121222
    Abstract: A graphics processing unit (GPU) renders graphical objects into a group of pixels and stores the pixels in an on-chip buffer on the same chip as the GPU. Each pixel has an alpha value that indicates transparency of the pixel. The GPU reads the alpha value of each pixel from the on-chip buffer. According to alpha values of the group of pixels, the GPU generates an alpha hint in the system memory for the group of pixels. The alpha hint represents an aggregate of the alpha values of the group of pixels. The GPU then stores the group of pixels into a frame buffer in the system memory.
    Type: Grant
    Filed: August 19, 2016
    Date of Patent: November 6, 2018
    Assignee: MediaTek Inc.
    Inventors: Ying-Chieh Chen, I-Hsuan Lu, Shih-Chin Lin
  • Patent number: 10121282
    Abstract: Provided is an image processing apparatus that may determine whether indirect lights are to be assigned to tiles for tile-based deferred rendering. For example, the image processing apparatus includes a calculator configured to calculate a correlation based on at least one of a first vector representing an object normal direction of a tile to be rendered and a second vector corresponding to a normal vector of an indirect light to be determined to be assigned to the tile, and a determiner configured to determine whether the indirect light is to be assigned to the tile by comparing the correlation to a threshold value.
    Type: Grant
    Filed: November 9, 2015
    Date of Patent: November 6, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Minsu Ahn, Seungin Park, Hyong Euk Lee, Inwoo Ha
  • Patent number: 10121266
    Abstract: Image based imposters suffer from common errors called disocclusion artifacts where portions of the scene that should be occluded by real geometry are visible when using image based imposters. These artifacts are the result of parallax error created by camera motion where regions of a mesh that were not visible at the time of imposter generation have become visible. A computationally inexpensive on-line technique to resolve these disocclusions stretches existing imposter texture information over new geometry bridging the gap between imposters.
    Type: Grant
    Filed: November 24, 2015
    Date of Patent: November 6, 2018
    Assignee: AFFINE TECHNOLOGIES LLC
    Inventor: Chad Mourning
  • Patent number: 10115230
    Abstract: Systems, methods, and computer readable media for generating optimized shader programs (e.g., vertex and fragment) at run-time are described. In general, techniques are disclosed for determining when an executing graphics program (a “client”) issues a command that, to be carried out, would require a significant change in the currently executing shader program (a “shader”). When this is detected, the client's specified change may be used to identify a minimal set of shader instructions that can provide the client's designated effect. The instructions so identified, may be used to generate a shader optimized for that effect.
    Type: Grant
    Filed: August 9, 2016
    Date of Patent: October 30, 2018
    Assignee: Apple Inc.
    Inventor: John D. Rosasco
  • Patent number: 10109076
    Abstract: A method for applying depth-dependent effects to images includes receiving a stereo image and depth related information extracted from the stereo image, and applying an effect to the stereo image according to the depth related information. The method may also include calculating surface orientation information for the stereo image to improve the depth related information extracted from the stereo image and/or facilitate the application of effects, such as scene relighting, which leverage surface orientation information. In some embodiments, the method includes fitting a curved surface to the depth related information and adjusting the depth related information and/or surface orientation information according to the curved surface. The method may also include processing the depth related information with a bilateral smoothing filter wherein coefficients for neighboring pixels are weighted according to similarity in color and similarity in depth.
    Type: Grant
    Filed: June 12, 2014
    Date of Patent: October 23, 2018
    Assignee: Brigham Young University
    Inventors: Joshua Abbott, Bryan S. Morse
  • Patent number: 10097799
    Abstract: An image sensor device may include an array of image sensing pixels with adjacent image sensing pixels being arranged in macropixel, and a processor coupled to the array of image sensing pixels. The processor may be configured to receive pixel signals from the array of image sensing pixels, and arrange the received pixel signals into macropixel signal sets for respective macropixels. The processor may be configured to perform, in parallel, an image enhancement operation on the received pixel signals for each macropixel signal set to generate enhanced macropixel signals, and transmit the enhanced macropixel signals.
    Type: Grant
    Filed: April 20, 2018
    Date of Patent: October 9, 2018
    Assignee: STMICROELECTRONICS INTERNATIONAL N.V.
    Inventors: Mahesh Chandra, Brejesh Lall
  • Patent number: 10096088
    Abstract: The disclosure provides an approach for denoising (also referred to as “filtering”) rendered images. In one embodiment, a denoising application takes as input rendered images and feature buffers that encode image information such as surface positions, surface depths, surface normals, surface albedos, and distances to the camera. For each pixel in a received image, the denoising application performs a first-order regression in a predefined neighborhood of the pixel to find a linear combination of pixel features that fits pixel colors in the predefined neighborhood. In such a first-order regression, the local regression weight of each pixel in the neighborhood may be determined using a metric which computes distances based on color values in patches around pixels being compared. In another embodiment, collaborative filtering may be performed in which filtered output from the first-order regression in each neighborhood is averaged with filtered output from overlapping neighborhoods to obtain a final output.
    Type: Grant
    Filed: September 28, 2016
    Date of Patent: October 9, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Benedikt Martin Bitterli, Jan Novák, Fabrice Pierre Armand Rousselle
  • Patent number: 10096296
    Abstract: A method and system for determining a first local time of day for a user device, and determining a first value of a visual aspect of a drop shadow associated with an application window on the display based on of the first local time of day. The drop shadow is displayed in view of the first value, wherein the drop shadow provides a visual appearance that the application window is above a background. A second local time is determined, and a second value of the visual aspect of the drop shadow is determined, wherein the second value is in view of the second local time. The drop shadow is displayed in view of the second value of the aspect such that the drop shadow has a different visual appearance from the first local time to the second local time.
    Type: Grant
    Filed: November 13, 2013
    Date of Patent: October 9, 2018
    Assignee: Red Hat, Inc.
    Inventor: Ray Strode
  • Patent number: 10089780
    Abstract: A processor-based device for displaying simulated or modeled surface appearances based on surface color and surface texture data stored in a data storage. By selecting different combinations of color and texture, different surface appearances may be modeled and displayed. Also, the device may comprise an orientation sensor. Accordingly, the device may additionally consider the orientation of the device when generating surface appearances.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: October 2, 2018
    Assignee: X-Rite, Inc.
    Inventors: Francis Lamy, Jon K Nisper
  • Patent number: 10074212
    Abstract: A method and renderer for a progressive computation of a light transport simulation are provided. The method includes the steps of employing a low discrepancy sequence of samples; and scrambling an index of the low discrepancy sequence independently per region using a hash value based on coordinates of a respective region, wherein for each set of a power-of-two number of the samples, the scrambling is a permutation.
    Type: Grant
    Filed: July 28, 2016
    Date of Patent: September 11, 2018
    Assignee: Nvidia Corporation
    Inventors: Carsten Waechter, Nikolaus Binder
  • Patent number: 10062205
    Abstract: A computer-readable medium storing computer-executable instructions for generating a three-dimensional floor plan of a structure (e.g., a building, vehicle, or other structure) that includes a plurality of walls and at least one window. The three-dimensional floor plan includes internal building data such as height and orientation information for one or more rooms of the structure. The internal building data may include lighting elements and a view from the at least one window. The floor plan also includes external building data such as size, shape, location, and orientation of a second structure adjacent the first structure. The external building data may include points of interest and heavenly bodies. The system may allow a user to view the interior of a particular room and the exterior view from the particular room while manipulating the lighting conditions inside and/or outside of the particular room.
    Type: Grant
    Filed: April 27, 2015
    Date of Patent: August 28, 2018
    Assignee: Trick 3D
    Inventor: Chad E. Eikhoff
  • Patent number: 10055857
    Abstract: A system, method and computer program product to traverse a polygon mesh, partition the polygon mesh into a set of polygon fans based on the traversal order, and tessellate the set of polygon fans into triangles based on the traversal order. This transformation of the polygon mesh into a triangle mesh enables the polygon mesh to be compressed and decompressed using the SC3DMC standard.
    Type: Grant
    Filed: August 29, 2014
    Date of Patent: August 21, 2018
    Assignee: ATI Technologies ULC
    Inventor: Khaled Mammou
  • Patent number: 10055881
    Abstract: A method for virtual, three-dimensional modeling of a subject using a depth-imaging camera operatively coupled to a modeling computer. A brightness image and a coordinate depth image of the subject acquired from each of a plurality of inequivalent vantage points are received from the depth-imaging camera. An angle-dependent reflectance is determined based on the brightness and coordinate depth images acquired from each of the vantage points.
    Type: Grant
    Filed: April 11, 2016
    Date of Patent: August 21, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Monica Stewart, Matthew Adam Simari, Michael Hall
  • Patent number: 10055883
    Abstract: A method, computer readable medium, and system are disclosed for rendering shadows. A frustum projected from a grid cell corresponding to a light source in light-space is defined and a graphics primitive is determined to intersect the frustum. A light-space visibility buffer is accessed to obtain a set of pixel fragment footprints corresponding to the frustum and it is identified whether each pixel fragment footprint of the pixel fragment footprints is shadowed by the graphics primitive.
    Type: Grant
    Filed: January 6, 2016
    Date of Patent: August 21, 2018
    Assignee: NVIDIA CORPORATION
    Inventors: Christopher Ryan Wyman, Aaron Eliot Lefohn, Anjul Patney
  • Patent number: 10043303
    Abstract: Methods and apparatus relating to more efficient ray tracing of instanced geometry are described. In an embodiment, overlapping instances are unbraided, by not instantiating the entire objects, but instantiating multiple sub-BVH nodes of the objects, which improves rendering performance by reducing overlap of BVH nodes. Other embodiments are also disclosed and claimed.
    Type: Grant
    Filed: March 30, 2016
    Date of Patent: August 7, 2018
    Assignee: Intel IP Corporation
    Inventors: Ingo Wald, Sven Woop, Carsten Benthin
  • Patent number: 10038864
    Abstract: A solid-state imaging device including a phase difference pixel that includes a photoelectric conversion unit formed in a semiconductor substrate, a light blocking film that is provided in an insulating layer stacked on the semiconductor substrate, and shields substantially a half of the phase difference pixel from light, with the boundary being the pupil position, and a polarizing structure that polarizes light passing through an opening portion not shielded from light by the light blocking film. The present technology can be applied to solid-state imaging devices capable of image plane phase difference autofocusing, for example.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: July 31, 2018
    Assignee: SONY CORPORATION
    Inventor: Hisashi Akiyama
  • Patent number: 10026145
    Abstract: Techniques for allowing for concurrent execution of multiple different tasks and preempted prioritized execution of tasks on a shader processor. In an example operation, a driver executed by a central processing unit (CPU) configures GPU resources based on needs of a first “host” shader to allow the first shader to execute “normally” on the GPU. The GPU may observe two sets of tasks, “guest” tasks. Based on, for example, detecting an availability of resources, the GPU may determine a “guest” task may be run while the “host” task is running. A second “guest” shader executes on a GPU by using resources that were configured for the first “host” shader if there are available resources and, in some examples, additional resources are obtained through software-programmable means.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: July 17, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Alexei Vladimirovich Bourd, Maxim Kazakov, Chunhui Mei, Sumesh Udayakumaran
  • Patent number: 10019830
    Abstract: A rendering method includes determining frames. The rendering method further includes successively rendering same regions of the frames. In another general aspect, rendering device includes an inter-frame determining unit configured to determine frames. The rendering device further includes a rendering unit configured to successively render same regions of the frames.
    Type: Grant
    Filed: October 15, 2014
    Date of Patent: July 10, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Youngsam Shin, Wonjong Lee, Jaedon Lee
  • Patent number: 10021314
    Abstract: An image processing apparatus comprises: an obtainment unit configured to obtain an image captured in accompaniment of an emission of a predetermined light source; a setting unit configured to set a virtual light source to be applied to the image based on a characteristic of the predetermined light source; and a generation unit configured to generate an image for which a shading state of at least one of a plurality of subjects included in the image is changed due to the virtual light source, wherein the setting unit is configured to set the virtual light source so that a difference between a change of a shading state in a first subject due to the predetermined light source and a change in the shading state in a second subject due to the predetermined light source is reduced.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: July 10, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hiroshi Ogino
  • Patent number: 10013809
    Abstract: Technologies are described for display of a merged image on a display. A processor may receive first data that relates to a first image of a real object and second data that relates to a second image of a virtual object. The second image, if displayed, may overlap, in an overlap region, at least part of the first image if the first image were displayed. The processor may identify an overlap part in the first data that corresponds to the overlap region, clip the overlap part from the first data to produce clipped data, and blur the clipped data to produce blurred data. The processor may subtract the clipped data from the blurred data to produce an additive blur component, add the additive blur component to the second data to produce merged data, and generate the merged image to be displayed on the display based on the merged data.
    Type: Grant
    Filed: March 27, 2017
    Date of Patent: July 3, 2018
    Assignee: EMPIRE TECHNOLOGY DEVELOPMENT LLC
    Inventor: Ezekiel Kruglick
  • Patent number: 10008033
    Abstract: A method, system, and computer program product for performing a lighting simulation are disclosed. The method includes the steps of receiving a three-dimensional (3D) model, receiving a set of probes, where each probe specifies a location within the 3D model and an orientation of the probe, and performing, via a processor, a lighting simulation based on the 3D model, the set of probes, and one or more light path expressions. The light path expressions are regular expressions that represent a series of events, each event representing an interaction of a ray at a location in the 3D model.
    Type: Grant
    Filed: January 2, 2018
    Date of Patent: June 26, 2018
    Assignee: NVIDIA Corporation
    Inventors: Daniel Johannes Seibert, Stefan Radig, Matthias Raab, Carsten Alexander Wächter, Lutz Kettner, Alexander Keller, Dirk Gerrit van Antwerpen
  • Patent number: 10007742
    Abstract: The present invention provides a GPU-based particle flow simulation system and method which includes generating particle information based on particle modeling information inputted from a client terminal, and generating geometric solid information; receiving the particle information and the geometric solid information, determining which GPUs of which computation nodes are to be used based on the number of the particles and the number of idle GPUs in each of the computation nodes; determining which particles are to be processed in which GPUs of which computation nodes based on the determined number of GPUs and a space distribution of the particles, and performing allocation according to the determination result; stimulating particle flow by computing in parallel in the plurality of GPUs a force applied to each particle due to particle collision and thus an acceleration; and presenting a stimulation result.
    Type: Grant
    Filed: May 22, 2013
    Date of Patent: June 26, 2018
    Assignee: INSTITUTE OF MODERN PHYSICS, CHINESE ACADEMY OF SCIENCES
    Inventors: Lei Yang, Ji Qi, Yuan Tian, Xiaofei Gao
  • Patent number: 10007995
    Abstract: A method for obtaining a model of an object surface from a plurality of images of said object, wherein the object is illuminated with one or more illumination sources, the method comprising: •—obtaining a set of images each comprising an array of pixels and representing similar views of an object, wherein the similar views are obtained under different illumination conditions; •—defining a model function that expresses the known pixel intensity values of the images in terms of the following unknown model components: •—a first model component (A) representing the albedo of the object at each pixel location and being the same for the plurality of images and being an albedo value; •—a second model component (L) representing an intensity of illumination for each image and being an illumination source intensity value being the same for all pixels of each image; •—a third model component (V) representing a specific illumination direction and being different for each image and being an illumination vector and being t
    Type: Grant
    Filed: May 22, 2014
    Date of Patent: June 26, 2018
    Assignee: Biomerieux
    Inventors: Lorene Allano, Khrystyna Kyrgyzova
  • Patent number: 10008034
    Abstract: A system, method, and computer program product are provided for computing indirect lighting in a cloud network. In operation, one or more scenes for rendering are identified. Further, indirect lighting associated with the one or more scenes is identified. Additionally, computation associated with the indirect lighting is performed in a cloud network utilizing at least one of a voxel-based algorithm, a photon-based algorithm, or an irradiance-map-based algorithm.
    Type: Grant
    Filed: October 18, 2013
    Date of Patent: June 26, 2018
    Assignee: NVIDIA Corporation
    Inventors: Morgan McGuire, Cyril Jean-Francois Crassin, David Patrick Luebke, Michael Thomas Mara, Brent L. Oster, Peter Schuyler Shirley, Peter-Pike J. Sloan, Christopher Ryan Wyman
  • Patent number: 10008026
    Abstract: Image rendering apparatus for rendering an image from a set of image data representing a volume, the apparatus comprises a rendering unit configured to perform a sampling process that comprises determining values of opacity for a plurality of sample positions along a specified path through the volume; at least one of a) determining values of color/grayscale for the plurality of sample positions along the specified path, b) determining gradient values for a plurality of gradient positions along the specified path; and determining whether there is a transition to or from a high opacity state, and if there is a transition to or from a high opacity state modifying at least pad of the sampling process, wherein the rendering unit is further configured to process the determined values of opacity, color/grayscale and/or gradient to determine a pixel value for a pixel of the image.
    Type: Grant
    Filed: July 19, 2013
    Date of Patent: June 26, 2018
    Assignee: Toshiba Medical Systems Corporation
    Inventors: Andrew Murray, Magnus Wahrenberg
  • Patent number: 10008024
    Abstract: A method for generating one or more two-dimensional texture maps of an object includes receiving an image frame that includes at least a portion of the object from an image capture device. The method also includes determining, at a processor, a color of a particular portion of the object using the image frame and determining a material of the particular portion of the object using the image frame. The method further includes determining at least one other property of the particular portion of the object based on the material. The method also includes generating a pixel value representative of the color of the particular portion of the object and representative of the at least one other property of the particular portion of the object. The method also includes generating at least one two-dimensional texture map based on the pixel value.
    Type: Grant
    Filed: June 8, 2016
    Date of Patent: June 26, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Bijan Forutanpour, Sairam Sundaresan
  • Patent number: 10008025
    Abstract: A rendering system and a rendering method are provided. The rendering method of the rendering system includes: preparing, using an acceleration data structure, data, with respect to at least one object, for performing rendering; dividing, using projection onto a screen, an area into a background area and an object area in order to extract the at least one object; and performing ray-tracing with respect to the object area in order to render the at least one object.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: June 26, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Ievgenii Borodavka, Oleksandr Lisovyi, Dmytro Deineka
  • Patent number: 10001651
    Abstract: A display device includes a first diffraction element configured to diffract image light and a second diffraction element disposed on an optical path between a light source and the first diffraction element. The first and the second diffraction element emit light beams that have highest diffraction efficiencies in one direction when a single wave light enters from directions of normals. If the sum of the number of reflections of light and the number of times of intermediate image generation between the second diffraction element and the first diffraction element is an even number, in the first and the second diffraction element, the directions of the diffraction light having the highest diffraction efficiencies are output when light enters from the directions of the normals are the same with respect to the directions of the normals to the incident planes. If the sum is an odd number, the directions are opposite.
    Type: Grant
    Filed: February 21, 2017
    Date of Patent: June 19, 2018
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Toshiyuki Noguchi, Masatoshi Yonekubo
  • Patent number: 10003790
    Abstract: The invention consists in a method of and a device for adapting 3D content to an observer wearing prescription glasses. The method comprises the step of—providing information about prescription glasses of the observer;—calculating a value representative of the optical deviation created by the glasses from the provided information, for a given direction;—estimating a depth adjustment value as a function of the calculated value and—modifying the depth of the 3D content according to the estimated depth adjustment value.
    Type: Grant
    Filed: June 24, 2013
    Date of Patent: June 19, 2018
    Assignee: Thomson Licensing
    Inventors: Laurent Blonde, Sylvain Thiebaud, Didier Doyen
  • Patent number: 9990762
    Abstract: An image processing apparatus includes a calculator configured to calculate a first difference value between frames in terms of either one or both of a position and a direction of a direct light by comparing a current frame to at least one previous frame, and a determiner configured to determine that an indirect light of the current frame is to be sampled in response to the first difference value being greater than or equal to a threshold.
    Type: Grant
    Filed: November 19, 2015
    Date of Patent: June 5, 2018
    Assignee: Samsung Electronic Co., Ltd.
    Inventors: Minsu Ahn, Seungin Park, Inwoo Ha, Hyong Euk Lee
  • Patent number: 9986225
    Abstract: A computer-implemented method for stereoscopically displaying content includes determining a first position of an object within in a region of display space proximate to a stereoscopic display device and calculating a second position of a virtual object in the region. The method further includes determining an occluded portion of the virtual object that is occluded the object when the virtual object is disposed at the second position and causing the display device to stereoscopically render for display one or more portions of the virtual object that do not include the occluded portion. One advantage of the disclosed method is that a viewer can perform direct touch operations with stereoscopically displayed (3D) content with reduced visual discomfort.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: May 29, 2018
    Assignee: AUTODESK, INC.
    Inventors: Tovi Grossman, George Fitzmaurice, Natalia Bogdan
  • Patent number: 9973744
    Abstract: One exemplary embodiment involves receiving a plurality of three-dimensional (3D) track points for a plurality of frames of a video, wherein the 3D track points are extracted from a plurality of two-dimensional source points. The embodiment further involves rendering the 3D track points across a plurality of frames of the video on a two-dimensional (2D) display. Additionally, the embodiment involves coloring each of the 3D track points wherein the color of each 3D track point visually distinguishes the 3D track point from a plurality of surrounding 3D track points, and wherein the color of each 3D track point is consistent across the frames of the video. The embodiment also involves sizing each of the 3D track points based on a distance between a camera that captured the video and a location of the 2D source points referenced by the respective one of the 3D track points.
    Type: Grant
    Filed: October 19, 2015
    Date of Patent: May 15, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: James Acquavella, David Simons, Daniel M. Wilk
  • Patent number: 9972128
    Abstract: A method for generating a polycube representation of an input object comprises: receiving an input volumetric representation of the input object; deforming the input volumetric representation to provide a deformed object representation; and extracting, by the processor, a polycube representation of the object from the deformed object representation. Deforming the input volumetric representation to provide the deformed object representation comprises effecting a tradeoff between competing objectives of: deforming the input volumetric representation in a manner which provides surfaces having normal vectors closely aligned with one of the six directions aligned with the set of global Cartesian axes; and deforming the input volumetric representation in a manner which provides low-distortion deformations. Deforming the input volumetric representation to provide the deformed object may be performed iteratively.
    Type: Grant
    Filed: July 22, 2013
    Date of Patent: May 15, 2018
    Assignees: The University of British Columbia, Oregon State University
    Inventors: James Gregson, Alla Sheffer, Eugene Zhang
  • Patent number: 9965834
    Abstract: Provided is an image processing apparatus including a transformation unit that is configured to deform images so that corresponding points in a plurality of images obtained from several viewpoints with respect to the same subject are matched; a separating unit that is configured to separate specular-reflection components from the plurality of images transformed by the transformation unit and create an image from which the specular-reflection component is removed; and an image reconstructing unit that is configured to combine at least one of the specular-reflection components of the plurality of images, separated by the separating unit, and the image from which the specular-reflection component is removed.
    Type: Grant
    Filed: October 28, 2016
    Date of Patent: May 8, 2018
    Assignees: OLYMPUS CORPORATION, NATIONAL UNIVERSITY CORPORATION CHIBA UNIVERSITY
    Inventors: Masao Sambongi, Norimichi Tsumura, Mayu Yokoya
  • Patent number: 9959590
    Abstract: Embodiment described herein combines a caching system with special cache flushing methods aimed at reducing thread divergence across a group of threads in a thread group, in order to synchronize branching paths taken by different threads executing on the same graphics processor execution unit, One embodiment provides for a graphics processing apparatus comprising graphics execution logic to execute one or more threads of a graphics shader program; an occluder cache to store input occluder node data for adaptive graphical effects logic of the graphics shader program; and compression logic to compress input occluder node data stored in the occluder cache. The occluder node data, in one embodiment, includes occlusion data for use with adaptive shadowing or transparency logic.
    Type: Grant
    Filed: March 30, 2016
    Date of Patent: May 1, 2018
    Assignee: Intel Corporation
    Inventors: Filip Strugar, Axel Mamode
  • Patent number: 9960210
    Abstract: The present invention discloses a structure of pixel arrangement and a display device. The structure of pixel arrangement includes a first sub-pixel, and second sub-pixels and third sub-pixels that are provided surrounding the first sub-pixel, the first sub-pixel, portions of the second sub-pixels and portions of the third sub-pixels constituting a virtual rhombus, wherein a center of the first sub-pixel coincides with a center of the virtual rhombus; a center of the second sub-pixel coincides with a first vertex of the virtual rhombus; and a center of the third sub-pixel coincides with a second vertex of the virtual rhombus. Compared with the prior art, the number of sub-pixels required to achieve high resolution display in the present invention is smaller, so that the number of the sub-pixels is decreased.
    Type: Grant
    Filed: July 20, 2015
    Date of Patent: May 1, 2018
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Lujiang Huangfu, Xiaodan Jin, Yinan Liang
  • Patent number: 9953457
    Abstract: A system, method, and computer program product are provided for performing path space filtering. In use, a set of light transport paths associated with a scene is sampled. Additionally, a plurality of vertices associated with the sampled set of light transport paths is selected, where each selected vertex has an associated throughput and light contribution. Further, an averaged light contribution of each of the selected plurality of vertices is determined, utilizing one or more weights. Further still, the averaged light contribution of each of the selected plurality of vertices is combined after multiplying the averaged light contribution of each of the selected vertices by the associated throughput of the vertex.
    Type: Grant
    Filed: January 28, 2014
    Date of Patent: April 24, 2018
    Assignee: NVIDIA Corporation
    Inventors: Alexander Keller, Ken Patrik Dahm, Nikolaus Binder
  • Patent number: 9952868
    Abstract: One embodiment of the present invention sets forth a graphics processing system. The graphics processing system includes a screen-space pipeline and a tiling unit. The screen-space pipeline is configured to perform visibility testing and fragment shading. The tiling unit is configured to determine that a first set of primitives overlaps a first cache tile. The tiling unit is also configured to first transmit the first set of primitives to the screen-space pipeline with a command configured to cause the screen-space pipeline to process the first set of primitives in a z-only mode, and then transmit the first set of primitives to the screen-space pipeline with a command configured to cause the screen-space pipeline to process the first set of primitives in a normal mode. In the z-only mode, at least some fragment shading operations are disabled in the screen-space pipeline. In the normal mode, fragment shading operations are enabled.
    Type: Grant
    Filed: October 1, 2013
    Date of Patent: April 24, 2018
    Assignee: NVIDIA Corporation
    Inventors: Ziyad S. Hakura, Jerome F. Duluk, Jr.
  • Patent number: 9947132
    Abstract: A material representation data structure and a method of representing a material for digital image synthesis. The data structure may be embodied in a graphics processing subsystem, including: (1) a memory configured to store a material representation data structure according to which a material is declaratively represented by a property indicative of an interaction between the material and light, and (2) a processor operable to gain access to the memory and employ the property in a rendering procedure defined independent of the material representation data structure and designed to effect the interaction.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: April 17, 2018
    Assignee: Nvidia Corporation
    Inventors: Lutz Kettner, Hakan Andersson, Michael Beck, Robert Hoedicke, Jan Jordan, Andy Kopra, Steven Parker, Matthias Raab, Daniel Seibert, Rajko Yasui-Schoeffel
  • Patent number: 9940018
    Abstract: A method for creating a boundless projected interactive virtual desktop, wherein the interactive virtual desktop comprises an adjustable image of a projected portion of an area associated with at least one desktop of a computing device is provided. The method may include integrating a projector and a motion sensor into a device. The method may also include capturing at least one of a location, a change in location, a change in direction, or a change in orientation associated with the device. The method may include computing a projected image. The method may also include coordinating the computed projected image across at least one application running in the device. The method may further include projecting a view of a portion of an area associated with the coordinated projected image, wherein the projected view comprises an interactive virtual desktop. The method may additionally include adjusting the projected view based on a criteria.
    Type: Grant
    Filed: August 18, 2015
    Date of Patent: April 10, 2018
    Assignee: International Business Machines Corporation
    Inventor: Jonathan F. Brunn
  • Patent number: 9939925
    Abstract: Example systems and methods of providing a user interface are presented. In one example, a graphical object is displayed on an opaque display component on a user-facing side of a computing device. Using a sensing component of the computing device, movement of a physical pointer controlled by a user is sensed. The physical pointer may be located opposite the user-facing side of the computing device. On the opaque display component, a representation of the physical pointer is displayed during the movement of the physical pointer. The graphical object, as displayed on the opaque display component, is modified based on the sensed movement of the physical pointer during the movement of the physical pointer.
    Type: Grant
    Filed: November 26, 2013
    Date of Patent: April 10, 2018
    Assignee: ADOBE SYSTEMS INCORPORATED
    Inventors: Daichi Ito, Nathan Carr, Naoki Sasaki
  • Patent number: 9933901
    Abstract: Systems, methods, and computer-readable media are provided for enabling efficient control of a media application at a media electronic device by a user electronic device, and, more particularly, for reducing perceived latency of and/or input response time to control data that may be provided by a user electronic device for a media application running on a media electronic device.
    Type: Grant
    Filed: August 24, 2015
    Date of Patent: April 3, 2018
    Assignee: APPLE INC.
    Inventors: Jacques P. Gasselin de Richebourg, Norman N. Wang, James J. Cwik
  • Patent number: 9934153
    Abstract: A patch memory system for accessing patches from a memory is disclosed. A patch is an abstraction that refers to a contiguous, array of data that is a subset of an N-dimensional array of data. The patch memory system includes a tile cache, and is configured to fetch data associated with a patch by determining one or more tiles associated with an N-dimensional array of data corresponding to the patch, and loading data for the one or more tiles from the memory into the tile cache. The N-dimensional array of data may be a two-dimensional (2D) digital image comprising a plurality of pixels. A patch of the 2D digital image may refer to a 2D subset of the image.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: April 3, 2018
    Assignee: NVIDIA Corporation
    Inventors: Jason Lavar Clemons, Chih-Chi Cheng, Daniel Robert Johnson, Stephen William Keckler, Iuri Frosio, Yun-Ta Tsai