Patents Examined by Ke Xiao
  • Patent number: 10896524
    Abstract: There is provided a system and method for color representation generation. In an aspect, the method includes: receiving three base colors; receiving a patchwork parameter; and generating a color representation having each of the three base colors at a vertex of a triangular face, the triangular face having a color distribution therein, the color distribution discretized into discrete portions, the amount of discretization based on the patchwork parameter, each discrete portion having an interpolated color determined to be a combination of the base colors at respective coordinates of such discrete portion. In further aspects, one or more color representations are generated based on an input image and can be used to modify colors of a reconstructed image.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: January 19, 2021
    Assignee: THE GOVERNING COUNCIL OF THE UNIVERSITY OF TORONTO
    Inventors: Maria Shugrina, Amlan Kar, Sanja Fidler, Karan Singh
  • Patent number: 10891773
    Abstract: An apparatus and method are described for allocating local memories to virtual machines. For example, one embodiment of an apparatus comprises: a command streamer to queue commands from a plurality of virtual machines (VMs) or applications, the commands to be distributed from the command streamer and executed by graphics processing resources of a graphics processing unit (GPU); a tile cache to store graphics data associated with the plurality of VMs or applications as the commands are executed by the graphics processing resources; and tile cache allocation hardware logic to allocate a first portion of the tile cache to a first VM or application and a second portion of the tile cache to a second VM or application; the tile cache allocation hardware logic to further allocate a first region in system memory to store spill-over data when the first portion of the tile cache and/or the second portion of the file cache becomes full.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: January 12, 2021
    Assignee: Intel Corporation
    Inventors: Joydeep Ray, Abhishek R. Appu, Pattabhiraman K, Balaji Vembu, Altug Koker, Niranjan L. Cooray, Josh B. Mastronarde
  • Patent number: 10885697
    Abstract: One embodiment of the present disclosure presents a technique for generating an augmented reality effect. The technique includes receiving first input data including an image of a face. The technique further includes, based on the first input data, generating a first intermediate texture corresponding to an eyelid of the face with make-up. The technique further includes, based on the first input data, generating a second intermediate texture corresponding to the eyelid of the face without make-up. The technique also includes generating an output texture based on the first intermediate texture and the second intermediate texture. The technique further includes generating an effect by applying the output texture to second input data corresponding to a second image of a second face.
    Type: Grant
    Filed: December 12, 2018
    Date of Patent: January 5, 2021
    Assignee: Facebook, Inc.
    Inventors: Srinidhi Viswanathan, Ian Erik Smith Heisters, Bruno Pereira Evangelista, Jennifer Dolson, Alexandra Louise Krakaris
  • Patent number: 10878771
    Abstract: An electronic device includes a deformable housing and a flexible display supported by the deformable housing. One or more flex sensors supported by the deformable housing detect the electronic device is deformed at a deformation portion to partition the flexible display into a first portion and a second portion. One or more processors present content on the first portion of the flexible display in response to detecting the flexible display being deformed, and remediate the second portion of the flexible display to compensate performance degradation of the flexible display resulting from presenting content on the first portion of the flexible display.
    Type: Grant
    Filed: July 13, 2016
    Date of Patent: December 29, 2020
    Assignee: Motorola Mobility LLC
    Inventors: Xiaodong Xun, Ye Yang
  • Patent number: 10878177
    Abstract: Improved techniques are presented for generating stereoscopic image of 2D web pages. In accordance with an exemplary embodiment, a stereo-enhancing annotation tool is provided and used to generate intermediate HTML source code. The intermediate HTML source code—together with the normal HTML code that is served when a user's browser makes a URL call—are used by a computer processing unit to generate stereoscopic images. Algorithms optimize the look and feel of stereoscopically-imaged web-page content using a number of known presentation optimized parameters that are automatically determined based on a priori assumptions of depth cues.
    Type: Grant
    Filed: January 21, 2019
    Date of Patent: December 29, 2020
    Assignee: EQULDO LIMITED
    Inventors: Dimitrios Andriotis, Ioannis Paliokas, Athanasios Tsakiris
  • Patent number: 10873741
    Abstract: The present disclosure relates to an image processing apparatus and method, and specifically relates to an image processing apparatus and method which can improve convenience of a service using a multi-viewpoint image. An image processing apparatus includes a virtual captured image generation unit which generates, by using multi-viewpoint image data, depth data showing a distance to a photographic subject in the multi-viewpoint image, and profile information including a parameter which reproduces an optical effect by a virtual optical system, a virtual captured image obtained by capturing the photographic subject of the multi-viewpoint image by using the virtual optical system. The present disclosure can be applied, for example, to the image processing apparatus.
    Type: Grant
    Filed: July 22, 2019
    Date of Patent: December 22, 2020
    Assignee: SONY CORPORATION
    Inventors: Kengo Hayasaka, Hironori Mori, Katsuhisa Ito
  • Patent number: 10872582
    Abstract: Systems and methods are described for adjusting the color spectrum of synthetic objects in augmented reality (AR) displays under varying lighting conditions and a human observers spectral sensitivities, to produce customized color matches for a specific observer. Spectral data may be captured, and color matching functions (CMFs) of the observer may be used by a spectral color workflow that produces color display values, for example coordinates in RGB space. The color rendering may custom-match for multiple observers with different color perceptions under a wide range of environmental (ambient lighting) conditions.
    Type: Grant
    Filed: February 20, 2019
    Date of Patent: December 22, 2020
    Assignee: Vid Scale, Inc.
    Inventor: David Wyble
  • Patent number: 10867362
    Abstract: Methods, apparatus, systems, and articles of manufacture are disclosed to improve operation of a graphics processing unit (GPU). An example apparatus includes an instruction generator to insert profiling instructions into a GPU kernel to generate an instrumented GPU kernel, the instrumented GPU kernel is to be executed by a GPU, a trace analyzer to generate an occupancy map associated with the GPU executing the instrumented GPU kernel, a parameter calculator to determine one or more operating parameters of the GPU based on the occupancy map, and a processor optimizer to invoke a GPU driver to adjust a workload of the GPU based on the one or more operating parameters.
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: December 15, 2020
    Assignee: INTEL CORPORATION
    Inventors: Konstantin Levit-Gurevich, Michael Berezalsky, Noam Itzhaki, Arik Narkis, Orr Goldman
  • Patent number: 10853907
    Abstract: Systems, methods, and computer readable media to improve task switching operations in a graphics processing unit (GPU) are described. As disclosed herein, the clock rate (and voltages) of a GPU's operating environment may be altered so that a low priority task may be rapidly run to a task switch boundary (or completion) so that a higher priority task may begin execution. In some embodiments, only the GPU's operating clock (and voltage) is increased during the task switch operation. In other embodiments, the clock rate (voltages) of supporting components may also be increased. For example, the operating clock for the GPU's supporting memory, memory controller or memory fabric may also be increased. Once the lower priority task has been swapped out, one or more of the clocks (and voltages) increased during the switch operation could be subsequently decreased, though not necessarily to their pre-switch rates.
    Type: Grant
    Filed: July 15, 2019
    Date of Patent: December 1, 2020
    Assignee: Apple Inc.
    Inventors: Tatsuya Iwamoto, Kutty Banerjee, Rohan Sanjeev Patil
  • Patent number: 10853974
    Abstract: A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes receiving a compressed bitstream. The method also includes decoding the compressed bitstream into 2-D frames that represent a 3-D point cloud. Each of the 2-D frames including a set of patches, and each patch includes a cluster of points of the 3-D point cloud. The cluster of points corresponds to an attribute associated with the 3-D point cloud. One patch of the set of patches, the set of patches, and the 2-D frames correspond to respective access levels representing the 3-D point cloud. The method also includes identifying a first and a second flag. In response to identifying the first and the second flag, the method includes reading the metadata from the bitstream. The method further includes generating, based on metadata and using the sets of 2-D frames, the 3-D point cloud.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: December 1, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Esmaeil Faramarzi, Rajan Joshi, Hossein Najaf-Zadeh
  • Patent number: 10832484
    Abstract: Provided is a method, computer program product, and virtual reality system for applying an individualized risk tolerance threshold to external risks during a virtual reality simulation. A processor may receive event data from one or more devices communicatively coupled to a virtual reality device. The processor may compare the event data to a risk tolerance threshold specifically generated for a first user. In response to the risk tolerance threshold being met, the processor may push a notification to the virtual reality device indicating a potential risk to the first user has been determined.
    Type: Grant
    Filed: May 9, 2019
    Date of Patent: November 10, 2020
    Assignee: International Business Machines Corporation
    Inventors: Zachary A. Silverstein, Trudy L. Hewitt, Jeremy R. Fox, Robert Huntington Grant
  • Patent number: 10831436
    Abstract: A beacon device is a mobile object having an AR marker provided on its surface which indicates an existing position of the beacon device in actual space and transmits a beacon signal including a beacon ID. A user communication device, which is a mobile object equipped with an imaging function, identifies the position of the beacon device by recognizing the AR marker in a live view image, receives the beacon signal transmitted from the beacon device, transmits the beacon ID to a server device and controls to display an object corresponding to the beacon ID transmitted from the server device at the identified position of the beacon device in the live view image. The server device reads out the object corresponding to the beacon ID transmitted from the user communication device from a character data file group and transmits that data to the user communication device.
    Type: Grant
    Filed: August 28, 2017
    Date of Patent: November 10, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Tsukasa Sueki, Koji Yamamoto, Shosaku Suzuki
  • Patent number: 10825422
    Abstract: A display where water is applied onto the screen of a visual display monitor and graphics are presented on the display that coincides with the applied water is described. The timing of the water being applied to the screen and the playing of the graphics may be orchestrated such that the applied water seems to create the presented graphics. A controller may be used to control the water and the display.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: November 3, 2020
    Assignee: WET
    Inventors: Mark W. Fuller, James W. Doyle, Gautam Rangan, John Canavan
  • Patent number: 10810797
    Abstract: Systems and methods for generating and animating virtual representations to a wearer of a HMD device are disclosed. A virtual representation associated with a real-world object is retrieved based on received input data. The retrieved virtual representation is rendered for display to the wearer. Sensor data tracking one or more of the real-world object and the wearer is also received. The rendered virtual representation can be further animated based on the sensor data.
    Type: Grant
    Filed: May 22, 2015
    Date of Patent: October 20, 2020
    Assignee: OTOY, INC
    Inventors: Julian Michael Urbach, Nicolas Lazareff, Clay Sparks
  • Patent number: 10803626
    Abstract: Systems and techniques for a large scale online lossless animated GIF processor are described herein. In an example, a lossless animated GIF processor is adapted to receive an animated GIF image and decode a first and second frame of the animated GIF image, wherein the decoding identifies a disposal method for each frame. The lossless animated GIF processor may determine an optimized disposal method for the second frame based on transparency pixels in the second frame and an overlap estimation between the second frame and the first frame. The lossless animated GIF processor may encode the second frame with the optimized disposal method. The lossless animated GIF processor may be further adapted to identify pixels in an area of interest, designate pixels outside the area of interest as transparent, and encode the area of interest and the pixels designated as transparent for the second frame.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: October 13, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yurong Jiang, Ivaylo G. Dimitrov, Sining Ma, Si Lao
  • Patent number: 10794047
    Abstract: Provided is a display system including: a display unit which displays an image; a vehicle body position data acquisition unit which acquires vehicle body position data indicating a position of a vehicle body supporting a work machine; a process position data storage unit which stores process position data indicating a process position of a process target processed by the work machine; and a display controller which displays an image indicating the process position based on the process position data and an image indicating a specific position of the vehicle body on the display unit.
    Type: Grant
    Filed: July 13, 2016
    Date of Patent: October 6, 2020
    Assignee: KOMATSU LTD.
    Inventors: Daiki Arimatsu, Yuki Shimano, Takeshi Takaura, Jason Anetsberger
  • Patent number: 10783690
    Abstract: Systems and methods for image retargeting are provided. Image data may be acquired that includes motion capture data indicative of motion of a plurality of markers disposed on a surface of a first subject. Each of the markers may be associated with a respective location on the first subject. A plurality of blendshapes may be calculated for the motion capture data based on a configuration of the markers. An error function may be identified for the plurality of blendshapes, and it may be determined that the plurality of blendshapes can be used to retarget a second subject based on the error function. The plurality of blendshapes may then be applied to a second subject to generate a new animation.
    Type: Grant
    Filed: March 6, 2018
    Date of Patent: September 22, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
    Inventors: Mark Andrew Sagar, Tim Szu-Hsien Wu, Frank Filipe Bonniwell, Homoud B. Alkouh, Colin Joseph Hodges
  • Patent number: 10769850
    Abstract: Computer-implemented systems and methods for updating a polygonal mesh representation of a model are provided. A model comprises a set of topologies, and a meshing state is maintained for each topology of the set of topologies. The meshing state indicates, for a given topology, whether a polygonal mesh exists and is valid. A change made to the model is determined, where the change comprises a modification to a geometry of the model or a modification to mesh settings of a polygonal mesh representation of the model. One or more topologies of the set of topologies that are affected by the change are determined, and the meshing state for the affected one or more topologies is updated. Based on the one or more updated meshing states, a set of meshing operations needed to bring the polygonal mesh representation of the model up-to-date is determined.
    Type: Grant
    Filed: February 12, 2018
    Date of Patent: September 8, 2020
    Assignee: Ansys, Inc.
    Inventors: Frank DeSimone, Vivek J. Joshi, Joseph Borella, John Svitek, Mukesh Bauskar, James West, Jitendra Kulkarni
  • Patent number: 10762703
    Abstract: A method for visualizing 3D image data of a 3D sensor (10) with a plurality of 3D points which form a lateral 2D arrangement with a respective depth value, wherein connected segments (32) are formed from connected 3D points and the segments (32) are displayed, and wherein two respective 3D points are connected in the same segment (32) if they are laterally adjacent and also differ in their depth value by at most a depth threshold (z).
    Type: Grant
    Filed: May 21, 2019
    Date of Patent: September 1, 2020
    Assignee: SICK AG
    Inventors: Davide Impera, Thomas Neumann
  • Patent number: 10762695
    Abstract: Rendering shadows of transparent objects using ray tracing in real-time is disclosed. For each pixel in an image, a ray is launched towards the light source. If the ray intersects a transparent object, lighting information (e.g., color, brightness) is accumulated for the pixel. A new ray is launched from the point of intersection, either towards the light source or in a direction based on reflection/refraction from the surface. Ray tracing continues recursively, accumulating lighting information at each transparent object intersection. Ray tracing terminates when a ray intersects an opaque object, indicating a dark shadow. Ray tracing also terminates when a ray exits the scene without intersecting an object, where the accumulated lighting information is used to render a shadow for the pixel location. Soft shadows can be rendered using the disclosed technique by launching a plurality of rays in different directions based on a size of the light source.
    Type: Grant
    Filed: February 21, 2019
    Date of Patent: September 1, 2020
    Assignee: Electronic Arts Inc.
    Inventor: Karl Henrik Halén