Patents Examined by Haixia Du
  • Patent number: 11200722
    Abstract: Systems and methods for super sampling and viewport shifting of non-real time 3D applications are disclosed. In one embodiment, a graphics processing unit includes a processing resource to execute graphics commands to provide graphics for an application, a capture tool to capture the graphics commands, and a data generator to generate a dataset including at least one frame based on the captured graphics commands and to modify viewport settings for each frame of interest to generate a conditioned dataset.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: December 14, 2021
    Assignee: Intel Corporation
    Inventors: Joanna Douglas, Michal Taryma, Mario Garcia, Carlos Dominguez
  • Patent number: 11164283
    Abstract: A feature extractor determines reference feature locations from a portion of a reference image and corresponding feature locations from a portion of a warp image. A transform module determines a homography transform function that transforms versions of the corresponding feature locations to the reference feature locations. The homography transform function has an error below a threshold level, where the error represents a difference between the transformed corresponding feature locations and the reference feature locations. The local transform module generates transform parameters by processing the homography transform function. A warper circuit warps the portion of the warp image by at least applying the transform parameters to generate a portion of a warped image.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: November 2, 2021
    Assignee: Apple Inc.
    Inventors: Kaiming Liu, Maxim Smirnov, David R. Pope
  • Patent number: 11164240
    Abstract: Embodiments disclosed herein include virtual apparel fitting systems configured to perform methods comprising generating a first virtual garment carousel the includes images of garments. In operation, a user scrolling through the virtual garment carousel causes a graphical user interface to display images of the garments in the carousel superposed over an image of the user, thereby enabling the user to see how the garments would look on him or her, where virtual fit points of each garment image align with virtual fit points on the image of the user.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: November 2, 2021
    Assignee: SelfieStyler, Inc.
    Inventors: Kyle Mitchell, Julianne Applegate, Muhammad Ibrahim, Waqas Muddasir, Jeff Portaro, Dustin Ledo
  • Patent number: 11164359
    Abstract: Apparatus and method for encoding sub-primitives to improve ray tracing efficiency. For example, one embodiment of an apparatus comprises: a ray generator to generate a plurality of rays in a ray tracing graphics pipeline; a sub-primitive generator to subdivide each primitive of a plurality of primitives into a plurality of sub-primitives; a sub-primitive encoder to identify a first subset of the plurality of sub-primitives as being fully transparent and to identify a second subset of the plurality of sub-primitives as being fully opaque; and wherein the first subset of the plurality of primitives identified as being fully transparent are culled prior to further processing of each respective primitive.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: November 2, 2021
    Assignee: INTEL CORPORATION
    Inventor: Holger Gruen
  • Patent number: 11164357
    Abstract: A method, a computer-readable medium, and an apparatus are provided. The apparatus may be configured to receive information indicative of a fovea region. The apparatus may be configured to identify, based on the information indicative of the fovea region, high priority bins and low priority bins. The apparatus may be configured to determine a rendering time allotment for the frame. The apparatus may be configured to determine that the rendering time allotment for the frame will be exceeded, based on an amount of time used to render the high priority bins and the low priority bins. The apparatus may be configured to render, based on the determination that the rendering time allotment for the frame will be exceeded, at least one of the low priority bins at a first quality instead of a second quality.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: November 2, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Samuel Benjamin Holmes, Tate Hornbeck, Robert Vanreenen
  • Patent number: 11151788
    Abstract: Examples disclosed herein may involve (i) identifying, in a 3D point cloud representative of a real-world environment in which a vehicle was operating during a window of time, a set of 3D data points associated with an object detected in the environment that comprises different subsets of 3D data points corresponding to different capture times within the window of time, (ii) based at least on the 3D data points, evaluating a trajectory of the object and thereby determining that the object was in motion during some portion of the window of time, (iii) in response to determining that the object was in motion, reconstructing the different subsets of 3D data points into a single, assembled 3D representation of the object, and (iv) generating a time-aggregated, 3D visualization of the environment that presents the single, assembled 3D representation of the object at one or more points along the trajectory of the object.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: October 19, 2021
    Assignee: Woven Planet North America, Inc.
    Inventors: Rupsha Chaudhuri, Kumar Hemachandra Chellapilla, Tanner Cotant Christensen, Newton Ko Yue Der, Joan Devassy, Suneet Rajendra Shah
  • Patent number: 11139072
    Abstract: An embodiment of the invention may include a method, computer program product and computer system for three-dimensional medical image generation. The method, computer program product and computer system may include computing device which may receive a first three-dimensional medical image of a first patient from a first period of time, a two-dimensional medical image of the first patient from a second period of time and a plurality of three-dimensional medical images for a plurality of second patients. The computing device may input the three-dimensional medical image of the first patient, the two-dimensional medical image of the first patient and the plurality of three-dimensional medical images for a plurality of second patients into a generative adversarial network (GAN). The computing device may generate a synthetic three-dimensional medical image for the first patient based on the two-dimensional medical image from the second period of time utilizing the GAN.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: October 5, 2021
    Assignee: International Business Machines Corporation
    Inventors: Sun Young Park, Dustin Michael Sargent, James G. Thompson
  • Patent number: 11113438
    Abstract: A fluid simulating method includes extracting, based on positional information included in particle data of particles during a predetermined time period, a first particle with a predetermined value or less of distance from a fluid particle and a second particle with the predetermined value or less of distance from the first particle from among wall boundary particles related to a boundary with a wall. The method may also include setting a boundary condition of a pressure Poisson equation for calculating pressure to be applied to each of the particles, and calculating pressure to be applied to each of the particles, based on the extracted first particle and the extracted second particle. The method may also include calculating particle data of the particles during a next time period based on the calculated pressure.
    Type: Grant
    Filed: October 4, 2018
    Date of Patent: September 7, 2021
    Assignee: FUJITSU LIMTIED
    Inventors: Tamon Suwa, Masaki Kazama
  • Patent number: 11100602
    Abstract: Systems and methods for providing geometric interactions via three-dimensional mapping. A method includes determining a plurality of first descriptors for a plurality of key points in a plurality of first images, wherein each first image shows a portion of a 3D environment in which a robotic device and a visual sensor are deployed; generating a 3D map of the 3D environment based on the plurality of key points and the plurality of descriptors; determining a pose of the visual sensor based on at least one second descriptor and the plurality of first descriptors, wherein the second image is captured by the visual sensor; and determining a target action location based on at least one user input made with respect to a display of the second image and the pose of the visual sensor, wherein the target action location is a location within the 3D environment.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: August 24, 2021
    Assignee: R-GO Robotics LTD.
    Inventors: Nizan Horesh, Amir Bousani
  • Patent number: 11094100
    Abstract: An online system presents a content item to users and receives selections of reaction icons from the users. The online system generates a background animation with the selected reaction icons and a foreground animation to be layered on top of the background animation. The online system sends the background and foreground animations to a client device to be cached. Further, the online system presents the content item to a viewing user associated with the client device and receives a selection of a reaction icon from the viewing user. The online system selects a subset of the users based on the viewing user's affinity to the users, retrieves images of the selected users, and send the images to the client device. The client device customizes the background and foreground animations based on the images and the viewing user's reaction icon to generate a compound animation for display to the viewing user.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: August 17, 2021
    Assignee: Facebook, Inc.
    Inventors: Robert Benson Walton, Zachary W. Stubenvoll, Julia Harter Toffey, Skyler Bock, Silvia Chyou, Jordan Richard Honnette, Wei-Sheng Su, Jerod Wanner, Stefan Casey Parker, Renyu Liu, Rajat Bhardwaj
  • Patent number: 11087530
    Abstract: A method and system for providing access to and control of parameters within a scenegraph includes redefining components or nodes' semantic within a scenegraph. The set of components or nodes (depending on the scenegraph structure) are required to enable access from the Application User Interface to selected scenegraph information. In one embodiment, a user interface is generated for controlling the scenegraph parameters. In addition, constraints can be implemented that allow or disallow access to certain scenegraph parameters and restrict their range of values.
    Type: Grant
    Filed: June 3, 2019
    Date of Patent: August 10, 2021
    Assignee: GRASS VALLEY CANADA
    Inventors: Ralph Andrew Silberstein, David Sahuc, Donald Johnson Childers
  • Patent number: 11087523
    Abstract: A computer-implemented method and system provide the ability to draw a feature line on an image. An image is acquired and is represented as a set of pixel samples for every pixel in the image, with each pixel sample including one or more feature attributes. One or more features are detected based on differences between the feature attributes. The detected features are represented by pixel samples. A color of the pixel samples representing the detected features is altered. The image is rendered based on the pixel samples including the altered color, and the feature line includes the altered color.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: August 10, 2021
    Assignee: AUTODESK, INC.
    Inventors: Shinji Ogaki, Iliyan Georgiev
  • Patent number: 11080918
    Abstract: There is provided a computer implemented method for predicting garment or accessory attributes using deep learning techniques, comprising the steps of: (i) receiving and storing one or more digital image datasets including images of garments or accessories; (ii) training a deep model for garment or accessory attribute identification, using the stored one or more digital image datasets, by configuring a deep neural network model to predict (a) multiple-class discrete attributes; (b) binary discrete attributes, and (c) continuous attributes, (iii) receiving one or more digital images of a garment or an accessory, and (iv) extracting attributes of the garment or the accessory from the one or more received digital images using the trained deep model for garment or accessory attribute identification. A related system is also provided.
    Type: Grant
    Filed: May 25, 2017
    Date of Patent: August 3, 2021
    Assignee: METAIL LIMITED
    Inventors: Yu Chen, Sukrit Shankar, Jim Downing, Joe Townsend, Duncan Robertson, Tom Adeyoola
  • Patent number: 11076142
    Abstract: Provided is a real-time aliasing rendering method for a 3D VR video and a virtual three-dimensional scene, including: capturing 3D camera video signals in real time and process the same to generate texture data; creating a virtual three-dimensional scene according to the proportion of a real scene; generating virtual camera rendering parameters according to a physical position of the 3D camera and a shooting angle relationship; aliasing the texture data onto a virtual three-dimensional object in a virtual scene, and adjusting the position of the virtual three-dimensional object according to a physical positional relationship between the virtual three-dimensional scene and the real scene, so as to form a complete virtual reality combined three-dimensional scene; rendering the virtual reality combined three-dimensional scene by using the virtual camera rendering parameters to obtain a simulated rendering picture.
    Type: Grant
    Filed: September 4, 2017
    Date of Patent: July 27, 2021
    Assignee: IDEAPOOL CULTURE & TECHNOLOGY CO., LTD.
    Inventor: Bin Cheng
  • Patent number: 11069134
    Abstract: Methods, systems, and computer program products for removing unused portions of a 3D mesh representation of an object may include generating a first mesh representation of the object, the first mesh representation including a plurality of polygons, respective ones of the polygons including at least three vertices and at least three edges, wherein respective ones of the plurality of polygons are associated with a precision value that indicates an extent to which the respective ones of the plurality of polygons in the first mesh representation match the object, and adjusting the first mesh representation of the object to create a second mesh representation of the object by removing, front the first mesh representation, polygons of the plurality of polygons that are associated with precision values that have not been modified from an initial precision value.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: July 20, 2021
    Assignee: Sony Group Corporation
    Inventors: Pal Szasz, Johannes Elg, Fredrik Olofsson, Lars Novak, Fredrik Mattisson
  • Patent number: 11069111
    Abstract: Methods, devices, media, and other embodiments are described for generating pseudorandom animations matched to audio data on a device. In one embodiment a video is generated and output on a display of the device using a computer animation model. Audio is detected from a microphone of the device, and the audio data is processed to determine a set of audio characteristics for the audio data received at the microphone of the device. A first motion state is randomly selected from the plurality of motion states, one or more motion values of the first motion state are generated using the set of audio characteristics, and the video is updated using the one or more motion values with the computer animation model to create an animated action within the video.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: July 20, 2021
    Assignee: Snap Inc.
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Patent number: 11069113
    Abstract: A method for creating a computer simulation of a crowd by animating a plurality of virtual actors simultaneously with each virtual actor set to a different setting of parameters and therefore expressing a unique individual body posture. An apparatus for creating a computer simulation of an actor by depicting the actor based on a plurality of postural parameters of the actor. A method for creating a computer simulation of an actor by having the actor move subject to a first idiomatic behavior for a first set of a plurality of successive key frames, and transitioning the actor to move to a second idiomatic behavior for a second set of a plurality of successive key frames.
    Type: Grant
    Filed: May 17, 2018
    Date of Patent: July 20, 2021
    Inventor: Kenneth Perlin
  • Patent number: 11043024
    Abstract: The present application discloses a method, apparatus, and storage medium for processing an image in a virtual reality system. The method comprises: splitting an image to be rendered at a first timing in the virtual reality system into a first region and a second region; rendering the first region of the image to be rendered according to first gesture data of a user at the first timing; rendering the second region of the image to be rendered according to second gesture data at a second timing at the end of the rendering of the first region.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: June 22, 2021
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yakun Wang, Lin Lin, Jian Sun, Ziqiang Guo, Jiyang Shao, Binhua Sun, Feng Zi, Bingxin Liu, Yadong Ding
  • Patent number: 11037356
    Abstract: A system and method for performing non-graphical algorithm calculations on a GPU (graphics processing unit), by adapting the non-graphical algorithm to be executed according to the texture mapping calculation functions of the GPU, for example within the Web Browser environment. The non-graphical algorithm preferably relates to comparison of a plurality of data points. Each data point may relate to any unit of information, including but not limited to a document (for a document comparison algorithm), information about movements of a unit (for a collision detection algorithm), determination of interactions between two more nodes on a graph, such as for example and without limitation, determining such interactions in a social media channel.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: June 15, 2021
    Assignee: ZIGNAL LABS, INC.
    Inventors: Alex Smith, Andras Benke, Jonathan R. Dodson, Michael Kramer, Fabien Vives, Adam Beaugh, Christopher Miller
  • Patent number: 11024262
    Abstract: An electronic device is provided. The electronic device includes a display for outputting a screen and a processor operatively connected to the display. The processor is configured to receive a user input associated with movement of a screen output on the display, detect a screen movement speed corresponding to the user input associated with the screen movement, determine an amount of screen tilt compensation corresponding to the screen movement based on the screen movement speed, when the screen movement speed is included in a first interval, and keep the amount of screen tilt compensation based on the screen movement speed constant, when the screen movement speed is included in a second interval faster than the first interval.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: June 1, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jaesung Lee, Jiyong Kim, Jinhyun Kim, Taehyeong Kim, Jungbae Bae, Jongkon Bae, Byungduk Yang, Yohan Lee, Dongkyoon Han, Yunpyo Hong