Patents Examined by Tize Ma
  • Patent number: 11756263
    Abstract: A box modeling method and apparatus, a robot picking system, an electronic device and a medium, the method comprising: acquiring first 3D point cloud information of a box (S302); determining a first point of the box according to box parameters and the first 3D point cloud information (S304); performing a calculation to the first point and the first 3D point cloud information by using a ray method so as to generate a first minimum bounding rectangle (S306); and modeling the box according to the first minimum bounding rectangle and the box parameters (S308).
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: September 12, 2023
    Assignee: BEIJING JINGDONG QIANSHI TECHNOLOGY CO., LTD.
    Inventors: Baocheng Wan, Weifeng Liu, Xu Liu, Kai Cao
  • Patent number: 11756223
    Abstract: The methods and systems described herein provide for depth-aware image editing and interactive features. In particular, a computer application may provide image-related features that utilize a combination of a (a) the depth map, and (b) segmentation data to process one or more images, and generate an edited version of the one or more images.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: September 12, 2023
    Assignee: Google LLC
    Inventors: Tim Phillip Wantland, Brandon Charles Barbello, Christopher Max Breithaupt, Michael John Schoenberg, Adarsh Prakash Murthy Kowdle, Bryan Woods, Anshuman Kumar
  • Patent number: 11748855
    Abstract: Disclosed is a signal processing device and an image display apparatus including the same. The signal processing device and the image display apparatus comprise: a first reduction unit to receive a image signal and reduce noise of the received image signal, and a second reduction unit to perform grayscale amplification based on the image signal from the first reduction unit, wherein the second reduction unit is configured to perform the grayscale amplification so that upper-limit level of grayscale of the image signal from the first reduction unit is greater than upper-limit level of grayscale of an OSD signal. Accordingly, OSD area may be uniformly displayed regardless of ambient luminance.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: September 5, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Kyeongryeol Park, Jongchan Kim, Jeonghyu Yang
  • Patent number: 11734890
    Abstract: A three-dimensional (3D) model of an object is recovered from two-dimensional (2D) images of the object. Each image in the set of 2D images includes the object captured from a different camera position and deformations of a base mesh that defines the 3D model may be computed corresponding to each image. The 3D model may also include a texture map that represents the lighting and material properties of the 3D model. Recovery of the 3D model relies on analytic antialiasing to provide a link between pixel colors in the 2D images and geometry of the 3D model. A modular differentiable renderer design yields high performance by leveraging existing, highly optimized hardware graphics pipelines to reconstruct the 3D model. The differential renderer renders images of the 3D model and differences between the rendered images and reference images are propagated backwards through the rendering pipeline to iteratively adjust the 3D model.
    Type: Grant
    Filed: February 15, 2021
    Date of Patent: August 22, 2023
    Assignee: NVIDIA Corporation
    Inventors: Samuli Matias Laine, Janne Johannes Hellsten, Tero Tapani Karras, Yeongho Seol, Jaakko T. Lehtinen, Timo Oskari Aila
  • Patent number: 11727535
    Abstract: In examples, threads of a schedulable unit (e.g., a warp or wavefront) of a parallel processor may be used to sample visibility of pixels with respect to one or more light sources. The threads may receive the results of the sampling performed by other threads in the schedulable unit to compute a value that indicates whether a region corresponds to a penumbra (e.g., using a wave intrinsic function). Each thread may correspond to a respective pixel and the region may correspond to the pixels of the schedulable unit. A frame may be divided into the regions with each region corresponding to a respective schedulable unit. In denoising ray-traced shadow information, the values for the regions may be used to avoid applying a denoising filter to pixels of regions that are outside of a penumbra while applying the denoising filter to pixels of regions that are within a penumbra.
    Type: Grant
    Filed: January 14, 2021
    Date of Patent: August 15, 2023
    Assignee: NVIDIA Corporation
    Inventor: Pawel Kozlowski
  • Patent number: 11715260
    Abstract: Provided are an offline teaching device and a measurement control device. The offline teaching device detects a shape of a measured object by a three-dimensional sensor unit, generates measurement procedure information in which measurement items are respectively associated with measurement points sequentially specified to the detected shape, and causes a measurement procedure information storage unit to store the measurement procedure information associated.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: August 1, 2023
    Assignee: MITUTOYO CORPORATION
    Inventors: Shinsaku Abe, Hideyuki Kusanagi
  • Patent number: 11710272
    Abstract: An image processing system includes a computing platform having processing hardware, a display, and a system memory storing a software code. The processing hardware executes the software code to receive a digital object, surround the digital object with virtual cameras oriented toward the digital object, render, using each one of the virtual cameras, a depth map identifying a distance of that one of the virtual cameras from the digital object, and generate, using the depth map, a volumetric perspective of the digital object from a perspective of that one of the virtual cameras, resulting in multiple volumetric perspectives of the digital object. The processing hardware further executes the software code to merge the multiple volumetric perspectives of the digital object to form a volumetric representation of the digital object, and to convert the volumetric representation of the digital object to a renderable form.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: July 25, 2023
    Assignee: Disney Enterprises, Inc.
    Inventors: Dane M. Coffey, Siroberto Scerbo, Daniel L. Baker, Mark R. Mine, Evan M. Goldberg
  • Patent number: 11704865
    Abstract: This disclosure describes methods, non-transitory computer readable storage media, and systems that generate realistic shading for three-dimensional objects inserted into digital images. The disclosed system utilizes a light encoder neural network to generate a representation embedding of lighting in a digital image. Additionally, the disclosed system determines points of the three-dimensional object visible within a camera view. The disclosed system generates a self-occlusion map for the digital three-dimensional object by determining whether fixed sets of rays uniformly sampled from the points intersects with the digital three-dimensional object. The disclosed system utilizes a generator neural network to determine a shading map for the digital three-dimensional object based on the representation embedding of lighting in the digital image and the self-occlusion map.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: July 18, 2023
    Assignee: Adobe Inc.
    Inventors: Ruben Villegas, Yunseok Jang, Duygu Ceylan Aksit, Jimei Yang, Xin Sun
  • Patent number: 11704871
    Abstract: A method of garment deformation based on Laplacian deformation of a human body, including the following steps: inputting polygonal mesh models of the human body and the garment; discretizing non-homogeneous mesh models of the human body and the garment inputted in the first step; clustering all the discretized mesh vertices, to reduce a number of vertices and to form a set of homogeneous discrete vertices; constructing Laplacian matrices of the human body and the garment; preprocessing and solving inverse matrices; editing by using the human body mesh as a control vertex, to drive a real-time smooth deformation of the garment mesh; and mapping a deformed and simplified mesh back to a mesh space of an original resolution to obtain deformed human body and garment mesh models.
    Type: Grant
    Filed: November 5, 2021
    Date of Patent: July 18, 2023
    Assignee: SHANGHAI LINCTEX DIGITAL TECHNOLOGY CO, LTD.
    Inventors: Likang Luo, Luyuan Wang, Xiaogang Jing, Chen Liu, Ninghai Huang, Zexi Shao
  • Patent number: 11679616
    Abstract: A method for producing a hologram (1), (1) for security elements (1a) and/or security documents (1b). One or more virtual hologram planes (10) are arranged in front of and/or behind one or more virtual models (20) and/or one or more virtual hologram planes (10) are arranged such that they intersect one or more virtual models (20). One or more virtual light sources (30) are arranged on one or more partial regions of the surface (21) of one or more of the virtual models (20). One or more virtual electromagnetic fields (40) are calculated starting from at least one of the virtual light sources (30) in one or more zones (11) of the one or more virtual hologram planes (10). In the one or more zones (11), in each case, a virtual total electromagnetic field (41) is calculated on the basis of the sum of two or more, of the virtual electromagnetic fields (40) in the respective zone (11). One or more phase images (50) are calculated from the virtual total electromagnetic fields (41) in the one or more zones (11).
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: June 20, 2023
    Assignee: OVD Kinegram AG
    Inventors: Sebastian Mader, Harald Walter, Corrado Fraschina
  • Patent number: 11682142
    Abstract: Subject matter regards colorizing a three-dimensional (3D) point set. A method of colorizing a 3D point can include voxelizing 3D points including the 3D point into voxels such that a voxel of the voxels including the 3D point includes a voxel subset of the 3D points, projecting the voxel subset to respective image spaces of first and second images used to generate the 3D points, and associating a color value, determined based on a respective number of pixels of the first and second images to which the voxel subset projects, with the 3D point.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: June 20, 2023
    Assignee: Raytheon Company
    Inventors: Stephen J. Raif, Allen Hainline
  • Patent number: 11682158
    Abstract: Foveated rendering for rendering an image uses a ray tracing technique to process graphics data for a region of interest of the image, and a rasterisation technique is used to process graphics data for other regions of the image. A rendered image can be formed using the processed graphics data for the region of interest of the image and the processed graphics data for the other regions of the image. The region of interest may correspond to a foveal region of the image. Ray tracing naturally provides high detail and photo-realistic rendering, which human vision is particularly sensitive to in the foveal region; whereas rasterisation techniques are suited for providing temporal smoothing and anti-aliasing in a simple manner, and is therefore suited for use in the regions of the image that a user will see in the periphery of their vision.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: June 20, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Steven Blackmon, Luke T. Peterson, Cuneyt Ozdas, Steven J. Clohset
  • Patent number: 11645363
    Abstract: In example embodiments, techniques are provided to automatically identify misclassified elements of an infrastructure model using machine learning. In a first set of embodiments, supervised machine learning is used to train one or more classification models that use different types of data describing elements (e.g., a geometric classification model that uses geometry data, a natural language processing (NLP) classification model that uses textual data, and an omniscient (Omni) classification model that uses a combination of geometry and textual data; or a single classification model that uses geometry data, textual data, and a combination of geometry and textual data). Predictions from classification models (e.g., predictions from the geometric classification model, NLP classification model and the Omni classification model) are compared to identify misclassified elements, or a prediction of misclassified elements directly produced (e.g., from the single classification model).
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: May 9, 2023
    Assignee: Bentley Systems, Incorporated
    Inventors: Karl-Alexandre Jahjah, Hugo Bergeron, Marc-André Lapointe, Kaustubh Page, Evan Rausch-Larouche
  • Patent number: 11645813
    Abstract: Techniques are disclosed for creating digital faces. In some examples, an anatomical face model is generated from a data set including captured facial geometries of different individuals and associated bone geometries. A model generator segments each of the captured facial geometries into patches, compresses the segmented geometry associated with each patch to determine local deformation subspaces of the anatomical face model, and determines corresponding compressed anatomical subspaces of the anatomical face model. A sculpting application determines, based on sculpting input from a user, constraints for an optimization to determine parameter values associated with the anatomical face model. The parameter values can be used, along with the anatomical face model, to generate facial geometry that reflects the sculpting input.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: May 9, 2023
    Assignees: DISNEY ENTERPRISES, INC., ETH ZÜRICH (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)
    Inventors: Aurel Gruber, Marco Fratarcangeli, Derek Edward Bradley, Gaspard Zoss, Dominik Thabo Beeler
  • Patent number: 11631213
    Abstract: Forming a 3D representation of an object using a portable electronic device with a camera. A sequence of image frames, captured with the camera may be processed to generate 3D information about the object. This 3D information may be used to present a visual representation of the object as real-time feedback to a user, indicating confidence of 3D information for regions of the object. Feedback may be a composite image based on surfaces in a 3D model derived from the 3D information given visual characteristics derived from the image frames. The 3D information may be used in a number of ways, including as an input to a 3D printer or an input, representing, in whole or in part, an avatar for a game or other purposes. To enable processing to be performed on a portable device, a portion of the image frames may be selected for processing with higher resolution.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: April 18, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Erik Fonseka, Alexander Ilic
  • Patent number: 11615590
    Abstract: A method of producing surface data from electronic polygonal data is disclosed. The method includes accessing the polygonal data with a computer, the polygonal data defining a mesh of polygonal data points and including a plurality of vertices, and where the polygonal data describes an object. The method also includes generating a plurality of bounded areas, each including one or more vertices of the polygonal data, expanding a plurality of the bounded areas by adding a plurality of vertices thereto, generating a surface for each of the expanded bounded areas based on the vertices of the expanded bounded areas, generating the surface data based at least in part on the surfaces, and storing the surface data in a computer readable data storage.
    Type: Grant
    Filed: May 25, 2019
    Date of Patent: March 28, 2023
    Assignee: IntegrityWare, Inc.
    Inventor: Gary Arnold Crocker
  • Patent number: 11605197
    Abstract: An embodiment of a parallel processor apparatus may include a sample pattern selector to select a sample pattern for a pixel, and a sample pattern subset selector communicatively coupled to the sample pattern selector to select a first subset of the sample pattern for the pixel corresponding to a left eye display frame and to select a second subset of the sample pattern for the pixel corresponding to a right eye display frame, wherein the second subset is different from the first subset. Other embodiments are disclosed and claimed.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: March 14, 2023
    Assignee: Intel Corporation
    Inventors: Nikos Kaburlasos, Joydeep Ray, John H. Feit, Travis T. Schluessler, Jacek Kwiatkowski, Philip R. Laws
  • Patent number: 11587281
    Abstract: A graphics processor architecture provides for scan conversion and ray tracing approaches to visible surface determination as concurrent and separate processes. Surfaces can be identified for shading by scan conversion and ray tracing. Data produced by each can be normalized, so that instances of shaders, being executed on a unified shading computation resource, can shade surfaces originating from both ray tracing and rasterization. Such resource also may execute geometry shaders. The shaders can emit rays to be tested for intersection by the ray tracing process. Such shaders can complete, without waiting for those emitted rays to complete. Where scan conversion operates on tiles of 2-D screen pixels, the ray tracing can be tile aware, and controlled to prioritize testing of rays based on scan conversion status. Ray population can be controlled by feedback to any of scan conversion, and shading.
    Type: Grant
    Filed: January 11, 2021
    Date of Patent: February 21, 2023
    Assignee: Imagination Technologies Limited
    Inventors: John W. Howson, Luke Tilman Peterson, Steven J. Clohset
  • Patent number: 11580675
    Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: February 14, 2023
    Assignee: Adobe Inc.
    Inventors: Gwendal Simon, Viswanathan Swaminathan, Nathan Carr, Stefano Petrangeli
  • Patent number: 11580700
    Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: February 14, 2023
    Assignee: Snap Inc.
    Inventors: Ozi Egri, David Ben Ezra, Andrew James McPhee, Qi Pan, Eyal Zak