Patents Examined by Tize Ma
  • Patent number: 11574430
    Abstract: Disclosed are methods, systems and apparatuses for creating an animal-shaped avatar using a human face. An avatar creation method according to example embodiments includes analyzing an image including a human face and automatically creating an animal-shaped avatar corresponding to the human face.
    Type: Grant
    Filed: October 9, 2020
    Date of Patent: February 7, 2023
    Assignee: LINE Plus Corporation
    Inventors: Soon Ho Kwon, Geum Yong Yoo, Yongseon Yim, JongHun Kim
  • Patent number: 11551423
    Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: January 10, 2023
    Assignee: Snap Inc.
    Inventors: Ozi Egri, David Ben Ezra, Andrew James McPhee, Qi Pan, Eyal Zak
  • Patent number: 11551391
    Abstract: Digital image dynamic shadow generation is described as implemented by a dynamic shadow system using one or more computing devices. The dynamic shadow system is configured to generate shadow objects based on one or more source objects included in a digital image (e.g., a two-dimensional digital image), automatically and without user intervention. The shadow object is based on a shape of the source object that is to “cast” the shadow and thus promotes realism. The shadow object is also generated by the dynamic shadow system to address an environment, in which, the shadow object is disposed within the digital image.
    Type: Grant
    Filed: February 15, 2021
    Date of Patent: January 10, 2023
    Assignee: Adobe Inc.
    Inventors: Rakesh Baidya, Praveen Kumar Dhanuka, Nitin Sharma, Arushi Jain
  • Patent number: 11551378
    Abstract: The computer stores the plurality of first positions in the image captured by the image pickup device and the second positions corresponding to the plurality of first positions in the graphic corresponding to the image as a relationship. The computer acquires a third position related to the object in the image, a positional relationship between a part of the plurality of first positions and the third position, and one of the relationships. A method specifies a position in a figure corresponding to a position in an image including generating a fourth position in the figure corresponding to the third position using parts or all. In a method, a part of the plurality of first positions is three first positions closest to the third position among the plurality of first positions. A method includes generating the fourth position using the sides of a triangle composed of the three first positions.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: January 10, 2023
    Assignee: NEURAL POCKET INC.
    Inventors: Alex Edward Daniels, Yuichi Sasaki, Taichi Koido, Roi Shigematsu
  • Patent number: 11544865
    Abstract: Various implementations disclosed herein include devices, systems, and methods for detecting and correcting the posture of users of electronic devices. In some implementations, an image capture device or other sensor is used to estimate or otherwise determine a posture of a user. As a specific example, a head mounted device (HMD) may include a camera that captures an image of the user wearing the device and the image may be analyzed to identify 3D joint locations representing the current posture of the user relative to the HMD. The user's posture is analyzed to assess whether a posture correction or change is desirable, for example, by classifying the posture as good or bad or by scoring the posture on a numerical scale. If a posture correction or change is desirable, appropriate feedback to encourage the user to adopt the posture correction or otherwise change his or her posture is identified and provided.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: January 3, 2023
    Assignee: Apple Inc.
    Inventor: Daniel Kurz
  • Patent number: 11540886
    Abstract: A system and method for providing enhanced information to a surgeon is described. A three-dimensional reconstruction of a patient's anatomical structure selected for surgery and a representation of a surgical treatment apparatus are rendered on a display device. At least one attachment metric for a proposed attachment between the surgical treatment apparatus and the patient's anatomical structure is calculated using the three-dimensional position of the surgical treatment apparatus relative to the patient's anatomical structure. And, an indication of the attachment metric is rendered on the display device.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: January 3, 2023
    Inventors: Jörn Richter, Roger Berger
  • Patent number: 11544887
    Abstract: A method for generating a facial animation from a single image is provided. The method is mainly divided into four steps: generation of facial feature points in an image, global two-dimensional deformation of the image, optimization of details of a facial area, and generation of texture of an oral cavity area. The present disclosure can generate a facial animation in real time according to a change of the facial feature points, and the animation quality reaches a level of current state-of-art facial image animation technology. The present disclosure can be used in a series of applications, such as facial image editing, portrait animation generation based on a single image, and facial expression editing in videos.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: January 3, 2023
    Assignees: ZHEJIANG UNIVERSITY, FACEUNITY TECHNOLOGY CO., LTD.
    Inventors: Kun Zhou, Jiahao Geng
  • Patent number: 11532125
    Abstract: A three-dimensional model-based coverage path planning method for an unmanned aerial vehicle, including determining a size of a view frustum of the unmanned aerial vehicle, and establishing a bounding box of the three-dimensional model; designing a three-dimensional grid map according to the view frustum and the bounding box, and defining an attribute of a grid, and arranging a measurement point of the unmanned aerial vehicle on a surface of the three-dimensional model; and planning an unmanned aerial vehicle measurement path on the surface of the three-dimensional model according to the arrangement of measurement points.
    Type: Grant
    Filed: March 23, 2022
    Date of Patent: December 20, 2022
    Assignee: NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS
    Inventors: Jun Wang, Jiajia Dai
  • Patent number: 11532118
    Abstract: Augmented and virtual reality display systems increase viewer comfort by reducing viewer exposure to virtual content that causes undesirable accommodation-vergence mismatches (AVM). The display systems limit displaying content that exceeds an accommodation-vergence mismatch threshold, which may define a volume around the viewer. The volume may be subdivided into two or more zones, including an innermost loss-of-fusion zone (LoF) in which no content is displayed, and one or more outer AVM zones in which the displaying of content may be stopped, or clipped, under certain conditions. For example, content may be clipped if the viewer is verging within an AVM zone and if the content is displayed within the AVM zone for more than a threshold duration. A further possible condition for clipping content is that the user is verging on that content.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: December 20, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Brian David Schwab, Randall E. Hand, Björn Nicolaas Servatius Vlaskamp
  • Patent number: 11481976
    Abstract: A system for and a method of generating an ordered list of instructions comprising a list of pixel coordinates which are vertices of triangles in a strip of a reference input image in a source coordinate system such that transformation of the vertices to a corresponding output image in a destination coordinate system causes the triangles to be mapped to a block of image data which maps to a block of line memory (or “texture cache”). The method comprises dividing the reference output image into a plurality of tiled sections in the destination coordinate system. The method comprises, for each section, defining first and second boundaries of an array of strips of pixels in the section by dividing the section into blocks of line memory.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: October 25, 2022
    Assignee: RENESAS ELECTRONICS CORPORATION
    Inventor: Bjoern Toschi
  • Patent number: 11475643
    Abstract: Cell-based augmented reality (AR) content positioning systems may include a reference grid of cells, each of which includes a 32-bit intracellular coordinate system based on a respective reference point of the cell. Cell topology is selected such that the intracellular coordinate systems may utilize single-precision floating point numbers while retaining the ability to define content positions with, e.g., millimeter-level precision. Accordingly, rendering of AR content may be performed at a high precision using 32-bit devices and methods.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: October 18, 2022
    Assignee: YouAR INC.
    Inventors: Brandon P. Farrell, Carlo J. Calica
  • Patent number: 11475648
    Abstract: The present invention relates to technology for providing eyewear recommendation and try-on services to a customer and allowing the customer to select optimal eyewear based on the eyewear recommendation and try-on services. A system for providing eyewear try-on and recommendation services according to one embodiment may include a feature data extraction unit for extracting feature data from the face mesh of a customer created using a TrueDepth camera, an eyewear adjustment unit for performing rendering by adjusting the specifications of eyewear by reflecting the extracted feature data, a matching processing unit for matching the facial image of the customer and the face mesh, and a try-on processing unit for performing a try-on process by overlapping the rendered eyewear on the facial image of the customer in an augmented reality manner with reference to the face mesh in the matching state.
    Type: Grant
    Filed: August 7, 2019
    Date of Patent: October 18, 2022
    Assignee: COPTIQ CO., LTD.
    Inventor: Woo Seok Sung
  • Patent number: 11461965
    Abstract: A representation of a surface in a three-dimensional space is obtained. A first input representing a starting point and a second input representing a next point are obtained. A representation of a surface-aware spline comprising vertices is generated, with the representation of the surface-aware spline including a starting vertex corresponding to the starting point and a next vertex corresponding to the next point. First and second projection points corresponding to projections of a first vertex and a second vertex onto the surface are determined. New points corresponding to equal distance points for the first and second vertices aligned with the first and second projection points are determined, and a rigid transformation is determined from the new points. The representation of the surface-aware spline is adjusted based on a transformation of the new points using the rigid transformation.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: October 4, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11461969
    Abstract: An exemplary method includes generating a 3D mesh of a subject based on frames of time-synchronized video streams of a subject, the frames associated with a first time and generating a transformed facial-mesh model based on a facial portion of the 3D mesh and a facial-mesh model. The method further includes generating a hybrid mesh by combining the transformed facial-mesh model and at least a portion of the 3D mesh. The method further includes generating a current 3D mesh based on frames of the time-synchronized video streams associated with a second time that temporally follows the first time. The method further includes generating a deformed historical 3D mesh by applying a non-rigid deformation process to the hybrid mesh based on the current 3D mesh. The method further includes compressing the deformed historical 3D mesh to form at least one triangle-based 3D submesh including a plurality of submesh triangles.
    Type: Grant
    Filed: November 4, 2020
    Date of Patent: October 4, 2022
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Simion Venshtain, Yi Zhang, Cong Nguyen
  • Patent number: 11461949
    Abstract: An electronic device is provided. The electronic device includes an avatar and an operating method thereof. The electronic device includes a display, and at least one processor operatively coupled with the display, wherein the at least one processor is configured to detect a face in at least one image, determine a user avatar corresponding to the detected face, determine a region of both the face and at least one object related to the face, determine a size of the user avatar based on the determined region, and control the display to display the user avatar on the display by rendering the user avatar based on the determined size of the user avatar.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: October 4, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Minsheok Choi, Hyejin Kang, Jaeyun Song, Sangkyun Seo, Junho An, Gyuhee Han, Changsub Bae, Dasom Lee
  • Patent number: 11430157
    Abstract: Disclosed herein are related to a device and a method of generating triggers to provide effects to an artificial reality based on features in an environment. In one aspect, a set of candidate triggers for applying effects to the artificial reality provided by the device is determined according to features in an environment. In one aspect, a subset of the set of candidate triggers is determined according to a predetermined policy. In one aspect, corresponding effects to apply to the artificial reality are generated by the device according to the subset of the set of candidate triggers.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: August 30, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Xiaoyang Gao, Rahul Prasad, Krishnan Ramnath
  • Patent number: 11423614
    Abstract: Geometric correction of rough wireframe models derived from photographs may include rectification of either a 2D or 3D original wireframe model of a roof structure, derivation of metadata from the original wireframe, in-plane normalization of the wireframe, extrusion into a “rough” 3D wireframe based on the normalized wireframe, and correction of the “rough” 3D wireframe. The correction and normalization may be an iterative process based on initial pitch values, metadata derived from the original or corrected wireframe models and defined constraints regarding relationships between roof portions or segments. The iterative process may repeat adjusting the wireframe model until the adjusting converges to a stable state according to the various defined constraints.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: August 23, 2022
    Assignee: Eagle View Technologies, Inc.
    Inventors: Chris Pershing, John F. Keane
  • Patent number: 11423613
    Abstract: A representation of a surface in a three-dimensional space is obtained. A first input representing a starting point and a second input representing a next point are obtained. A representation of a surface-aware spline comprising vertices is generated, with the representation of the surface-aware spline including a starting vertex corresponding to the starting point and a next vertex corresponding to the next point. First and second projection points corresponding to projections of a first vertex and a second vertex onto the surface are determined. New points corresponding to equal distance points for the first and second vertices aligned with the first and second projection points are determined, and a rigid transformation is determined from the new points. The representation of the surface-aware spline is adjusted based on a transformation of the new points using the rigid transformation.
    Type: Grant
    Filed: October 27, 2021
    Date of Patent: August 23, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11419101
    Abstract: Three-dimensional (3D) depth imaging systems and methods are disclosed for assessing an orientation with respect to a container. A 3D-depth camera captures 3D image data of a shipping container. A container feature assessment application determines a representative container point cloud and (a) converts the 3D image data into 2D depth image data; (b) compares the 2D depth image data to one or more template image data; (c) performs segmentation to extract 3D point cloud features; (d) determines exterior features of the shipping container and assesses the exterior features using an exterior features metric; (e) determines interior features of the shipping container and assesses the interior features using an interior features metric; and (f) generates an orientation adjustment instruction for indicating to an operator to orient the 3D-depth camera in a second direction for use during a shipping container loading session, wherein the second direction is different than the first direction.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: August 16, 2022
    Assignee: Zebra Technologies Corporation
    Inventors: Yan Zhang, Kevin J. O'Connell, Jay J. Williams, Lichen Wang
  • Patent number: 11410384
    Abstract: Methods, apparatus, devices, and systems for three-dimensional (3D) displaying objects are provided. In one aspect, a method includes obtaining data including respective primitive data for primitives corresponding to an object, determining an electromagnetic (EM) field contribution to each element of a display for each of the primitives by calculating an EM field propagation from the primitive to the element, generating a sum of the EM field contributions from the primitives for each of the elements, transmitting to each of the elements a respective control signal for modulating at least one property of the element based on the sum of the EM field contributions, and transmitting a timing control signal to an illuminator to activate the illuminator to illuminate light on the display, such that the light is caused by the modulated elements of the display to form a volumetric light field corresponding to the object.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: August 9, 2022
    Assignee: Pacific Light & Hologram, Inc.
    Inventors: Jonathan Seamus Blackley, Tina Qin, Asher Zelig Sefami, Kamran Qaderi, Mark Anthony Sararu, Joshua D. Wiensch, Rajay Kumar, Sylvain Marcel Colin