Patents Examined by Sultana M Zalalee
  • Patent number: 11803998
    Abstract: An image generator generates images of a set of virtual fibers and effects thereon by processing representations of the set of fibers and computing representation of a virtual surface for a fiber clump in the set of virtual fibers from an artist parameter representing a desired artist effect, computing correlations of the vertices from a set of vertices based on associations of the vertices corresponding to the artist parameter, computing a set of relevant vertices using the correlations of the vertices, computing orthogonal gradients to produce a plurality of gradients using a selected vertex and the set of relevant vertices for the fiber clump, and computing the virtual surface of the fiber clump from the plurality of gradients.
    Type: Grant
    Filed: April 8, 2022
    Date of Patent: October 31, 2023
    Assignee: Unity Technologies SF
    Inventor: Olivier Gourmel
  • Patent number: 11803997
    Abstract: A system may perform head pose neutralization on an input mesh to produce a neutral mesh and/or determine blend shapes for the neutral mesh. The system may generate a neutral mesh based on an input mesh and a reference mesh and then generate a blend shape associated with the neutral mesh based at least in part on one or more reference neutral meshes and one or more corresponding reference blend shapes.
    Type: Grant
    Filed: February 15, 2022
    Date of Patent: October 31, 2023
    Assignee: Electronic Arts Inc.
    Inventors: Hau Nghiep Phan, Mathieu Marquis Bolduc
  • Patent number: 11798196
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for three-dimensional (3D) visual volumetric content and/or a decoder configured to decompress compressed attribute and/or spatial information for the 3D visual volumetric content. The encoder is configured to convert 3D visual volumetric content, such as a point cloud or mesh, into image based patch representations. The encoder is further configured to select one or more reference patches for copying or prediction, such that metadata for copying or predicting a patch based on the reference patch is signaled without explicitly signaling a full set of information for the copied or predicted patch. Likewise, a decoder is configured to receive such information and reconstruct a 3D version of the 3D visual volumetric content using both signaled and predicted or copied patches.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: October 24, 2023
    Assignee: Apple Inc.
    Inventors: Jungsun Kim, Khaled Mammou, Alexandros Tourapis
  • Patent number: 11798231
    Abstract: Provided is a method for generating a hollow structure of a 3D model on the basis of a 2D laminated cross-sectional outline to reduce the amount of using a material or the weight of a printed matter during laminating and manufacturing. The method for generating a hollow structure based on a 2D laminated cross-sectional outline, according to an embodiment of the present invention, comprises the steps of: slicing the 3D model; generating a hollow structure outline on the basis of the result of the slicing; detecting an overhang area between adjacent hollow structure outlines; recalculating the hollow structure outline according to the result of detecting the overhang area; and generating a hollow structure mesh on the basis of the recalculated hollow structure outline. Accordingly, because 2D laminated cross-sectional data is used, a hollow structure can be generated without separate data processing, thereby reducing a calculation burden.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: October 24, 2023
    Assignee: Korea Electronics Technology Institute
    Inventors: Hye In Lee, Hwa Seon Shin, Sung Hwan Chun, Sung Hun Park, Ji Min Jang
  • Patent number: 11798230
    Abstract: Embodiments of the present disclosure provide a display data processing method, device and terminal, a display method and device and a readable storage medium. The display data processing method includes: acquiring a display data saving instruction; and storing, when a display screen deforms, display data and a state parameter of display screen corresponding to the display screen to obtain a display data processing result.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: October 24, 2023
    Assignee: ZTE CORPORATION
    Inventor: Yuanyuan Xu
  • Patent number: 11790562
    Abstract: Methods and devices are provided to encode and decode a data stream carrying data representative of a three-dimensional scene, the data stream comprising color pictures packed in a color image; depth pictures packed in a depth image; and a set of patch data items comprising de-projection data; data for retrieving a color picture in the color image and geometry data. Two types of geometry data are possible. The first type of data describes how to retrieve a depth picture in the depth image. The second type of data comprises an identifier of a parametric function and a list of parameter values for the identified parametric function.
    Type: Grant
    Filed: January 14, 2019
    Date of Patent: October 17, 2023
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Julien Fleureau, Renaud Dore, Franck Thudor
  • Patent number: 11790606
    Abstract: In example embodiments, techniques are provided for calculating camera rotation using translations between sensor-derived camera positions (e.g., from GPS) and pairwise information, producing a sensor-derived camera pose that may be integrated in an early stage of SfM reconstruction. A software process of a photogrammetry application may obtain metadata including sensor-derived camera positions for a plurality of cameras for a set of images and determine optical centers based thereupon. The software process may estimate unit vectors along epipoles from a given camera of the plurality of cameras to two or more other cameras. The software process then may determine a camera rotation that best maps unit vectors defined based on differences in the optical centers to the unit vectors along the epipoles. The determined camera rotation and the sensor-derived camera position form a sensor-derived camera pose that may be returned and used.
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: October 17, 2023
    Assignee: Bentley Systems, Incorporated
    Inventor: Luc Robert
  • Patent number: 11776210
    Abstract: An electronic device and method for 3D face modeling based on neural networks is provided. The electronic device receives a two-dimensional (2D) color image of a human face with a first face expression and obtains a first three-dimensional (3D) mesh of the human face with the first face expression based on the received 2D color image. The electronic device generates first texture information and a first set of displacement maps. The electronic device feeds the generated first texture information and the first set of displacement maps as an input to the neural network and receives an output of the neural network for the fed input. Thereafter, the electronic device generates a second 3D mesh of the human face with a second face expression which is different from the first face expression based on the received output.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: October 3, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Hiroyuki Takeda, Mohammad Gharavi Alkhansari
  • Patent number: 11756264
    Abstract: Embodiments are disclosed for receiving a target shape. The method may further include initializing a gradient mesh to a vector graphic having at least one node. The method may further include performing a constrained optimization of the vector graphic based on the target shape. The method may further include generating a stress metric based on a comparison of the constrained optimization and the target shape. The method may further include determining one or more unconstrained candidate vector graphics based on the stress metric. The method may further include selecting an improved vector graphic from the one or more unconstrained candidate vector graphics. The method may further include mapping the vector graphic to the improved vector graphic. The method may further include optimizing the improved vector graphic based on the target shape.
    Type: Grant
    Filed: November 23, 2021
    Date of Patent: September 12, 2023
    Assignee: Adobe Inc.
    Inventors: Chi Cheng Hsu, Michal Lukác, Michael Gharbi, Kevin Wampler
  • Patent number: 11749411
    Abstract: A system for modeling the evolution of a system over time using an advection-based process is provided. The system continuously evolves a probability density function (“PDF”) for a characteristic of a characteristic of the state of the system and its time-varying parameters. The PDF is evolved based on advection by solving an advection partial differential equation that is based on a system model of the system. The system model has time-varying parameters for modeling the characteristic of the state of the system. The system uses the continuously evolving PDF to make predictions about the characteristic of the state of the system.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: September 5, 2023
    Assignee: Intermountain Intellectual Asset Management, LLC
    Inventors: David John Balaban, Mark Joseph Durst, Todd W. Kelley, John Scott Skellenger, Mikhail Toupikov, Nicolas Sean Frisby, Dominic Joseph Steinitz
  • Patent number: 11734870
    Abstract: Systems and methods for constructing a three-dimensional virtual reality model of a property are disclosed. An exemplary system includes a storage device configured to store a structure mesh of the three-dimensional virtual reality model and texture images captured of the property. The system further includes at least one processor configured to extract a planar area from the structure mesh of the three-dimensional virtual reality model. The at least one processor is further configured to obtain initial texture patches for the planar area from the texture images, determine a target texture patch for the planar area from the initial texture patches projected to an imaging plane of a virtual camera, and add the target texture patch to a texture atlas. The at least one processor is also configured to construct the three-dimensional virtual reality model by mapping the texture atlas to the structure mesh of the three-dimensional virtual reality model.
    Type: Grant
    Filed: August 30, 2021
    Date of Patent: August 22, 2023
    Assignee: KE.COM (BEIJING) TECHNOLOGY CO., LTD.
    Inventor: Mofang Cheng
  • Patent number: 11734889
    Abstract: The present invention proposes method of gaze estimation with 3D face reconstructing, which precisely reconstructs a 3D face to accurately calculate the gaze direction of the face. The present invention decomposes the gaze direction calculation task into two sub-tasks of gaze-aligned 3D face reconstruction, and gaze contact realized by rotation. First, a 3D morphable model is used to reconstruct a basic 3D face with a 2D reference face image as input. Then, shape adjustment is performed on the basic 3D face to obtain a shape-aligned 3D reconstructed face. Finally, a gaze-aligned 3D face is obtained by replacing the textures of the shape-aligned 3D face eye area. For the subtask of gaze contact, the present invention proposes a novel method for realizing gaze contact by rotating a 3D face, which does not depend on too many assumptions and can be widely used in the field of virtual reality.
    Type: Grant
    Filed: April 13, 2022
    Date of Patent: August 22, 2023
    Assignee: Beihang University
    Inventors: Feng Lu, Jiadong Liang
  • Patent number: 11727636
    Abstract: Three-dimensional (3D) mesh segmentation techniques are described. In one example, a geometry segmentation system determines a vertex direction for each vertex in a 3D mesh. A segment generation module is then employed to generate segments (e.g., as developable geometries) from the 3D mesh. To do so, a vertex selection module selects an initial vertex having an associated vertex direction. A face identification module then identifies a face in the 3D mesh using that initial vertex and at least one other vertex. A segment determination module compares the vertex direction associated with the initial vertex with a normal determined for the face. If the vertex direction is orthogonal to the normal (e.g., within a threshold amount), the face is added to the segment, and sets another one of the vertices of the face as the initial vertex and the process repeats.
    Type: Grant
    Filed: September 16, 2021
    Date of Patent: August 15, 2023
    Assignee: Adobe Inc.
    Inventor: Noam Aigerman
  • Patent number: 11728038
    Abstract: Methods, computer-readable storage media and systems are described for constructing a three-dimensional electronic library of simulated decays of the diffusion-weighted 1H2O MR signal in b-space. Methods, computer-readable media, and systems are described for preparing a parametric tissue map for tissue in a subject. Computer readable media, having an electronic library of simulated decays of the diffusion-weighted 1H2O signal in b-space and method of using such a library.
    Type: Grant
    Filed: April 6, 2018
    Date of Patent: August 15, 2023
    Assignee: OREGON HEALTH & SCIENCE UNIVERSITY
    Inventors: Charles Springer, Gregory Wilson, Jeffrey Maki, Thomas Barbara, Xin Li, William Rooney, Wei Huang, Brendan Moloney, Eric Baker
  • Patent number: 11727607
    Abstract: A method includes determining depth values associated with a first set of pixel locations in a first image of a mouth. One or more function is generated for one or more color channels based on intensities of the one or more color channels at the first set of pixel locations and depth values associated with the first set of pixel locations. Image data comprising a new representation of the teeth is received, wherein the image data comprises a second set of pixel locations and new depth values associated with the second set of pixel locations. A new image is generated based on the image data and the one or more functions.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: August 15, 2023
    Assignee: Align Technology, Inc.
    Inventors: Yun Gao, Yingjie Li, Chao Shi
  • Patent number: 11715247
    Abstract: An animation system wherein scanned facial expressions are processed to form muscle models based on live actors combines muscle models over a plurality of live actors to form a facial rig usable for generating expressions based on specification of a strain vector and a control vector of a muscle model for varying characters corresponding to live actors.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: August 1, 2023
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Byung Kuk Choi, Gergely Klár
  • Patent number: 11699254
    Abstract: Video or graphics, received by a render engine within a graphics processing unit, may be segmented into a region of interest such as foreground and a region of less interest such as background. In other embodiments, an object of interest may be segmented from the rest of the depiction in a case of a video game or graphics processing workload. Each of the segmented portions of a frame may themselves make up a separate surface which is sent separately from the render engine to the display engine of a graphics processing unit. In one embodiment, the display engine combines the two surfaces and sends them over a display link to a display panel. The display controller in the display panel displays the combined frame. The combined frame is stored in a buffer and refreshed periodically.
    Type: Grant
    Filed: November 11, 2021
    Date of Patent: July 11, 2023
    Assignee: Intel Corporation
    Inventor: Joydeep Ray
  • Patent number: 11694389
    Abstract: An avatar output device includes an avatar storage unit that stores, for each of two or more avatars, avatar information including first model information for displaying the avatar; a determination unit that determines at least one first avatar displayed using the first model information and at least one second avatar displayed using second model information with a data size smaller than a data size of the first model information from among the two or more avatars; an avatar acquisition unit that acquires an avatar using the second model information for each of the at least one second avatar determined by the determination unit, and acquires an avatar using the first model information for each of the at least one first avatar; and an avatar output unit that outputs the two or more avatars acquired by the avatar acquisition unit.
    Type: Grant
    Filed: June 7, 2022
    Date of Patent: July 4, 2023
    Assignee: CLUSTER, INC
    Inventors: Daiki Handa, Hiroki Kurimoto
  • Patent number: 11688150
    Abstract: A color mapping technique that provides an intuitive visualization of surface normals is described. The surface normals can be associated with a mesh for a virtual object to be displayed in augmented reality. The color mapping technique can map a unit sphere in a color space to an octahedron. The vertices of the octahedron can be aligned with prime colors of the color space. To perform the alignment, a rotation and shear matrix can be determined from coordinates for octahedron positions and coordinates of colors in the color space. The rotation and shear can provide that each region of the unit color sphere is dominated by a single prime color, with gradients between prime colors being visually balanced. Surface normals of a mesh for a virtual object can be visualized using the color mapping, and a viewer can readily determine how distant in terms of rotation two surface normals are from each other.
    Type: Grant
    Filed: February 2, 2022
    Date of Patent: June 27, 2023
    Assignee: Magic Leap, Inc.
    Inventor: Kai Berger
  • Patent number: 11682170
    Abstract: A plurality of images is obtained, whether as separate images or part of a video. The plurality of images is used to generate a three-dimensional (3D) model of the imagery. The 3D model is registered to a geographic coordinate system as a first registered 3D model. The first registered 3D model is merged with a second registered 3D model to generate a merged 3D model. A request including a value corresponding to a location within the geographic coordinate system that includes at least a portion of the merged 3D model is received from a client device. A message identifying at least a subset of points in the portion of the merged 3D model is sent to the client device, each point in the subset having a three-dimensional coordinate.
    Type: Grant
    Filed: October 12, 2021
    Date of Patent: June 20, 2023
    Assignee: PTAS I LLC
    Inventors: Tom Haramaty, Alon Salhov, Sid Sampangi, Ethan Van Andel