Patents Examined by Said Broome
  • Patent number: 10803664
    Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: October 13, 2020
    Assignee: Snap Inc.
    Inventors: Andrew James McPhee, Samuel Edward Hare, Peicheng Yu, Robert Cornelius Murphy, Dhritiman Sagar
  • Patent number: 10803658
    Abstract: A process for receiving, from a computing device, a series of captured building images. The process continues by processing, in real-time, each building image in the series of captured building images to determine if each building image meets a minimum criterion, wherein the minimum criteria includes applicability to be used in constructing a specific digital multi-dimensional building model. The process continues by aggregating each image meeting the minimum criteria, determining when a base set of building images has been aggregated, wherein the base set of building images includes a threshold number images to model at least a partial multi-dimensional building model representing the series of captured building images, determining one or more facades present in the partial multi-dimensional building model, determining preliminary dimensions for one or more architectural features of the one or more facades and returning, incrementally (in real-time), the preliminary dimensions to the computing device.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: October 13, 2020
    Assignee: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Ajay Mishra, Adam J. Altman
  • Patent number: 10789733
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: September 29, 2020
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, David W. Singer, Alexandros Tourapis, Fabrice A. Robinet, Hsi-Jung Wu
  • Patent number: 10789758
    Abstract: Ray tracing, and more generally, graphics operations taking place in a 3-D scene, involve a plurality of constituent graphics operations. Responsibility for executing these operations can be distributed among different sets of computation units. The sets of computation units each can execute a set of instructions on a parallelized set of input data elements and produce results. These results can be that the data elements can be categorized into different subsets, where each subset requires different processing as a next step. The data elements of these different subsets can be coalesced so that they are contiguous in a results set. The results set can be used to schedule additional computation, and if there are empty locations of a scheduling vector (after accounting for the members of a given subset), then those empty locations can be filled with other data elements that require the same further processing as that subset.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: September 29, 2020
    Assignee: Imagination Technologies Limited
    Inventors: Luke T. Peterson, James A. McCombe, Ryan R. Salsbury, Stephen Purcell
  • Patent number: 10789771
    Abstract: A method and apparatus for fusing point cloud data, and a computer readable storage medium are provided. Some embodiments of the method can include: acquiring a first image and a second image, the first image and the second image being respectively associated with a first frame of point cloud data and a second frame of point cloud data acquired for a given scene; determining a point cloud movement matrix between the first frame of point cloud data and the second frame of point cloud data on the basis of the first image and the second image; and fusing the first frame of point cloud data with the second frame of point cloud data on the basis of the point cloud movement matrix.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: September 29, 2020
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventors: Wang Zhou, Miao Yan, Yifei Zhan, Xiong Duan, Changjie Ma, Xianpeng Lang, Yonggang Jin
  • Patent number: 10779917
    Abstract: The present invention relates to a computer implemented method for modifying a digital three-dimensional model (3) of a dentition comprising: displaying an image of the dentition by applying a virtual camera to the three-dimensional model to render the image for a display (1); acquiring a line drawn by a user on the image on the display (1); projecting the acquired line, using the virtual camera (4), to a three-dimensional projection surface (7) approximating the shape of the dental arches and extending the upper and lower dental arches to cover any opening therebetween; obtaining visible teeth arch contour curves, namely incisal curve and gingiva border curve, of the upper and lower teeth arches, and projecting the teeth arch contour curves to the projection surface; selecting one of the teeth arch contour curves as teeth arch contour curve to be modified and selecting the other teeth arch contour curve of the same teeth arch or a curve derived therefrom as a baseline curve; deforming all teeth belonging
    Type: Grant
    Filed: February 18, 2019
    Date of Patent: September 22, 2020
    Assignee: Ivoclar Vivadent AG
    Inventors: Marcel Lancelle, Roland Mörzinger, Nicolas Degen, Gábor Sörös, Bartolovic Nemanja
  • Patent number: 10776977
    Abstract: A device includes a processor and a memory that stores predetermined data including a progressive transition rule and animation models. Each of the animation models corresponds to a respective phoneme. The memory stores instructions including receiving a request from a user and obtaining an answer to the request. The answer includes first and second indicators that correspond to first and second phonemes. The instructions include, according to the first indicator, identifying a first animation model that corresponds to the first phoneme. The instructions include, according to the second indicator, identifying a second animation model that corresponds to the second phoneme. The instructions include generating a transition animation model according to the progressive transition rule using the first and second animation models. The instructions include generating images according to the first, second, and transition animation models. The instructions include outputting the images to the user via a display.
    Type: Grant
    Filed: February 11, 2019
    Date of Patent: September 15, 2020
    Assignee: TD Ameritrade IP Company, Inc.
    Inventor: Abd Alrazzak Habra
  • Patent number: 10776981
    Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing, by a computer device, a database of motions; receiving, by a computing device, an input image, the input image including a body of a person; receiving, by the computing device, a user input including a motion selected from the database of motions; segmenting, by the computing device, the input image into a body portion and a background portion; generating, by the computing device and based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; and displaying, by the computing device, the generated video; receiving, by a computer device, a further user input including clothes, scene, illumination effect, and additional objects; and, while generating the video, modifying frames of the video based on the further user input.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: September 15, 2020
    Assignee: Snap Inc.
    Inventors: Sergei Gorbatyuk, Nikolai Smirnov, Aleksandr Mashrabov, Egor Nemchinov
  • Patent number: 10762667
    Abstract: A method for point cloud coding (200 or 300) or decoding (400 or 500) includes identifying (201) a plurality of quantized points in 3D space, defining (202), a sequence order of the quantized points in 3D space, and identifying (203) differential vector patterns in the sequence order of quantized points in 3D space. The method further includes identifying (204) Morton Index Differences in the sequence order of quantized points in 3d space, coding (205) the one or more quantized points in 3D space using differential vector patterns in a first plurality of codewords, coding (206) the one or more quantized points in 3D space using the Morton index differences in a second plurality of codewords, combining (207) the first and second plurality of codewords into a third plurality of codewords, and coding (208) the third plurality of codewords using an entropy coding scheme into a bitstream.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: September 1, 2020
    Assignee: Point Cloud Compression, B.V.
    Inventor: Rufael Negatu Mekuria
  • Patent number: 10762654
    Abstract: A method of generating a three-dimensional model of an object is disclosed. The method may use a light field camera to capture a plurality of light field images at a plurality of viewpoints. The method may include capturing a first light field image at a first viewpoint; capturing a second light field image at the second viewpoint; estimating a rotation and a translation of a light field from the first viewpoint to the second viewpoint; obtaining a disparity map from each of the plurality of light field image; and computing a three-dimensional point cloud by optimizing the rotation and translation of the light field and the disparity map. The first light field image may include a first plurality of subaperture images and the second light field image may include a second plurality of subaperture images.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: September 1, 2020
    Assignee: SHANGHAITECH UNIVERSITY
    Inventor: Jingyi Yu
  • Patent number: 10755460
    Abstract: A flat scene modeler can more accurately simulate items in environments by receiving instructions to model a given 2D depiction of an item in a given 2D depiction of a room. The flat scene modeler can analyze the instructions and arrange a 3D model of the item in a 3D model of the room. Textures, materials, lighting, and virtual camera position are modified per the received instructions. Two-dimensional images rendered from the 3D models can be provided to a user as a simulation.
    Type: Grant
    Filed: August 24, 2018
    Date of Patent: August 25, 2020
    Assignee: Houzz, Inc.
    Inventors: Xiaoyi Huang, Aaron Yip
  • Patent number: 10748322
    Abstract: Systems and methods for generating cartoon images or emojis of an individual from a photograph of the individual is described. The systems and methods involve transmitting a picture of the individual, such as one taken with a mobile device, to a server that generates a set of emojis showing different emotions of the individual from the picture. The emojis are then transmitted to the mobile device and are available for use by the user in messaging applications, emails, or other electronic communications. The emojis can be added to the default keyboard of the mobile device or be generated in a separate emoji keyboard and be available for selection by the user.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: August 18, 2020
    Assignee: UMOJIFY, INC.
    Inventor: Afshin Pishevar
  • Patent number: 10747203
    Abstract: A modeling process device for performing a three-dimensional object modeling process is provided. The modeling process device includes an accumulation unit configured to accumulate a plurality of three-dimensional object information sets each including corresponding surface shape information items for three-dimensional objects; a searching unit configured to, based on surface shape information of a three-dimensional object generated by a scanning unit that scans a surface of the three-dimensional object, search for a three-dimensional object information set used for modeling in the plurality of the three-dimensional object information sets accumulated in the accumulation unit; and an extraction unit configured to extract a modeling condition that has been used for modeling the three-dimensional object according to the surface shape information that has been generated by the scanning unit.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: August 18, 2020
    Assignee: Ricoh Company, Ltd.
    Inventors: Reiji Yukumoto, Koji Kobayashi, Hiroshi Maeda, Yasuaki Yuji, Fei Yang
  • Patent number: 10748331
    Abstract: Techniques are disclosed for displaying a graphical element in a manner that simulates three-dimensional (3D) visibility (including parallax and shadowing). More particularly, a number of images, each captured with a known spatial relationship to a target 3D object, may be used to construct a lighting model of the target object. In one embodiment, for example, polynomial texture maps (PTM) using spherical or hemispherical harmonics may be used to do this. Using PTM techniques a relatively small number of basis images may be identified. When the target object is to be displayed, orientation information may be used to generate a combination of the basis images so as to simulate the 3D presentation of the target object.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: August 18, 2020
    Assignee: Apple Inc.
    Inventors: Ricardo Motta, Lynn R. Youngs, Minwoong Kim
  • Patent number: 10740868
    Abstract: The described embodiments include systems, methods, and apparatuses for increased efficiency processing flow. One method includes a plurality of stages configured to process an execution graph that includes a plurality of logical nodes with defined properties and resources associated with each logical node of the plurality of logical nodes, a recirculating ring buffer, wherein the recirculating ring buffer is configured to holding only any one of a control information, input, and, or out data necessary to stream a temporary data between each logical node of the execution graph, and a data producer, wherein the data producer is configured to stall from writing control information into a command buffer upon the command buffer being full, preventing command buffer over-writing.
    Type: Grant
    Filed: November 28, 2019
    Date of Patent: August 11, 2020
    Assignee: Blaize, Inc.
    Inventors: Val G. Cook, Satyaki Koneru, Ke Yin, Dinakar C. Munagala
  • Patent number: 10740980
    Abstract: A system and method for generating a virtual reality scene from scanned point cloud data having user defined content is provided. The system includes a coordinate measurement device operable to measure three-dimensional coordinates. A computing device having a processor is operably coupled to the coordinate measurement device, the processor being operable to generate a point cloud data and insert user defined content into the point cloud data in response to an input from a user, the processor further being operable to generate a virtual reality data file based at least in part on the point cloud data with the user defined content. A virtual reality device is operably coupled to the computing device, the virtual reality device being operable to display the virtual reality data file to the user.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: August 11, 2020
    Assignee: FARO TECHNOLOGIES, INC.
    Inventors: Aleksej Frank, Oliver Zweigle
  • Patent number: 10728527
    Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a multi-view interactive digital media representation for presentation on a device. Once a multi-view interactive digital media representation is generated, a user can provide navigational inputs, such via tilting of the device, which alter the presentation state of the multi-view interactive digital media representation. The navigational inputs can be analyzed to determine metrics which indicate a user's interest in the multi-view interactive digital media representation.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: July 28, 2020
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Stephen David Miller, Pantelis Kalogiros, George Haber
  • Patent number: 10715684
    Abstract: Three dimension (3D) model generation methods are operable to generate 3D model data corresponding to images of a physical object of interest that are viewed in a presenting media content event. An exemplary embodiment receives a user request that is associated with an interest by the user to obtain a 3D model of a physical object of interest that is being shown in a scene of a currently presenting media content event. A plurality of video image frames are selected from the scene. Then, 3D model data of the physical object of interest is generated based on at least the selected video image frames of the scene.
    Type: Grant
    Filed: April 22, 2019
    Date of Patent: July 14, 2020
    Assignee: DISH Technologies L.L.C.
    Inventors: Nick Newell, Swapnil Tilaye
  • Patent number: 10713842
    Abstract: A process for receiving, from a computing device, a series of captured building images by overlaying, on a capture device display, a selected graphical guide from a set of sequentially related graphical guides. The process continues by capturing, by a capture device, a building image, wherein the capturing is performed during substantial alignment of an image of a selected building object with a corresponding orientation of the selected graphical guide. The process continues by receiving acknowledgement of the building image being captured for the selected graphical guide and the selected building object. The process is repeated for a plurality of building images.
    Type: Grant
    Filed: August 29, 2019
    Date of Patent: July 14, 2020
    Assignee: HOVER, Inc.
    Inventors: Manish Upendran, William Castillo, Ajay Mishra, Adam J. Altman
  • Patent number: 10705785
    Abstract: Described are an apparatus and method for interactively retrieving data from one or more data sources and rendering the data in a three dimensional (3D) format. The rendering may be displayed on a hand-held device, e.g., a smart phone or tablet computer, or on a remote display device such as another phone, tablet, screen, or a projector. The apparatus and method may operate in response to one or more inputs or orientation sensors, e.g., proximity, gravimeter, gyroscope, photo, and touch sensors.
    Type: Grant
    Filed: March 10, 2017
    Date of Patent: July 7, 2020
    Assignee: Zoho Corporation Private Limited
    Inventors: Ramakrishna Raju Vegesna, Sudheer A. Grandhi