Patents Examined by Todd Buttram
  • Patent number: 10891799
    Abstract: An augmented reality processing method is provided for a terminal. The method includes: obtaining a plurality of frames of images, comprising a first image and a second image, which is a frame of an image immediately following the first image; obtaining a key point set of a first object in the first image; obtaining, through a neural network model, first pose key point sets respectively corresponding to a plurality of objects in the second image; determining a second pose key point set of the first object in the second image according to the key point set and a motion trend of the first object; using a target first pose key point set as a key point set of the first object in the second image; and generating an augmented information image according to the key point set of the first object in the second image.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: January 12, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiaolong Zhu, Yitong Wang, Kaining Huang, Lijian Mei, Shenghui Huang, Jingmin Luo
  • Patent number: 10888785
    Abstract: A method of generating an image frame for depicting a posing of a character in a game is disclosed. A dominant atom from a set of active atoms associated with the character is determined. A motion controlling ability from a plurality of abilities of the character is determined. A motion fragment for the dominant atom is determined based on pose data and future trajectory data in a motion library associated with the dominant atom; A predicted future trajectory of the character is calculated. Based on a detection of a future collision or problem between the predicted future trajectory and an environment within the game, a combined future trajectory is calculated based on the predicted future trajectory and an additional future trajectory. The character is posed in the image frame based on a weighted combination of poses associated with the set of active atoms.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: January 12, 2021
    Assignee: Unity IPR ApS
    Inventor: Michael Buttner
  • Patent number: 10861239
    Abstract: A computer system renders one or more virtual objects on a display of a hybrid-reality system (DHR), such as head-mounted display (HMD), which represents occluded or obscured details in the field-of-view. Information is presented to a user by establishing a view position relative to a real-world object and receiving dimension and position data associated with an occluded object. The occluded object is at least partially occluded by the real-world object at the view position. A first image of at least a portion of the occluded object is rendered on the DHR using the first data. Second data associated with the occluded object is received and a stimulus is provided to the user representing the second data.
    Type: Grant
    Filed: September 19, 2018
    Date of Patent: December 8, 2020
    Inventors: Anthony Mark Jones, Jessica A. F. Jones
  • Patent number: 10861213
    Abstract: Systems and methods for automatic generation of artificial motion blur are provided. The method includes obtaining a sequence of images of an object captured along a camera translation. Then, a multi-view interactive digital media representation (MIDMR) of the object is generated. Generating the MIDMR includes segmenting the object and then adding a blur effect to all parts of the MIDMR except for the segmented object.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: December 8, 2020
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Matthias Reso, Pavel Hanchar, Radu Bogdan Rusu
  • Patent number: 10861217
    Abstract: An output of a first one of a plurality of layers within a neural network is identified. A bitmap is determined from the output, the bitmap including a binary matrix. A particular subset of operations for a second one of the plurality of layers is determined to be skipped based on the bitmap. Operations are performed for the second layer other than the particular subset of operations, while the particular subset of operations are skipped.
    Type: Grant
    Filed: August 19, 2017
    Date of Patent: December 8, 2020
    Assignee: Movidius Ltd.
    Inventors: David Macdara Moloney, Xiaofan Xu
  • Patent number: 10861421
    Abstract: A stable frame rate is maintained by a system that includes a graphics processing unit (GPU). The system also includes memory to store frames rendered by the GPU, and a display to display the frames rendered by the GPU. In response to a negative indication with respect to the GPU maintaining a frame rate at an operating frequency, the GPU is operative to reduce frame quality of subsequent frames while maintaining the operating frequency.
    Type: Grant
    Filed: May 3, 2019
    Date of Patent: December 8, 2020
    Assignee: MediaTek Inc.
    Inventors: Chiung-Fu Chen, Kuo-Yi Wang, Cheng-Che Chen
  • Patent number: 10854172
    Abstract: A display system includes a display configured to superimpose an image on a landscape in front of a vehicle and cause the image to be visually recognized by an occupant of the vehicle, a road shape acquirer configured to acquire information indicating a shape of a road around the vehicle, and a display controller configured to change a display aspect of an image regarding a road to be displayed on the display, on the basis of a form of a roundabout including one or both of a shape component and an outer diameter of the roundabout obtained from the information in a case that the roundabout has been determined to be included in the road shape by referring to the information acquired by the road shape acquirer.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: December 1, 2020
    Assignee: HONDA MOTOR CO., LTD.
    Inventor: Jumpei Ichinokawa
  • Patent number: 10846916
    Abstract: There is provided an image processing apparatus and an image processing method that can follow a fast movement of a virtual point to change a high-precision image. A position correction unit corrects a three-dimensional position of a point of a boundary of an occlusion area among a plurality of points, the three-dimensional position being included in three-dimensional data including three-dimensional positions and color information of the plurality of points, the three-dimensional data being generated from color image data and depth image data from a predetermined viewpoint. The present disclosure can be applied to, for example, an image processing apparatus or the like that generates color image data from a virtual viewpoint on the basis of color image data and depth image data from a predetermined viewpoint.
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: November 24, 2020
    Assignee: SONY CORPORATION
    Inventors: Yuichi Araki, Nobuaki Izumi, Junichiro Enoki
  • Patent number: 10846661
    Abstract: Various aspects described herein generally relate to visualizing a vehicle history using extended reality. In some implementations, an extended reality device may obtain image data corresponding to one or more vehicle parts that are visible in a field of view of the extended reality device. The extended reality device may identify one or more anchor points in a coordinate space corresponding to the field of view of the extended reality device and obtain a vehicle history report based on an identifier associated with the vehicle. The extended reality device may obtain digital content based on one or more records contained in the vehicle history report and an expected visual appearance of the one or more parts of the vehicle. The extended reality device may render the digital content on a display of the extended reality device. Various other aspects are provided.
    Type: Grant
    Filed: July 30, 2019
    Date of Patent: November 24, 2020
    Assignee: Capital One Services, LLC
    Inventors: Qiaochu Tang, Micah Price, Jason Hoover, Stephen Wylie, Geoffrey Dagley
  • Patent number: 10846043
    Abstract: A display method and apparatus of a portable terminal are provided. A given application is executed on the portable terminal and the executed application is entered into a division mode. At least one device other than the portable terminal is set to output at least one of a plurality of layers of the executed application. The at least one layer is transmitted to the at least one device.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: November 24, 2020
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Yong-Soo Jeong, Jin Park, Min-Ji Kim
  • Patent number: 10834986
    Abstract: A safety system is configured to be worn by a user. The safety system includes a helmet, a transparent display screen coupled to the helmet and configured to provide eye safety for the user, the transparent display screen configured to display graphical information to the user in substantially real time. According to one embodiment, if a hazard is identified in a first route, the apparatus communicates an identification of the hazard for display to the user via the transparent display screen. Further, if the hazard is identified in the first route, the apparatus communicates an identification of a second route for display to the user via the transparent display screen, the second route avoiding the hazard with each of the first route and the second route rendered in the transparent display screen.
    Type: Grant
    Filed: July 12, 2018
    Date of Patent: November 17, 2020
    Inventor: Sarah Nicole Ciccaglione
  • Patent number: 10825217
    Abstract: A computing system is provided, including one or more optical sensors, a display, one or more user input devices, and a processor. The processor may receive optical data of a physical environment. Based on the optical data, the processor may generate a three-dimensional representation of the physical environment. For at least one target region of the physical environment, the processor may generate a three-dimensional bounding volume surrounding the target region based on a depth profile measured by the one or more optical sensors and/or estimated by the processor. The processor may generate a two-dimensional bounding shape at least in part by projecting the three-dimensional bounding volume onto an imaging surface of an optical sensor. The processor may output an image of the physical environment and the two-dimensional bounding shape for display. The processor may receive a user input and modify the two-dimensional bounding shape based on the user input.
    Type: Grant
    Filed: January 2, 2019
    Date of Patent: November 3, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ali Osman Ulusoy, Yuri Pekelny, Szymon Piotr Stachniak
  • Patent number: 10818057
    Abstract: An electronic device is provided. The electronic device includes a memory storing spherical content, at least a portion of which is provided in the shape of at least a portion of a sphere with respect to a central point of an image, a display configured to output the spherical content, and a processor configured to be electrically connected with the memory and the display. The processor is configured to arrange a specified patch image on a central point of the spherical content when outputting the spherical content on the display. In addition, various embodiments ascertained through the specification are possible.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: October 27, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Mi Ji Park, Kyung Hwa Seo, Kyoung Soo Yoon, Jae Han Lee
  • Patent number: 10818062
    Abstract: A method for generating a body shape, comprising: receiving one or more linguistic descriptors related to the body shape; retrieving an association between the one or more linguistic descriptors and a body shape; and generating the body shape, based on the association.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: October 27, 2020
    Assignees: MAX-PLANCK-GESELLSCHAFT ZUR FÖRDERUNG D. WISSENSCHAFTEN E.V., Board of Regents, The University of Texas System
    Inventors: Stephan Streuber, Maria Alejandra Quirós Ramírez, Michael Black, Silvia Zuffi, Alice O'Toole, Matthew Q. Hill, Carina A. Hahn
  • Patent number: 10810159
    Abstract: The modular updating of visualizations is provided. Elements of a visualization (e.g., graphical representations of data series, axes, titles, etc.) are only updated within the visualization when the hierarchical data defining that element is changed, thus reducing the processing load on the system providing the visualization. According to an aspect, the changes in the data are accurately translated from an arbitrary hierarchy format into a normalized hierarchy format so that a data visualization platform modularly update the hierarchical data that defines the visualization. According to an aspect, modular updating of hierarchy data enables updating a visualization in pieces (i.e., modularly), such that portions of the visualization that are not affected by the change to the data are not updated and do not need to be recalculated for rendering.
    Type: Grant
    Filed: April 9, 2015
    Date of Patent: October 20, 2020
    Inventor: Michael Woolf
  • Patent number: 10803836
    Abstract: A switch device includes a first connection interface, a second connection interface, an video output interface, a control module and a processing module. The first connection interface receives a first video and the second connection interface receives a second video. The video output interface outputs an integrated video. The control module receives a control signals including a position data. The processing module generates the integrated video based on the first video and the second video. The integrated video includes a first sub-image having a first depth and a second sub-image having a second depth respectively corresponding to the first video and the second video. When the position data falls within an overlapping area of the first sub-image and the second sub-image, the processing module outputs the control signal to one of the first connection interface and the second connection interface based on the first depth and the second depth.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: October 13, 2020
    Assignee: ATEN International Co., Ltd.
    Inventor: Chun-Chi Liao
  • Patent number: 10803668
    Abstract: Information obscured to a user is provided through a display of a hybrid reality system (DHR). data associated with an occluded object at least partially occluded by a real-world object at a position of the user is received and a display window is created on the DHR. A first magnification factor is obtained and a first image of at least the portion of the occluded object is rendered in the display window at the first magnification factor at a first time. A second magnification factor, different than the first magnification factor, is obtained, and a second image of at least the portion of the occluded object is rendered in the display window at the second magnification factor at a second time after the first time.
    Type: Grant
    Filed: September 19, 2018
    Date of Patent: October 13, 2020
    Inventors: Anthony Mark Jones, Bruce A Young
  • Patent number: 10789672
    Abstract: Disclosed are a method and device for image pasting on a spherical panoramic image.
    Type: Grant
    Filed: August 15, 2017
    Date of Patent: September 29, 2020
    Assignee: BEIJING QIYI CENTURY SCIENCE & TECHNOLOGY CO., LTD.
    Inventor: Jiadan Zhu
  • Patent number: 10789775
    Abstract: Method for controlling an object, wherein the object is arranged in the real space and is linked to at least one virtual element of a character space, wherein the object, a depiction device, an operator control device and/or a control device are functionally connected to one another, having the steps of ascertaining a position and an orientation of the operator control device and/or of the depiction device in relation to the object, generating a virtual pointer from the ascertained position and the ascertained orientation of the operator control device and/or of the depiction device, selecting the object by means of the virtual pointer, depicting the object, augmented with the at least one element of the character space, by means of the depiction device, and/or controlling the object by means of the operator control device.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: September 29, 2020
    Assignee: Beckhoff Automation GmbH
    Inventors: Clemens Maier, Armin Pehlivan, Thomas Morscher, Stefan Wapelhorst, Christian Henke
  • Patent number: 10783682
    Abstract: Computer program products, methods, systems, apparatus, and computing entities are provided for overcoming the technical problem of providing an augmented reality that displays an actual image of the item or a proportionally dimensioned representation of the item to a user. To overcome this challenge, two separate approaches can be used: a beacon/tag/sensor-based approach and a marker-based approach.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: September 22, 2020
    Assignee: UNITED PARCEL SERVICE OF AMERICA, INC.
    Inventors: Andrew Dotterweich, Christopher T. Schenken, Jeffrey Cooper