Patents Examined by Peter Hoang
  • Patent number: 11651538
    Abstract: An approach for creating instructional 3D animated videos, without physical access to the object or to the object CAD models as a prerequisite is disclosed. The approach allows the user to submit some images or a video of the object and a knowledge about the required procedure. The required procedures includes, adding the instructions and text annotations. The approach will build a 3D model based on the submitted images and/or video. The approach will generate the instructional animated video based on the 3D model and the required procedure.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: May 16, 2023
    Assignee: International Business Machines Corporation
    Inventors: Adi Raz Goldfarb, Tal Drory, Oded Dubovsky
  • Patent number: 11635625
    Abstract: Included are a first display element configured to display a first virtual image; a second display element configured to display a second virtual image; a combining optical member configured to combine first imaging light and second imaging light; a light-guiding optical system configured to guide light that passed through the combining optical member; and a correction optical system provided between the first display element and the combining optical member and configured to correct an aberration in accordance with a positional difference between the first display element and the second display element.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: April 25, 2023
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Osamu Yokoyama
  • Patent number: 11609426
    Abstract: Systems and methods according to present principles allow social distancing within themed attractions such as haunted attractions in order to allow the enjoyment of the same in various circumstances. These circumstances include times of pandemic, for customers that are afraid to congregate in large groups, for customers that desire to control aspects of the experience, and so on.
    Type: Grant
    Filed: July 30, 2021
    Date of Patent: March 21, 2023
    Assignee: MARK D. WIECZOREK, P.C.
    Inventor: Mark D. Wieczorek
  • Patent number: 11605205
    Abstract: The present disclosure relates to methods, devices, and systems for presentation of multimedia content. In an aspect of the present disclosure, a method includes receiving, at a processor of a mobile device, a plurality of images from a camera, at least one image of the plurality of images including an object. The method also includes displaying a camera video stream based on the plurality of images, displaying three dimensional (3D) augmented reality content in the camera video content, and displaying video content based on the 3D augmented reality content. The video content is associated with the object.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: March 14, 2023
    Assignee: TIFF'S TREATS HOLDINGS, INC.
    Inventors: Leon Chen, Brian Keffer, Jocelyn Seever
  • Patent number: 11605396
    Abstract: An image processing system for generating an image for display to a user at a head-mountable display device includes: a sound input unit configured to receive sound information relating to one or more sounds, an audio processing unit configured to analyse the sound information relating to the one or more sounds, an image generation unit configured to generate one or more image elements that indicate properties of analysed sound information, and an image output unit configured to output display images for display to a user of a head-mountable display device, the images comprising the generated image elements as an image overlay, where the one or more generated image elements are indicative of the direction of the source of the one or more sounds.
    Type: Grant
    Filed: December 6, 2017
    Date of Patent: March 14, 2023
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Neil Jonathan Brown
  • Patent number: 11568609
    Abstract: In one example, an apparatus comprises: a first sensor layer, including an array of pixel cells configured to generate pixel data; and one or more semiconductor layers located beneath the first sensor layer with the one or more semiconductor layers being electrically connected to the first sensor layer via interconnects. The one or more semiconductor layers comprises on-chip compute circuits configured to receive the pixel data via the interconnects and process the pixel data, the on-chip compute circuits comprising: a machine learning (ML) model accelerator configured to implement a convolutional neural network (CNN) model to process the pixel data; a first memory to store coefficients of the CNN model and instruction codes; a second memory to store the pixel data of a frame; and a controller configured to execute the codes to control operations of the ML model accelerator, the first memory, and the second memory.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: January 31, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Xinqiao Liu, Barbara De Salvo, Hans Reyserhove, Ziyun Li, Asif Imtiaz Khan, Syed Shakib Sarwar
  • Patent number: 11568606
    Abstract: A method of and apparatus configured to perform obtaining a captured image of a real environment. The real environment includes a device having a screen. The captured image includes the device having the screen. The pose of the screen is determined based on the captured image. From a source other than the captured image, 2D content to be displayed on a representation of the screen in the virtual scene is obtained. The 2D content is projected to produce projected 2D content. The projected 2D content aligned to the pose of the screen. The virtual scene is generated as a combination of a virtual content item and the projected 2D content.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: January 31, 2023
    Assignee: INTERDIGITAL CE PATENT HOLDINGS
    Inventors: Sylvain Thiebaud, Julien Fleureau, Francois Gerard
  • Patent number: 11551395
    Abstract: The present technique discloses a method and system generating three dimensional animation in gaming engine. A CAD tool is used to generate 3D animation of kinematic assembly and it also stores the information related to complex joints and constraints of each component of the kinematic assembly. Then, it extracts information related to the co-ordinates of each component of the kinematic assembly in unit time and generate transformation matrix for each of those components. This transformation information is stored in JSON file. The gaming engine receives this JSON file from the CAD tool and convert the transformation matrix into gaming engine understandable pattern based on the co-ordinate system supported by the gaming engine. The gaming engine stores this converted transformation matrix into Quaternion representation. Then, the gaming engine applies tangential continuity to the Quaternion representation of each of the components of kinematic assembly to generate the 3D animation in gaming engine.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: January 10, 2023
    Assignee: INFOSYS LIMITED
    Inventors: Swapnil Madan Mehta, Ansa Davis, Mayuresh Mhaiskar, Srinivas Choudary Devalla
  • Patent number: 11551399
    Abstract: Methods, apparatus, systems and articles of manufacture to perform graphics processing on combinations of graphic processing units and digital signal processors are disclosed. A disclosed example method includes processing first data representing input vertices to create second data, the first data using a first format organized by vertex, the second data using a second format organized by components of the vertices. A digital signal processor (DSP) is to perform vertex shading on the second data to create third data, the third data formatted using the second format, the vertex shading performed by executing a first instruction at the DSP, the first instruction generated based on a second instruction capable of being executed at a graphics processing unit (GPU). The third data is processed to create fourth data, the fourth data formatted using the first format.
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: January 10, 2023
    Assignee: Texas Instruments Incorporated
    Inventors: Mihir Narendra Mody, Ajay Jayaraj, Hemant Hariyani, Anand Balagopalakrishnan, Jason A. T. Jones, Erick Zadiel Narvaez
  • Patent number: 11551479
    Abstract: A motion behavior pattern classification method, system and device relating to the human motion recognition field. The method includes: S1, determining a candidate motion behavior pattern which includes a motion behavior pattern to be classified; S2, acquiring time series of behavior data of the candidate motion behavior pattern through a motion control sensor; S3, establishing an LSTM motion behavior pattern classification model through the time series; S4, predicting the motion behavior pattern to be classified through the LSTM motion pattern classification model, comparing the prediction result obtained using the sequence within the T time with the prediction result obtained using the sequence within the T+?t time using the iterative process to obtain the final prediction result, wherein T1?T?T2, T1>0, T2>T1, and the incremental step is set to be ?t, ?t>0. The technical solution of the present invention may improve accuracy while reducing the latency of the motion behavior pattern classification.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: January 10, 2023
    Assignee: XIAMEN UNIVERSITY
    Inventors: Shihui Guo, Juncong Lin, Minghong Liao, Chenxu Lu, Min Jiang, Xing Gao, Guilin Li, Xinyu Shi, Zeyong Hu
  • Patent number: 11544901
    Abstract: Technologies for 3D virtual environment placement of 3D models based on 2D images are disclosed. At least an outline of a 3D virtual environment may be generated. A 2D image of one or more 2D images may be identified. A first product from the first 2D image may be identified. At least one 3D model of one or more 3D models based, at least, on the first product may be determined. A first location for placement of the first product in the 3D virtual environment may be identified. The at least one 3D model may be added within the 3D virtual environment based, at least, on the first location. The 3D virtual environment may be rendered into a visually interpretable form. A second product may be identified from the first 2D image, forming a first grouping of products. A starting element for the first grouping of products may be determined.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: January 3, 2023
    Assignee: Marxent Labs LLC
    Inventors: Bret Besecker, Barry Besecker, Jeffrey L. Cowgill, Jr., Jonathan Jekeli
  • Patent number: 11544419
    Abstract: The point cloud scan image data first is structured with a x-y-z coordinate system, then split into smaller Cluster Bounds (CB) volumes and a CB x-y-z is imposed on the CB centroid. The Euclidean x-y-z distance (ED) is calculated for each data point. Only points within Radial Distance (RD cylinder) are retained/processed. Data points within RD are weighted; points closer to centroid having higher weights. Each data point has Weighted Value WV (square of the inverse of the x-y-z distance). Each x, y, z has Weighted Average (WAV) per axes. WAV is sum of each original point coordinate times WV, divided by sum all WVs. Resultant is one subsampled point per axis. One WAV per CB is selected based upon axis nearly orthogonal to x, y, z WAV points. All CBs subsampled in parallel. Subsampled output comma separated coordinate file for CAD program.
    Type: Grant
    Filed: July 25, 2022
    Date of Patent: January 3, 2023
    Inventors: Evan Wingfield, Sophia Simpkins, Kevin P. Monahan, Michael T. Monahan
  • Patent number: 11527043
    Abstract: Providing selectable virtual reality (VR) viewpoints within a VR environment is disclosed. In one embodiment, a network computing device provides downloadable VR content that defines a VR environment comprising a plurality of viewpoints. The plurality of viewpoints may include, as non-limiting examples, one or more viewpoints corresponding to one or more VR participants within the VR environment, and/or one or more predefined non-participant viewpoints. The network computing device receives a viewpoint selection indication from a client computing device of a spectator of the VR environment, wherein the viewpoint selection indication corresponds to a selected viewpoint of the plurality of viewpoints. The network computing device then transmits, to the client computing device, a pose data stream comprising pose data corresponding to the selected viewpoint. The client computing device may then display the VR environment based on the VR content and the pose data corresponding to the selected viewpoint.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: December 13, 2022
    Assignee: Charter Communications Operating, LLC
    Inventors: Dell Wolfensparger, Dhananjay Lal, Matthew Ringenberg, Andrew Ip
  • Patent number: 11521350
    Abstract: Disclosed are a method and apparatus for processing an image, an electronic device and a storage medium. A specific implementation comprises: acquiring a matching association relationship of a feature point in each to-be-modeled image frame in a to-be-modeled image frame set, a plurality of to-be-modeled image frames in the to-be-modeled image frame set belonging to at least two different to-be-modeled image sequences; determining a first feature point set of the each to-be-modeled image frame based on the matching association relationship, the first feature point set including a first feature point, and the first feature point matching a corresponding feature point in a to-be-modeled image frame in a different to-be-modeled image sequence; and selecting, based on a number of the first feature point in the first feature point set in the each to-be-modeled image frame, a to-be-modeled image frame from the to-be-modeled image frame set for a three-dimensional reconstruction.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: December 6, 2022
    Assignee: Apollo Intelligent Driving Technology (Beijing) Co., Ltd.
    Inventor: Meng Yao
  • Patent number: 11520079
    Abstract: Methods, systems, and computer-readable medium for personalized weather forecast videos are provided. In one implementation, a weather forecast may be obtained, and a personalized profile associated with a user may be obtained. Further, the personalized profile may be used to select at least one characteristic of a character. Further, the personalized profile and the weather forecast may be used to generate a personalized script related to the weather forecast. Further, the selected at least one characteristic of a character and the generated personalized script may be used to generate a video of the character presenting the generated personalized script.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: December 6, 2022
    Assignee: VIDUBLY LTD
    Inventors: Ron Zass, Ben Avi Ingel
  • Patent number: 11520951
    Abstract: The present invention relates to a method for evaluating an ecological environmental impact of a channel project and countermeasures thereof based on mechanism analysis, belonging to the field of ecological environmental impact evaluation technologies. In view of limitations of an existing evaluation method and the void of related technologies, the method includes: a project construction verification and change analysis method, a method for analyzing a fine classification impact mechanism and countermeasures thereof, a method for establishing a multi-level comprehensive index system of ecological environmental impacts, a method for establishing a compliance evaluation index system of an ecological channel, a method for tracking, monitoring and evaluation based on long-term time series satellite remote sensing and a method for analyzing and evaluating a superimposed and cumulative impact model.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: December 6, 2022
    Assignee: China Waterborne Transport Research Institute
    Inventors: Bing Qiao, Chunling Liu, Xuan Wu, Jinpeng Li, Xueyuan Ji, Mingbo Chen, Shiyue Wang, Yue Li
  • Patent number: 11513353
    Abstract: An information processing device including a display unit, a detector, and a first control unit. The display unit capable of providing the user with a field of view of a real space. The detector detects an azimuth of the display unit around at least one axis. The first control unit includes a region limiter, a storage unit, and a display control unit. The region limiter is capable of limiting a display region of the field of view along a direction of the one axis in three-dimensional coordinates surrounding the display unit. The storage unit stores images including information relating to a predetermined target present in the field of view with the images being made corresponding to the three-dimensional coordinates. The display control unit is configured to display, based on an output of the detector, an image in the three-dimensional coordinates, which corresponds to the azimuth, in the field of view.
    Type: Grant
    Filed: December 2, 2019
    Date of Patent: November 29, 2022
    Assignee: SONY CORPORATION
    Inventors: Hirotaka Ishikawa, Takeshi Iwatsu
  • Patent number: 11508121
    Abstract: A method for annotating points on a 2D image of a hand, includes: capturing several images of the hand from different views; for each viewpoint, the hand is imaged using cameras including: one first 2D camera and one 3D camera; using a 3D engine for: creating a 3D hand representation from the 3D camera; considering a 3D model of an articulated hand with predefined annotation points; considering several 3D viewpoints of the hand; for each viewpoint considered: modifying the articulated hand to be superimposed with the 3D representation; considering a 2D image captured from the first 2D camera; superimposing the modified articulated hand on the hand captured on the 2D image; applying the annotation points of the modified articulated hand on the hand captured on the 2D image; and storing the 2D image with annotation on the hand.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: November 22, 2022
    Assignee: QUALCOMM TECHNOLOGIES, INC.
    Inventor: Kim Savaroche
  • Patent number: 11501482
    Abstract: An anonymization apparatus 6 is proposed for the generation of anonymized images 9, wherein surveillance images 5 are provided through video surveillance of a surveillance region 3 by means of at least one camera 2, with a recognition module 11, wherein the surveillance images 5 are provided to the recognition module 11, wherein the recognition module 11 is configured to recognize persons 4 contained in the surveillance images 5, with a processing module 13, wherein the processing module 13 is configured to process the surveillance images 5 into the anonymized images 9, wherein at least one person 4 or person segment included in the surveillance images 5 is anonymized in the anonymized images 9, wherein the processing module 13 is configured to replace the recognized person 4 or person segment by an animated person model 14 for the purpose of anonymization.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: November 15, 2022
    Assignee: Robert Bosch GmbH
    Inventors: Matthias Roland, Gregor Blott, Jan Rexilius
  • Patent number: 11494968
    Abstract: Briefly, in accordance with one or more embodiments, a processor receives an incoming data stream that includes alpha channel data, and a memory stores an application programming interface (API). The API is to route the alpha channel data to a fixed point blending unit to perform one or more blending operations using fixed point representation of the alpha channel data. The API is further to route the incoming data stream to a floating point blending unit to perform operations involving floating point representation of the incoming data.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: November 8, 2022
    Assignee: Intel Corporation
    Inventors: Abhishek R. Appu, Prasoonkumar Surti, Srivallaba Mysore, Subhajit Dasgupta, Hiroshi Akiba, Eric J. Hoekstra, Linda L. Hurd, Travis T. Schluessler, Daren J. Schmidt