Patents Examined by David H. Chu
  • Patent number: 11361515
    Abstract: Generating a self-guided augmented reality (AR) session plan from a remotely-guided AR session held between a remote user and a local user, by: Receiving data recorded during the remotely-guided AR session. Segmenting the data into temporal segments that correspond to steps performed by the local user during the remotely-guided AR session. The steps are detected using at least one of: a Natural-Language Understanding (NLU) algorithm applied to a conversation included in the data, to detect utterances indicative of step-to-step transitions; location analysis of annotations included in the data, to detect location differences indicative of step-to-step transitions; and analysis of camera pose data included in the data, to detect pose transitions indicative of step-to-step transitions. Generating the self-guided AR session plan based on the segmented data and a 3D representation of the scene, the AR session plan including step-by-step AR guidance on how to perform the various steps.
    Type: Grant
    Filed: October 18, 2020
    Date of Patent: June 14, 2022
    Assignee: International Business Machines Corporation
    Inventors: Erez Lev Meir Bilgory, Adi Raz Goldfarb
  • Patent number: 11341694
    Abstract: Various examples are directed to computer-implemented systems and methods for graphical representation of financial account outflow. The method includes obtaining, by a processor of a computer, a transaction of an account holder including an amount and frequency of the transaction, and categorizing the transaction on a continuum of discretionary spending and fixed expense spending. The transaction is displayed by the processor on a user interface using a graph having an x-axis providing a frequency of the at least one transaction, and a y-axis indicating the categorization of the transaction. The transaction is displayed as a bubble on the graph, where the bubble has a diameter that is proportional to the amount of the transaction.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: May 24, 2022
    Assignee: Wells Fargo Bank, N.A.
    Inventors: Erik Schutzman, Tambra Nichols, Susan Bell McCraw, H. Brock Kolls
  • Patent number: 11328157
    Abstract: A method and system for authoring a three-dimensional (3D) presentation can involve dividing a scene into a grid of equals-sized segments or non-equally sized segments, wherein one or more 360-degree cameras record the scene from a center of each segment, and a size of the each segment is proportional to a complexity of an environment captured in the scene. One or more objects can be created within the scene for a user interaction with a 3D presentation of the scene in the context of a video stream. A logical center of the object(s) can be used as a center point for recording a 360-degree video by the one or more 360-degree cameras for use as a low fidelity background video when the user interacts with the 3D presentation of the scene. The 3D presentation can be based on a 3D model.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: May 10, 2022
    Assignee: Honeywell International Inc.
    Inventors: Mark Phillips, Ziad Kaakani, Jason Urso
  • Patent number: 11328485
    Abstract: A method of displaying an augmented reality (AR) image includes controlling an AR display to display the AR image as being at least partially overlaid over a view through a microscope while the view is visible to a user of the microscope, wherein the AR image includes a cursor; receiving a user input from a user interface; setting an anchor point based on the user input; updating the AR image to include the anchor point; controlling the AR display to display the updated AR image; detecting a motion of a slide of the microscope; adjusting the AR image by moving at least one from among the cursor and the anchor point within the AR image based on the detected motion; and controlling the AR display to display the adjusted AR image.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: May 10, 2022
    Assignee: TENCENT AMERICA LLC
    Inventor: Hanbo Chen
  • Patent number: 11328491
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content providing, displaying and/or hosting systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel framework that displays an Extended Reality (XR) interface panel. The XR panel is configured to display and automatically and progressively adjust the panel and/or its displayed augmented reality (AR), virtual reality (VR) and/or mixed reality (MR) content based on dynamically determined and updated positioning of a viewing user.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: May 10, 2022
    Assignee: AVEVA SOFTWARE, LLC
    Inventors: Larry Weinheimer, Alessandro Giusti, Leonardo Ballari, Chetan Katariya, Bonnie Mathew
  • Patent number: 11321921
    Abstract: Provided is a display control apparatus including a state detection unit configured to detect a state of a user who observes an image, and a display control unit configured to cause a display to display the image in which a plurality of display content items are superimposed on a photographed image, and to control a behavior of each of the display content items according to the state of the user.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: May 3, 2022
    Assignee: SONY CORPORATION
    Inventors: Yuya Hanai, Shingo Tsurumi
  • Patent number: 11308698
    Abstract: In one embodiment, a computing system may generate and display a virtual reality environment to a user. The computing system may determine a head pose of the user based on headset tracking data associated with a headset worn by the user. The computing system may determine a hand pose of the user based on hand tracking data associated with a device held or worn by a hand of the user. The computing system may access scene information associated with the displayed virtual reality environment. The computing system may determine a predicted focal point of the user within the virtual reality environment by processing the head pose, the hand pose, and the scene information using a machine-learning model.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Kara Emery, Marina Zannoli, Lei Xiao
  • Patent number: 11308674
    Abstract: Embodiments of this application disclose a dynamic image compositing method performed at a terminal. A skeleton animation of an animation model is displayed on a real-world image captured by the terminal; a currently displayed target real-world image is captured in a case that a photographing instruction is received, and the skeleton animation of the animation model is recorded, to obtain the recorded skeleton animation; image compositing is performed on the target real-world image and each frame of image of the recorded skeleton animation, to obtain a plurality of composited images; and the plurality of composited images are combined into a corresponding dynamic image. Based on the solutions, the real-world image and the skeleton animation of the animation model may be automatically composited into the corresponding dynamic image, and a user does not need to perform a large quantity of repetitive image addition and selection operations.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: April 19, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Yi Xu, Qifa Guo, Shengwei Lin
  • Patent number: 11302037
    Abstract: A wearable electronic device is disclosed, including a transparent display, a camera, communication circuitry, a memory storing instructions, and at least one processor. The wearable electronic device receives, through the communication circuitry, screen data from the electronic device and displaying the screen data in a first area of the at least one display, while receiving the screen data, detect, using the at least one camera, a presence of a body part holding the electronic device within a field of view of the at least one camera and determine whether the presence of the body part overlaps the first area, in response to detecting overlap of the first area, display the screen data to a second area of the at least one display different from the first area.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: April 12, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Choonkyoung Moon, Jueun Lee, Shinjae Jung
  • Patent number: 11291521
    Abstract: A surgery assisting device using augmented reality includes: a camera configured to record an affected area or a surgical site of a patient; wireless transmission equipment configured to receive and transmit an image recorded by the camera in real time; smart glasses configured to display the image transmitted by the wireless transmission equipment to a wearer; and an Augmented Reality (AR) server configured to add augmented reality to the image and provide the wearer with the augmented reality.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: April 5, 2022
    Inventor: Seung Joon Im
  • Patent number: 11276242
    Abstract: An application for use with a mobile computing device is described that enables group members of a group activity to view the positions of each member in one or more formations for the group activity. The application enables the user to select a formation for viewing and practicing in any location, whether indoors or outdoors and with or without other group members of the group activity. The application allows the user to toggle between a top-down view and an augmented reality view. The augmented reality view enables a user to view graphical indicators of each position of the user, whereby the graphical indicators are superimposed on a user's computing device in the real user environment. The augmented reality view provides a user with a better understanding of his or her positions in a real-world environment.
    Type: Grant
    Filed: April 2, 2021
    Date of Patent: March 15, 2022
    Inventors: David Bakken, Kristian Bakken, Lianshi Gan, Samuel Lau, Matthew Morin, Sanjana Shetty
  • Patent number: 11263787
    Abstract: Disclosed embodiments include methods, systems, and non-transitory computer readable medium for augmented reality detection for locating a particular autonomous vehicle. In a non-limiting embodiment, an illustrative method includes providing, by an electronic device to a remote server, a request for an autonomous vehicle. A first signal indicating that the autonomous vehicle is within an accessible range to an intended passenger is received by an electronic device. The passenger is prompted by the electronic device to orient an image sensor of the electronic device towards a designated area of the accessible range. The designated area is imaged by the image sensor for the autonomous vehicle. A visual representation of the imaged designated area is generated on a graphical user interface of the electronic device. The autonomous vehicle is identified within the generated visual representation.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: March 1, 2022
    Assignee: Rivian IP Holdings, LLC
    Inventors: Matthew Hortop, Patrick Hunt, Lacey Trelfa
  • Patent number: 11263795
    Abstract: Described are systems and techniques to generate data for display to present visualizations of data acquired from sensors in a facility. The data visualizations may be used to develop, configure, administer, or otherwise support operation of the facility. In one implementation, the visualization may include a view incorporating aggregated images acquired from multiple cameras, depth data, tracking information about objects in the facility, and so forth. An analyst may use the data visualization to determine occurrence of an action in the facility such as a pick of an item, place of an item, what item was involved with an action, what user was involved with the action, and so forth. Based on the information presented by the data visualization, changes may be made to data processing parameters.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: March 1, 2022
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Nishitkumar Ashokkumar Desai, Frank Florian Liberato, Jr., I-Hung Wang, Daniel Bibireata, Muralidhar Koka
  • Patent number: 11262802
    Abstract: Methods, apparatus, systems and articles of manufacture are disclosed An example apparatus to update a spatially adjustable display disclosed herein includes a display size monitor to acquire an indication of a size of the spatially adjustable display, a service image comparator to compare the indication of the size to a size model, and a source image adjuster to invoke visual configuration adjustments to an output image of the spatially adjustable display based on parameters identified in the size model.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: March 1, 2022
    Assignee: INTEL CORPORATION
    Inventor: David W. Browning
  • Patent number: 11244164
    Abstract: An augmented-reality head-mounted display is configured to display an indication of a location of an unmanned aerial vehicle with respect to the field-of-view of the head-mounted display, in order to assist a UAV operator to maintain line-of-sight with the UAV.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: February 8, 2022
    Assignee: Honeywell International Inc.
    Inventors: Prasanna Murthy Gurajapu, Bimalananda Behera, Venkata Pavan M, Shreyas Joshi, Arjun Bindu Jyothikumar
  • Patent number: 11227421
    Abstract: A method of constructing a map including a plurality of lanes and a system thereof are provided. The method includes: for each of the plurality of lanes, constructing corresponding lane geometry data based on a plurality of polyline segments, including constructing a general outline circumscribing the plurality of lanes and identifying an outline of each of the plurality of lanes based on the plurality of polyline segments and the general outline. Outline polyline segments as boundaries of the general outline are selected from the plurality of polyline segments.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: January 18, 2022
    Assignee: TUSIMPLE, INC.
    Inventors: Minhao Jiang, Hsin Lu, Genmao Shi, Ziqi Liu
  • Patent number: 11222456
    Abstract: A graphics animation and compositing operations framework has a layer tree for interfacing with the application and a render tree for interfacing with a render engine. Layers in the layer tree can be content, windows, views, video, images, etc., for an application's user interface. The application commits state changes of the layers of the layer tree. The application does not need to include explicit code for animating the changes to the layers. Instead, after a synchronization threshold has been met, an animation is determined for animating the change in state by the framework which can define a set of predetermined animations based on motion, visibility and transition. The determined animation is explicitly applied to the affected layers in the render tree. A render engine renders from the render tree into a frame buffer, synchronized with the display. Portions of the render tree changing relative to prior versions can be tracked.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: January 11, 2022
    Assignee: Apple Inc.
    Inventors: Ralph Brunner, John Harper, Peter Graffagnino
  • Patent number: 11210816
    Abstract: Systems and methods for transitional effects in real-time rendering applications are described. Some implementations may include rendering a computer-generated reality environment in a first state using an application that includes multiple processes associated with respective objects of the computer-generated reality environment; generating a message that indicates a change in the computer-generated reality environment; sending the message to two or more of the multiple processes associated with respective objects of the computer-generated reality environment; responsive to the message, updating configurations of objects of the computer-generated reality environment to change the computer-generated reality environment from the first state to a second state; and rendering the computer-generated reality environment in the second state using the application.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: December 28, 2021
    Assignee: Apple Inc.
    Inventors: Xiaobo An, Peter Dollar, Eric J. Mueller, Brendan K. Duncan
  • Patent number: 11210962
    Abstract: An electronic display and method for memorizing a theme are disclosed. A theme is exhibited via a picture and a plurality of phrases associated with the theme. The phrases are intermittently highlighted individually over the picture. Each word of each phrase is designated a fixed location relative to the picture, each phrase being scattered over the picture and a phrase is interspersed among other phrases.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: December 28, 2021
    Assignee: A.R. HEAD VENTURES LTD
    Inventor: Ronen Shilo
  • Patent number: 11180026
    Abstract: A circuit device includes an image processing circuit and a comparison circuit. The image processing circuit performs a first mapping process and a first rotation process on an input image to generate an image for a head up display. The image processing circuit performs, on an image, a second mapping process that is a reverse mapping process of the first mapping process and a second rotation process that is a reverse rotation process of the first rotation process to generate an image. The comparison circuit performs a comparison between the image and the image and outputs a result of the comparison as information for detecting an error in the image.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: November 23, 2021
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Kumar Anandabairavasamy Anand, Wittmeir Manfred, Jeffrey Eric, Tetsuo Kawamoto, Yasutoshi Akiba