Patents Examined by Haixia Du
  • Patent number: 10419737
    Abstract: A video stream for a scene for a virtual reality or augmented reality experience may be stored and delivered to a viewer. The video stream may be divided into a plurality of units based on time segmentation, viewpoint segmentation, and/or view orientation segmentation. Each of the units may be divided into a plurality of sub-units based on a different segmentation from the units, via time segmentation, viewpoint segmentation, and/or view orientation segmentation. At least a portion of the video stream may be stored in a file that includes a plurality of the units. Each unit may be a group of pictures that is a sequence of successive frames in time. Each sub-unit may be a vantage defining a viewpoint from which the scene is viewable. Each vantage may be further divided into tiles, each of which is part of the vantage, limited to one or more particular view orientations.
    Type: Grant
    Filed: September 15, 2017
    Date of Patent: September 17, 2019
    Assignee: GOOGLE LLC
    Inventors: Derek Pang, Colvin Pitts, Kurt Akeley
  • Patent number: 10417991
    Abstract: A system for modifying a user interface in a multi-display device environment described herein can include a processor and a memory storing instructions that cause the processor to detect a number of display screens coupled to the system. The plurality of instructions can also cause the processor to split an image to generate sub-images based on the number of display screens and a bezel size corresponding to each of the display screens, the sub-images to exclude portions of the image corresponding to the bezel size of each of the display screens. Additionally, the plurality of instructions can cause the processor to resize each of the sub-images based on a display size of each of the display screens and display the image by transmitting the sub-images to the display screens.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: September 17, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Matthias Baer, Bryan K. Mamaril, Kyle T. Kral, Kae-Ling J. Gurr, Ryan Whitaker
  • Patent number: 10413158
    Abstract: A method for visualizing a 3D dental restoration on a 2D image of the mouth of a patient includes obtaining a 3D dental model of at least a part of the patient's oral cavity, designing the 3D dental restoration, obtaining the 2D image of the mouth of the patient, estimating a virtual camera including at least one virtual camera property corresponding to at least one physical camera property of the physical camera used to obtain the 2D image, viewing the 3D dental restoration using the virtual camera, determining the visible area of the 3D dental restoration, which is not overlapped by surrounding anatomic features when viewed with the virtual camera, imaging the visible area of the 3D dental restoration with the 2D image. This advantageously provides an image which with high accuracy gives the dentist and the patient a visual presentation of the final result of a dental treatment.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: September 17, 2019
    Assignee: 3Shape A/S
    Inventors: Tais Clausen, Rune Fisker
  • Patent number: 10410312
    Abstract: The present invention relates to a method of streaming interactive computer graphics from a server to a client device. The method includes the steps of: intercepting graphics instructions transmitted from an application destined for a graphical processing unit (GPU) at the server; processing the graphics instructions to generate graphics data at the server; generating index information for, at least, some of the graphics data at the server; transmitting the index information in place of the graphics data to a client device; extracting corresponding graphics data stored at the client device utilizing the index information; and rendering computer graphics at a graphical processing unit (GPU) at the client device using the corresponding graphics data. A system for streaming interactive computer graphics is also disclosed.
    Type: Grant
    Filed: January 21, 2015
    Date of Patent: September 10, 2019
    Assignee: ELEKTRAGLIDE LTD
    Inventor: Adam Billyard
  • Patent number: 10402071
    Abstract: Certain aspects of the present disclosure relate to a technique for generating simultaneous zoom in windows on a touch sensitive device. A first portion of the user content is zooming into by touching the display screen in a proximity of the first portion using the touch input device while retaining an original zoom size of a first remaining portion of the user content. A second portion of the user content from the first remaining portion is zoomed into by touching the display screen in a proximity of the second portion using the touch input device while retaining a zoomed in first portion and an original zoom size of a second remaining portion of the of the first remaining portion, the original zoom size of the first and the second remaining portions being the same.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: September 3, 2019
    Assignee: Open Invention Network LLC
    Inventor: Margarita Khafizova
  • Patent number: 10403028
    Abstract: A system and method for geometric warping correction in projection mapping is provided. A lower resolution mesh is applied to A mesh model, at least in a region of the mesh model misaligned with a corresponding region of a real-world object. One or more points of the lower resolution mesh are moved. In response, one or more corresponding points of the mesh model are moved to increase alignment between the region of the mesh model and the corresponding region of the real-world object. An updated mesh model is stored in a memory. And one or more projectors are controlled to projection map images corresponding to the updated mesh model onto the real-world object.
    Type: Grant
    Filed: August 7, 2018
    Date of Patent: September 3, 2019
    Assignee: CHRISTIE DIGITAL SYSTEMS USA, INC.
    Inventors: Roy Anthony, Kevin Moule, Derek Scott, Nick Wasilka, Maxwell Elendt
  • Patent number: 10395418
    Abstract: Examples described herein generally relate to prioritizing portions of images for rendering in a computing device. A probability field for prioritizing portions of an image of a scene for processing can be determined, where the probability field includes a set of values each corresponding to a likelihood of a rendering parameter acquiring an altered value between a render time at which at least a portion of the image is rendered and a display time at which the image is displayed. A shaped probability field can be generated based at least in part on applying the probability field to an original target shape associated with a display. The shaped probability field can be provided to a downstream node for prioritizing, based at least in part on one or more of the set of values in the probability field, a portion of the image in processing the image.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: August 27, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Matthew L. Bronder, Andrew Z. Yeung, Alexander Nankervis, Jack A. Elliott, Matthew D. Sandy
  • Patent number: 10386639
    Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: August 20, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Nicole Elizabeth Samec, John Graham Macnamara, Christopher M. Harrises, Brian T. Schowengerdt, Rony Abovitz, Mark Baerenrodt
  • Patent number: 10386640
    Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: August 20, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Nicole Elizabeth Samec, John Graham Macnamara, Christopher M. Harrises, Brian T. Schowengerdt, Rony Abovitz, Mark Baerenrodt
  • Patent number: 10389889
    Abstract: A display apparatus and a control method thereof are provided. The display apparatus includes an image processor, a display and a controller. The image processor processes an input image to generate an output image. The display displays the generated output image. The controller is configured to control the image processor to generate an output image of an region corresponding to the moved viewpoint, in response to a viewpoint being moved with respect to an input image generated for a predetermined bearing to enable the viewpoint to be moved, and to provide an image effect based on or corresponding to a speed at which the viewpoint is moved while the viewpoint is moved. With this, a dizziness and a sense of difference, which may break out when the viewpoint is moved in a speed a user does not intend, are improved and a new experiences is provided for a user.
    Type: Grant
    Filed: June 30, 2017
    Date of Patent: August 20, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kyu-hyun Cho, Sang-young Lee, Hyung-sun Lee, Hee-seok Jeong, Youn-ho Choi
  • Patent number: 10379351
    Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: August 13, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Nicole Elizabeth Samec, John Graham Macnamara, Christopher M. Harrises, Brian T. Schowengerdt, Rony Abovitz, Mark Baerenrodt
  • Patent number: 10379354
    Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: August 13, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Nicole Elizabeth Samec, John Graham Macnamara, Christopher M. Harrises, Brian T. Schowengerdt, Rony Abovitz, Mark Baerenrodt
  • Patent number: 10379353
    Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: August 13, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Nicole Elizabeth Samec, John Graham Macnamara, Christopher M. Harrises, Brian T. Schowengerdt, Rony Abovitz, Mark Baerenrodt
  • Patent number: 10380752
    Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.
    Type: Grant
    Filed: December 29, 2017
    Date of Patent: August 13, 2019
    Assignee: FotoNation Limited
    Inventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
  • Patent number: 10360715
    Abstract: An example information-processing device (10) includes an image capture unit (110) that captures a video of a subject, an image generation unit (120) that generates plural avatars based on plural images constituting the video captured by the image capture unit (110), the plural images corresponding respectively to different image capture timings, each of the plural avatars representing a subject shown in one of the plural images, and a display unit (130) that displays the plural avatars generated by the image generation unit (120).
    Type: Grant
    Filed: June 22, 2015
    Date of Patent: July 23, 2019
    Assignee: Nintendo Co., Ltd.
    Inventors: Munetaka Tsuda, Akihiro Umehara, Yui Iida, Masayuki Okada, Hayuru Soma
  • Patent number: 10353536
    Abstract: Disclosed are a terminal and operating method thereof. The present invention includes obtaining an input for selecting at least one video, displaying a polyhedron displaying a preview image of the selected at least one video on each of a plurality of faces, obtaining an input for selecting at least one of a plurality of the faces included in the displayed polyhedron, and outputting a video corresponding to the selected face.
    Type: Grant
    Filed: May 2, 2017
    Date of Patent: July 16, 2019
    Assignee: LG ELECTRONICS INC.
    Inventors: Namki Kim, Yunmi Kwon, Kyunghye Seo, Yongmun Gong, Jongook Yoon, Hoonjoon Chi, Yoonhee Choi, Ahyun Park, Hyungjin Choi
  • Patent number: 10345582
    Abstract: A system captures and displays video of surgeries. The system may include at least one digital image sensor optically coupled to one or more lenses and configured to capture a video sequence of a scene in a surgery; at least one interface configured to receive at least one region on interest (ROI) of the captured video sequence; an electronic display, selected so that at least one of the digital image sensors has a pixel resolution which is substantially greater than the pixel resolution of the electronic display; and a computer processor configured to: receive the at least one captured video sequence and the at least one received ROI and display over the at least one electronic display a portion of the captured video sequence based on the at least one selected ROI.
    Type: Grant
    Filed: March 9, 2015
    Date of Patent: July 9, 2019
    Assignee: ELBIT SYSTEMS LTD.
    Inventors: Ron Schneider, Abraham Zeitouny
  • Patent number: 10346016
    Abstract: Certain aspects of the present disclosure relate to a technique for generating nested zoom in windows on a touch sensitive device. A first portion of the user content is zooming into by touching the display screen in a proximity of the first portion using the touch input device while retaining an original zoom size of a remaining portion of the user content. A second portion of a zoomed in first portion of the user content is zooming into by touching the display screen in a proximity of the second portion using the touch input device while retaining an original zoom size of the zoomed in first portion.
    Type: Grant
    Filed: July 17, 2018
    Date of Patent: July 9, 2019
    Assignee: OPEN INVENTION NETWORK LLC
    Inventor: Margarita Khafizova
  • Patent number: 10339721
    Abstract: A computer system having a display generation component, one or more input devices, and one or more cameras receives a request to display a virtual object in a first user interface region that includes a field of view of the one or more cameras. In response to the request, in accordance with a determination that object-placement criteria are not met, the representation of the virtual object is displayed with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras. In accordance with a determination that the object-placement criteria are met, the representation of the virtual object is displayed with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane.
    Type: Grant
    Filed: September 27, 2018
    Date of Patent: July 2, 2019
    Assignee: APPLE INC.
    Inventors: Jonathan R. Dascola, Stephen O. Lemay, Jeffrey M. Faulkner, David J. Addey, David Lui, Giancarlo Yerkes, Lisa K. Forssell
  • Patent number: 10341632
    Abstract: An environment may be displayed from a viewpoint. According to one method, volumetric video data may be acquired depicting the environment, for example, using a tiled camera array. A plurality of vantages may be distributed throughout a viewing volume from which the environment is to be viewed. The volumetric video data may be used to generate video data for each vantage, representing the view of the environment from that vantage. User input may be received designating a viewpoint within the viewing volume. From among the plurality of vantages, a subset nearest to the viewpoint may be identified. The video data from the subset may be retrieved and combined to generate viewpoint video data depicting the environment from the viewpoint. The viewpoint video data may be displayed for the viewer to display a view of the environment from the viewpoint selected by the user.
    Type: Grant
    Filed: May 9, 2017
    Date of Patent: July 2, 2019
    Inventors: Derek Pang, Colvin Pitts, Kurt Akeley