Patents by Inventor Johnny Chung Lee

Johnny Chung Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11024082
    Abstract: A method includes sequentially outputting from an imaging sensor each pixel row of a set of pixel rows of an image captured by the imaging sensor. The method further includes displaying, at a display device, a pixel row representative of a first pixel row of the captured image prior to a second pixel row of the captured image being output by the imaging sensor. An apparatus includes an imaging sensor having a first lens that imparts a first type of spatial distortion, a display device coupled to the imaging sensor, the display to display imagery captured by the imaging sensor with the first spatial distortion, and an eyepiece lens aligned with the display, the eyepiece lens imparting a second type of spatial distortion that compensates for the first type of spatial distortion.
    Type: Grant
    Filed: May 3, 2016
    Date of Patent: June 1, 2021
    Assignee: GOOGLE LLC
    Inventors: Johnny Chung Lee, Steven B. Goldberg
  • Patent number: 10419747
    Abstract: In a system having a user-portable display device, a method includes maintaining a lightfield data structure representing at least a portion of a four-dimensional (4D) lightfield for a three-dimensional (3D) world in association with a first pose of the user-portable display device relative to the 3D world. The method further includes determining a second pose of the user-portable display device relative to the 3D world, the second pose comprising an updated pose of the user-portable display device. The method additionally includes generating a display frame from the lightfield data structure based on the second pose, the display frame representing a field of view of the 3D world from the second pose.
    Type: Grant
    Filed: September 21, 2016
    Date of Patent: September 17, 2019
    Assignee: GOOGLE LLC
    Inventors: Evan Hardesty Parker, Matthew Milton Pharr, Johnny Chung Lee, Craig Donner, Daniel Erickson, Dominik Philemon Kaeser
  • Patent number: 10275945
    Abstract: An electronic device includes at least one sensor, a display, and a processor. The processor is configured to determine a dimension of a physical object along an axis based on a change in position of the electronic device when the electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis. A method includes capturing and displaying imagery of a physical object at an electronic device, and receiving user input identifying at least two points of the physical object in the displayed imagery. The method further includes determining, at the electronic device, at least one dimensional aspect of the physical object based on the at least two points of the physical object using a three-dimensional mapping of the physical object.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: April 30, 2019
    Assignee: GOOGLE LLC
    Inventors: Johnny Chung Lee, Joel Hesch, Ryan Hickman, Patrick Mihelich, James Fung
  • Publication number: 20180350216
    Abstract: Systems and methods for generating or enhancing representations of an interior space using data collected by a device, such as a mobile device, capable of simultaneous localization and mapping. An electronic device, such as a mobile device, can be configured to collect data using a variety of sensors as the device is carried or transported through a space. The collected data can be processed and analyzed to generate geometry data providing a three-dimensional representation of the space and objects in the space in near real time as the device is carried through the space. The geometry data can be used for a variety of purposes, including generating and/or enhancing models and other representations of an interior space, and/or assisting with navigation through the interior space.
    Type: Application
    Filed: December 29, 2014
    Publication date: December 6, 2018
    Inventors: Scott Benjamin Satkin, Ryan Michael Hickman, Ying Zhang, Johnny Chung Lee
  • Patent number: 10102666
    Abstract: A method includes determining, at a first time, a representation of a first head rotation of a head mounted display (HMD) using a first inertial sensor sample stream and rendering, at an application processor, a texture based on the first head rotation. The method further includes determining, at a second time subsequent to the first time, a representation of a second head rotation of the HMD using a second inertial sensor sample stream having a higher sampling rate than the first inertial sensor sample stream, and generating, at a compositor, a rotated representation of the texture based on a difference between the first head rotation and the second head rotation.
    Type: Grant
    Filed: June 13, 2016
    Date of Patent: October 16, 2018
    Assignee: GOOGLE LLC
    Inventors: Evan Hardesty Parker, Johnny Chung Lee, Adrian Wong
  • Patent number: 10048747
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.
    Type: Grant
    Filed: April 21, 2017
    Date of Patent: August 14, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig Peeper, Shao Liu
  • Patent number: 9939648
    Abstract: A head mounted display (HMD) device includes first and second laterally-curved displays disposed about a medial plane, wherein each of the first and second curved displays includes a first lateral section distal from the medial plane and having a curvature with a first radius and a second lateral section adjacent to the medial plane and having a curvature with a second radius less than the first radius.
    Type: Grant
    Filed: June 22, 2016
    Date of Patent: April 10, 2018
    Assignee: Google LLC
    Inventors: Johnny Chung Lee, Ashish Ashok Shah, Renzo De Nardi
  • Publication number: 20170358142
    Abstract: An electronic device includes at least one sensor, a display, and a processor. The processor is configured to determine a dimension of a physical object along an axis based on a change in position of the electronic device when the electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis. A method includes capturing and displaying imagery of a physical object at an electronic device, and receiving user input identifying at least two points of the physical object in the displayed imagery. The method further includes determining, at the electronic device, at least one dimensional aspect of the physical object based on the at least two points of the physical object using a three-dimensional mapping of the physical object.
    Type: Application
    Filed: July 31, 2017
    Publication date: December 14, 2017
    Inventors: Johnny Chung Lee, Joel Hesch, Ryan Hickman, Patrick Mihelich, James Fung
  • Publication number: 20170287139
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.
    Type: Application
    Filed: April 21, 2017
    Publication date: October 5, 2017
    Inventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig Peeper, Shao Liu
  • Publication number: 20170180721
    Abstract: In a system having a user-portable display device, a method includes maintaining a lightfield data structure representing at least a portion of a four-dimensional (4D) lightfield for a three-dimensional (3D) world in association with a first pose of the user-portable display device relative to the 3D world. The method further includes determining a second pose of the user-portable display device relative to the 3D world, the second pose comprising an updated pose of the user-portable display device. The method additionally includes generating a display frame from the lightfield data structure based on the second pose, the display frame representing a field of view of the 3D world from the second pose.
    Type: Application
    Filed: September 21, 2016
    Publication date: June 22, 2017
    Inventors: Evan Hardesty Parker, Matthew Milton Pharr, Johnny Chung Lee, Craig Donner, Daniel Erickson, Dominik Philemon Kaeser
  • Patent number: 9659377
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.
    Type: Grant
    Filed: December 15, 2014
    Date of Patent: May 23, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig Peeper, Shao Liu
  • Patent number: 9582717
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A model may be adjusted based on a location or position of one or more extremities estimated or determined for a human target in the grid of voxels. The model may also be adjusted based on a default location or position of the model in a default pose such as a T-pose, a DaVinci pose, and/or a natural pose.
    Type: Grant
    Filed: October 27, 2014
    Date of Patent: February 28, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig C. Peeper
  • Publication number: 20160377869
    Abstract: A head mounted display (HMD) device includes first and second laterally-curved displays disposed about a medial plane, wherein each of the first and second curved displays includes a first lateral section distal from the medial plane and having a curvature with a first radius and a second lateral section adjacent to the medial plane and having a curvature with a second radius less than the first radius.
    Type: Application
    Filed: June 22, 2016
    Publication date: December 29, 2016
    Inventors: Johnny Chung Lee, Ashish Ashok Shah, Renzo De Nardi
  • Patent number: 9522328
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may be determined and a model may be adjusted based on the location or position of the one or more extremities.
    Type: Grant
    Filed: September 4, 2014
    Date of Patent: December 20, 2016
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Tommer Leyvand, Johnny Chung Lee, Szymon Stachniak, Craig Peeper, Shao Liu
  • Publication number: 20160364904
    Abstract: A method includes determining, at a first time, a representation of a first head rotation of a head mounted display (HMD) using a first inertial sensor sample stream and rendering, at an application processor, a texture based on the first head rotation. The method further includes determining, at a second time subsequent to the first time, a representation of a second head rotation of the HMD using a second inertial sensor sample stream having a higher sampling rate than the first inertial sensor sample stream, and generating, at a compositor, a rotated representation of the texture based on a difference between the first head rotation and the second head rotation.
    Type: Application
    Filed: June 13, 2016
    Publication date: December 15, 2016
    Inventors: Evan Hardesty Parker, Johnny Chung Lee, Adrian Wong
  • Publication number: 20160328882
    Abstract: A method includes sequentially outputting from an imaging sensor each pixel row of a set of pixel rows of an image captured by the imaging sensor. The method further includes displaying, at a display device, a pixel row representative of a first pixel row of the captured image prior to a second pixel row of the captured image being output by the imaging sensor. An apparatus includes an imaging sensor having a first lens that imparts a first type of spatial distortion, a display device coupled to the imaging sensor, the display to display imagery captured by the imaging sensor with the first spatial distortion, and an eyepiece lens aligned with the display, the eyepiece lens imparting a second type of spatial distortion that compensates for the first type of spatial distortion.
    Type: Application
    Filed: May 3, 2016
    Publication date: November 10, 2016
    Inventors: Johnny Chung Lee, Steven B. Goldberg
  • Publication number: 20150146923
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A model may be adjusted based on a location or position of one or more extremities estimated or determined for a human target in the grid of voxels. The model may also be adjusted based on a default location or position of the model in a default pose such as a T-pose, a DaVinci pose, and/or a natural pose.
    Type: Application
    Filed: October 27, 2014
    Publication date: May 28, 2015
    Inventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig C. Peeper
  • Publication number: 20150098619
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.
    Type: Application
    Filed: December 15, 2014
    Publication date: April 9, 2015
    Inventors: Johnny Chung Lee, Tommer Leyand, Simon Piotr Stachniak, Craig Peeper, Shao Liu
  • Patent number: 8963829
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.
    Type: Grant
    Filed: November 11, 2009
    Date of Patent: February 24, 2015
    Assignee: Microsoft Corporation
    Inventors: Johnny Chung Lee, Tommer Leyand, Simon Piotr Stachniak, Craig Peeper, Shao Liu
  • Publication number: 20140375557
    Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may be determined and a model may be adjusted based on the location or position of the one or more extremities.
    Type: Application
    Filed: September 4, 2014
    Publication date: December 25, 2014
    Inventors: Tommer Leyvand, Johnny Chung Lee, Szymon Stachniak, Craig Peeper, Shao Liu