Patents by Inventor Johnny Chung Lee
Johnny Chung Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11024082Abstract: A method includes sequentially outputting from an imaging sensor each pixel row of a set of pixel rows of an image captured by the imaging sensor. The method further includes displaying, at a display device, a pixel row representative of a first pixel row of the captured image prior to a second pixel row of the captured image being output by the imaging sensor. An apparatus includes an imaging sensor having a first lens that imparts a first type of spatial distortion, a display device coupled to the imaging sensor, the display to display imagery captured by the imaging sensor with the first spatial distortion, and an eyepiece lens aligned with the display, the eyepiece lens imparting a second type of spatial distortion that compensates for the first type of spatial distortion.Type: GrantFiled: May 3, 2016Date of Patent: June 1, 2021Assignee: GOOGLE LLCInventors: Johnny Chung Lee, Steven B. Goldberg
-
System and methods for performing electronic display stabilization via retained lightfield rendering
Patent number: 10419747Abstract: In a system having a user-portable display device, a method includes maintaining a lightfield data structure representing at least a portion of a four-dimensional (4D) lightfield for a three-dimensional (3D) world in association with a first pose of the user-portable display device relative to the 3D world. The method further includes determining a second pose of the user-portable display device relative to the 3D world, the second pose comprising an updated pose of the user-portable display device. The method additionally includes generating a display frame from the lightfield data structure based on the second pose, the display frame representing a field of view of the 3D world from the second pose.Type: GrantFiled: September 21, 2016Date of Patent: September 17, 2019Assignee: GOOGLE LLCInventors: Evan Hardesty Parker, Matthew Milton Pharr, Johnny Chung Lee, Craig Donner, Daniel Erickson, Dominik Philemon Kaeser -
Patent number: 10275945Abstract: An electronic device includes at least one sensor, a display, and a processor. The processor is configured to determine a dimension of a physical object along an axis based on a change in position of the electronic device when the electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis. A method includes capturing and displaying imagery of a physical object at an electronic device, and receiving user input identifying at least two points of the physical object in the displayed imagery. The method further includes determining, at the electronic device, at least one dimensional aspect of the physical object based on the at least two points of the physical object using a three-dimensional mapping of the physical object.Type: GrantFiled: July 31, 2017Date of Patent: April 30, 2019Assignee: GOOGLE LLCInventors: Johnny Chung Lee, Joel Hesch, Ryan Hickman, Patrick Mihelich, James Fung
-
Publication number: 20180350216Abstract: Systems and methods for generating or enhancing representations of an interior space using data collected by a device, such as a mobile device, capable of simultaneous localization and mapping. An electronic device, such as a mobile device, can be configured to collect data using a variety of sensors as the device is carried or transported through a space. The collected data can be processed and analyzed to generate geometry data providing a three-dimensional representation of the space and objects in the space in near real time as the device is carried through the space. The geometry data can be used for a variety of purposes, including generating and/or enhancing models and other representations of an interior space, and/or assisting with navigation through the interior space.Type: ApplicationFiled: December 29, 2014Publication date: December 6, 2018Inventors: Scott Benjamin Satkin, Ryan Michael Hickman, Ying Zhang, Johnny Chung Lee
-
Patent number: 10102666Abstract: A method includes determining, at a first time, a representation of a first head rotation of a head mounted display (HMD) using a first inertial sensor sample stream and rendering, at an application processor, a texture based on the first head rotation. The method further includes determining, at a second time subsequent to the first time, a representation of a second head rotation of the HMD using a second inertial sensor sample stream having a higher sampling rate than the first inertial sensor sample stream, and generating, at a compositor, a rotated representation of the texture based on a difference between the first head rotation and the second head rotation.Type: GrantFiled: June 13, 2016Date of Patent: October 16, 2018Assignee: GOOGLE LLCInventors: Evan Hardesty Parker, Johnny Chung Lee, Adrian Wong
-
Patent number: 10048747Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.Type: GrantFiled: April 21, 2017Date of Patent: August 14, 2018Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig Peeper, Shao Liu
-
Patent number: 9939648Abstract: A head mounted display (HMD) device includes first and second laterally-curved displays disposed about a medial plane, wherein each of the first and second curved displays includes a first lateral section distal from the medial plane and having a curvature with a first radius and a second lateral section adjacent to the medial plane and having a curvature with a second radius less than the first radius.Type: GrantFiled: June 22, 2016Date of Patent: April 10, 2018Assignee: Google LLCInventors: Johnny Chung Lee, Ashish Ashok Shah, Renzo De Nardi
-
Publication number: 20170358142Abstract: An electronic device includes at least one sensor, a display, and a processor. The processor is configured to determine a dimension of a physical object along an axis based on a change in position of the electronic device when the electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis. A method includes capturing and displaying imagery of a physical object at an electronic device, and receiving user input identifying at least two points of the physical object in the displayed imagery. The method further includes determining, at the electronic device, at least one dimensional aspect of the physical object based on the at least two points of the physical object using a three-dimensional mapping of the physical object.Type: ApplicationFiled: July 31, 2017Publication date: December 14, 2017Inventors: Johnny Chung Lee, Joel Hesch, Ryan Hickman, Patrick Mihelich, James Fung
-
Publication number: 20170287139Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.Type: ApplicationFiled: April 21, 2017Publication date: October 5, 2017Inventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig Peeper, Shao Liu
-
Publication number: 20170180721Abstract: In a system having a user-portable display device, a method includes maintaining a lightfield data structure representing at least a portion of a four-dimensional (4D) lightfield for a three-dimensional (3D) world in association with a first pose of the user-portable display device relative to the 3D world. The method further includes determining a second pose of the user-portable display device relative to the 3D world, the second pose comprising an updated pose of the user-portable display device. The method additionally includes generating a display frame from the lightfield data structure based on the second pose, the display frame representing a field of view of the 3D world from the second pose.Type: ApplicationFiled: September 21, 2016Publication date: June 22, 2017Inventors: Evan Hardesty Parker, Matthew Milton Pharr, Johnny Chung Lee, Craig Donner, Daniel Erickson, Dominik Philemon Kaeser
-
Patent number: 9659377Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.Type: GrantFiled: December 15, 2014Date of Patent: May 23, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig Peeper, Shao Liu
-
Patent number: 9582717Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A model may be adjusted based on a location or position of one or more extremities estimated or determined for a human target in the grid of voxels. The model may also be adjusted based on a default location or position of the model in a default pose such as a T-pose, a DaVinci pose, and/or a natural pose.Type: GrantFiled: October 27, 2014Date of Patent: February 28, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig C. Peeper
-
Publication number: 20160377869Abstract: A head mounted display (HMD) device includes first and second laterally-curved displays disposed about a medial plane, wherein each of the first and second curved displays includes a first lateral section distal from the medial plane and having a curvature with a first radius and a second lateral section adjacent to the medial plane and having a curvature with a second radius less than the first radius.Type: ApplicationFiled: June 22, 2016Publication date: December 29, 2016Inventors: Johnny Chung Lee, Ashish Ashok Shah, Renzo De Nardi
-
Patent number: 9522328Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may be determined and a model may be adjusted based on the location or position of the one or more extremities.Type: GrantFiled: September 4, 2014Date of Patent: December 20, 2016Assignee: Microsoft Technology Licensing, LLCInventors: Tommer Leyvand, Johnny Chung Lee, Szymon Stachniak, Craig Peeper, Shao Liu
-
Publication number: 20160364904Abstract: A method includes determining, at a first time, a representation of a first head rotation of a head mounted display (HMD) using a first inertial sensor sample stream and rendering, at an application processor, a texture based on the first head rotation. The method further includes determining, at a second time subsequent to the first time, a representation of a second head rotation of the HMD using a second inertial sensor sample stream having a higher sampling rate than the first inertial sensor sample stream, and generating, at a compositor, a rotated representation of the texture based on a difference between the first head rotation and the second head rotation.Type: ApplicationFiled: June 13, 2016Publication date: December 15, 2016Inventors: Evan Hardesty Parker, Johnny Chung Lee, Adrian Wong
-
Publication number: 20160328882Abstract: A method includes sequentially outputting from an imaging sensor each pixel row of a set of pixel rows of an image captured by the imaging sensor. The method further includes displaying, at a display device, a pixel row representative of a first pixel row of the captured image prior to a second pixel row of the captured image being output by the imaging sensor. An apparatus includes an imaging sensor having a first lens that imparts a first type of spatial distortion, a display device coupled to the imaging sensor, the display to display imagery captured by the imaging sensor with the first spatial distortion, and an eyepiece lens aligned with the display, the eyepiece lens imparting a second type of spatial distortion that compensates for the first type of spatial distortion.Type: ApplicationFiled: May 3, 2016Publication date: November 10, 2016Inventors: Johnny Chung Lee, Steven B. Goldberg
-
Publication number: 20150146923Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A model may be adjusted based on a location or position of one or more extremities estimated or determined for a human target in the grid of voxels. The model may also be adjusted based on a default location or position of the model in a default pose such as a T-pose, a DaVinci pose, and/or a natural pose.Type: ApplicationFiled: October 27, 2014Publication date: May 28, 2015Inventors: Johnny Chung Lee, Tommer Leyvand, Szymon Piotr Stachniak, Craig C. Peeper
-
Publication number: 20150098619Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.Type: ApplicationFiled: December 15, 2014Publication date: April 9, 2015Inventors: Johnny Chung Lee, Tommer Leyand, Simon Piotr Stachniak, Craig Peeper, Shao Liu
-
Patent number: 8963829Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may then be determined.Type: GrantFiled: November 11, 2009Date of Patent: February 24, 2015Assignee: Microsoft CorporationInventors: Johnny Chung Lee, Tommer Leyand, Simon Piotr Stachniak, Craig Peeper, Shao Liu
-
Publication number: 20140375557Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may be determined and a model may be adjusted based on the location or position of the one or more extremities.Type: ApplicationFiled: September 4, 2014Publication date: December 25, 2014Inventors: Tommer Leyvand, Johnny Chung Lee, Szymon Stachniak, Craig Peeper, Shao Liu