Patents by Inventor Lomesh Agarwal
Lomesh Agarwal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11978159Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.Type: GrantFiled: December 3, 2021Date of Patent: May 7, 2024Assignee: Magic Leap, Inc.Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nicholas Atkinson Kramer, Kenneth William Tossell, Christian Ivan Robert Moore
-
Publication number: 20240108217Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.Type: ApplicationFiled: December 7, 2023Publication date: April 4, 2024Inventors: Samuel A. MILLER, Lomesh AGARWAL, Lionel Ernest EDWIN, Ivan Li Chuen YEOH, Daniel FARMER, Sergey Fyodorovich PROKUSHKIN, Yonatan MUNK, Edwin Joseph SELKER, Bradley Vincent STUART, Jeffrey Scott SOMMERS
-
Publication number: 20240062403Abstract: Disclosed here in are systems and methods for mapping environment information. In some embodiments, the systems and methods are configured for mapping information in a mixed reality environment. In some embodiments, the system is configured to perform a method including scanning an environment including capturing, with a sensor, a plurality of points of the environment; tracking a plane of the environment; updating observations associated with the environment by inserting a keyframe into the observations; determining whether the plane is coplanar with a second plane of the environment; in accordance with a determination that the plane is coplanar with the second plane, performing planar bundle adjustment on the observations associated with the environment; and in accordance with a determination that the plane is not coplanar with the second plane, performing planar bundle adjustment on a portion of the observations associated with the environment.Type: ApplicationFiled: February 11, 2022Publication date: February 22, 2024Inventors: Lipu ZHOU, Ashwin SWAMINATHAN, Lomesh AGARWAL
-
Patent number: 11883104Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.Type: GrantFiled: September 2, 2021Date of Patent: January 30, 2024Assignee: Magic Leap, Inc.Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Bradley Vincent Stuart, Jeffrey Scott Sommers
-
Publication number: 20230037046Abstract: A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.Type: ApplicationFiled: October 7, 2022Publication date: February 2, 2023Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Erik Fonseka, Paul M. Greco, Jeffrey Scott Sommers, Bradley Vincent Stuart, Shiuli Das, Suraj Manjunath Shanbhag
-
Patent number: 11468640Abstract: A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.Type: GrantFiled: August 2, 2019Date of Patent: October 11, 2022Assignee: Magic Leap, Inc.Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Erik Fonseka, Paul M. Greco, Jeffrey Scott Sommers, Bradley Vincent Stuart, Shiuli Das, Suraj Manjunath Shanbhag
-
Patent number: 11386629Abstract: An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.Type: GrantFiled: March 22, 2021Date of Patent: July 12, 2022Assignee: Magic Leap, Inc.Inventors: Jeremy Dwayne Miranda, Rafael Domingos Torres, Daniel Olshansky, Anush Mohan, Robert Blake Taylor, Samuel A. Miller, Jehangir Tajik, Ashwin Swaminathan, Lomesh Agarwal, Ali Shahrokni, Prateek Singhal, Joel David Holder, Xuan Zhao, Siddharth Choudhary, Helder Toshiro Suzuki, Hirai Honar Barot, Eran Guendelman, Michael Harold Liebenow, Christian Ivan Robert Moore
-
Publication number: 20220092852Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.Type: ApplicationFiled: December 3, 2021Publication date: March 24, 2022Applicant: Magic Leap, Inc.Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nicholas Atkinson Kramer, Kenneth William Tossell, Christian Ivan Robert Moore
-
Publication number: 20220057862Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.Type: ApplicationFiled: September 2, 2021Publication date: February 24, 2022Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Bradley Vincent Stuart, Jeffrey Scott Sommers
-
Patent number: 11227435Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.Type: GrantFiled: October 4, 2019Date of Patent: January 18, 2022Assignee: Magic Leap, Inc.Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nicholas Atkinson Kramer, Kenneth William Tossell, Christian Ivan Robert Moore
-
Patent number: 11112863Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.Type: GrantFiled: January 17, 2019Date of Patent: September 7, 2021Assignee: Magic Leap, Inc.Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Bradley Vincent Stuart, Jeffrey Scott Sommers
-
Publication number: 20210209859Abstract: An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.Type: ApplicationFiled: March 22, 2021Publication date: July 8, 2021Applicant: Magic Leap, Inc.Inventors: Jeremy Dwayne Miranda, Rafael Domingos Torres, Daniel Olshansky, Anush Mohan, Robert Blake Taylor, Samuel A. Miller, Jehangir Tajik, Ashwin Swaminathan, Lomesh Agarwal, Ali Shahrokni, Prateek Singhal, Joel David Holder, Xuan Zhao, Siddharth Choudhary, Helder Toshiro Suzuki, Hiral Honar Barot, Eran Guendelman, Michael Harold Liebenow, Christian Ivan Robert Moore
-
Patent number: 10957112Abstract: An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.Type: GrantFiled: August 12, 2019Date of Patent: March 23, 2021Assignee: Magic Leap, Inc.Inventors: Jeremy Dwayne Miranda, Rafael Domingos Torres, Daniel Olshansky, Anush Mohan, Robert Blake Taylor, Samuel A. Miller, Jehangir Tajik, Ashwin Swaminathan, Lomesh Agarwal, Ali Shahrokni, Prateek Singhal, Joel David Holder, Xuan Zhao, Siddharth Choudhary, Helder Toshiro Suzuki, Hiral Honar Barot, Eran Guendelman, Michael Harold Liebenow, Christian Ivan Robert Moore
-
Publication number: 20200090407Abstract: An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.Type: ApplicationFiled: August 12, 2019Publication date: March 19, 2020Applicant: Magic Leap, Inc.Inventors: Jeremy Dwayne Miranda, Rafael Domingos Torres, Daniel Olshansky, Anush Mohan, Robert Blake Taylor, Samuel A. Miller, Jehangir Tajik, Ashwin Swaminathan, Lomesh Agarwal, Ali Shahrokni, Prateek Singhal, Joel David Holder, Xuan Zhao, Siddharth Choudhary, Helder Toshiro Suzuki, Hiral Honar Barot, Eran Guendelman, Michael Harold Liebenow
-
Publication number: 20200051328Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.Type: ApplicationFiled: October 4, 2019Publication date: February 13, 2020Applicant: Magic Leap, Inc.Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nick Kramer, Ken Tossell
-
Publication number: 20200043236Abstract: A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.Type: ApplicationFiled: August 2, 2019Publication date: February 6, 2020Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Erik Fonseka, Paul M. Greco, Jeffrey Scott Sommers, Bradley Vincent Stuart, Shiuli Das, Suraj Manjunath Shanbhag
-
Publication number: 20190243448Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.Type: ApplicationFiled: January 17, 2019Publication date: August 8, 2019Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edward Joseph Selker, Bradley Vincent Stuart
-
Patent number: 9128866Abstract: Systems and methods may provide for using audio output device driver logic to maintain one or more states of an audio accelerator in a memory store, detect a suspend event, and deactivate the audio accelerator in response to the suspend event. In addition, firmware logic of the audio accelerator may be used to detect a resume event with respect to the audio output accelerator, and retrieve one or more states of the audio accelerator directly from the memory store in response to the resume. Thus, the retrieval of the one or more states can bypass the driver logic.Type: GrantFiled: December 30, 2011Date of Patent: September 8, 2015Assignee: Intel CorporationInventors: Shoumeng Yan, Xiaocheng Zhou, Lomesh Agarwal
-
Publication number: 20140137137Abstract: Systems and methods may provide for using audio output device driver logic to maintain one or more states of an audio accelerator in a memory store, detect a suspend event, and deactivate the audio accelerator in response to the suspend event. In addition, firmware logic of the audio accelerator may be used to detect a resume event with respect to the audio output accelerator, and retrieve one or more states of the audio accelerator directly from the memory store in response to the resume. Thus, the retrieval of the one or more states can bypass the driver logic.Type: ApplicationFiled: December 30, 2011Publication date: May 15, 2014Inventors: Shoumeng Yan, Xiaocheng Zhou, Lomesh Agarwal