Patents by Inventor Zachary C. Nienstedt
Zachary C. Nienstedt has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12196952Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment may vary for different users and may change over time (e.g., as a user moves around and/or the HMD slips or is otherwise displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.Type: GrantFiled: November 28, 2023Date of Patent: January 14, 2025Assignee: Magic Leap, Inc.Inventors: Lionel Ernest Edwin, Zachary C. Nienstedt, Ivan Li Chuen Yeoh, Samuel A. Miller, Yan Xu, Jordan Alexander Cazamias
-
Publication number: 20240256029Abstract: An augmented reality (AR) system includes a wearable device comprising a display inside the wearable device and operable to display virtual content and an imaging device mounted to the wearable device. The AR system also includes a handheld device comprising handheld fiducials affixed to the handheld device and a computing apparatus configured to perform localization of the handheld device with respect to the wearable device.Type: ApplicationFiled: April 10, 2024Publication date: August 1, 2024Applicant: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Patent number: 11989339Abstract: A method of performing localization of a handheld device with respect to a wearable device includes capturing, by a first imaging device mounted to the handheld device, a fiducial image containing a number of fiducials affixed to the wearable device and capturing, by a second imaging device mounted to the handheld device, a world image containing one or more features surrounding the handheld device. The method also includes obtaining, by a sensor mounted to the handheld device, handheld data indicative of movement of the handheld device, determining the number of fiducials contained in the fiducial image, and updating a position and an orientation of the handheld device using at least one of the fiducial image or the world image and the handheld data.Type: GrantFiled: February 22, 2023Date of Patent: May 21, 2024Assignee: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Publication number: 20240094528Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment may vary for different users and may change over time (e.g., as a user moves around and/or the HMD slips or is otherwise displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.Type: ApplicationFiled: November 28, 2023Publication date: March 21, 2024Inventors: Lionel Ernest EDWIN, Zachary C. NIENSTEDT, Ivan Li Chuen YEOH, Samuel A. MILLER, Yan XU, Jordan Alexander CAZAMIAS
-
Patent number: 11880033Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment may vary for different users and change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.Type: GrantFiled: March 28, 2022Date of Patent: January 23, 2024Assignee: Magic Leap, Inc.Inventors: Lionel Ernest Edwin, Zachary C. Nienstedt, Ivan Li Chuen Yeoh, Samuel A. Miller, Yan Xu, Jordan Alexander Cazamias
-
Publication number: 20230195212Abstract: A method of performing localization of a handheld device with respect to a wearable device includes capturing, by a first imaging device mounted to the handheld device, a fiducial image containing a number of fiducials affixed to the wearable device and capturing, by a second imaging device mounted to the handheld device, a world image containing one or more features surrounding the handheld device. The method also includes obtaining, by a sensor mounted to the handheld device, handheld data indicative of movement of the handheld device, determining the number of fiducials contained in the fiducial image, and updating a position and an orientation of the handheld device using at least one of the fiducial image or the world image and the handheld data.Type: ApplicationFiled: February 22, 2023Publication date: June 22, 2023Applicant: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Patent number: 11625090Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.Type: GrantFiled: October 8, 2021Date of Patent: April 11, 2023Assignee: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Publication number: 20220221934Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.Type: ApplicationFiled: March 28, 2022Publication date: July 14, 2022Inventors: Lionel Ernest Edwin, Zachary C. Nienstedt, Ivan Li Chuen Yeoh, Samuel A. Miller, Yan Xu, Jordan Alexander Cazamias
-
Patent number: 11290706Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.Type: GrantFiled: December 17, 2020Date of Patent: March 29, 2022Assignee: Magic Leap, Inc.Inventors: Lionel Ernest Edwin, Zachary C. Nienstedt, Ivan Li Chuen Yeoh, Samuel A. Miller, Yan Xu, Jordan Alexander Cazamias
-
Patent number: 11181974Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.Type: GrantFiled: October 29, 2020Date of Patent: November 23, 2021Assignee: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Publication number: 20210116991Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.Type: ApplicationFiled: October 29, 2020Publication date: April 22, 2021Applicant: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Publication number: 20210105456Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.Type: ApplicationFiled: December 17, 2020Publication date: April 8, 2021Inventors: Lionel Ernest Edwin, Zachary C. Nienstedt, Ivan Li Chuen Yeoh, Samuel A. Miller, Yan Xu, Jordan Alexander Cazamias
-
Patent number: 10917634Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.Type: GrantFiled: January 17, 2019Date of Patent: February 9, 2021Assignee: Magic Leap, Inc.Inventors: Lionel Ernest Edwin, Zachary C. Nienstedt, Ivan Li Chuen Yeoh, Samuel A. Miller, Yan Xu, Jordan Alexander Cazamias
-
Patent number: 10860090Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.Type: GrantFiled: September 30, 2019Date of Patent: December 8, 2020Assignee: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Publication number: 20200026348Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.Type: ApplicationFiled: September 30, 2019Publication date: January 23, 2020Applicant: Magic Leap, Inc.Inventors: Zachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
-
Patent number: 9915575Abstract: Disclosed is a passive, in-situ pressure sensor. The sensor includes a sensing element having a ferromagnetic metal and a tension inducing mechanism coupled to the ferromagnetic metal. The tension inducing mechanism is operable to change a tensile stress upon the ferromagnetic metal based on a change in pressure in the sensing element. Changes in pressure are detected based on changes in the magnetic switching characteristics of the ferromagnetic metal when subjected to an alternating magnetic field caused by the change in the tensile stress. The sensing element is embeddable in a closed system for detecting pressure changes without the need for any penetrations of the system for power or data acquisition by detecting changes in the magnetic switching characteristics of the ferromagnetic metal caused by the tensile stress.Type: GrantFiled: August 21, 2015Date of Patent: March 13, 2018Assignee: Consolidated Nuclear Security, LLCInventors: David K. Mee, Edward B. Ripley, Zachary C. Nienstedt, Alex W. Nienstedt, Layton N. Howell, Jr.
-
Patent number: 9146168Abstract: Disclosed is a passive, in-situ pressure sensor. The sensor includes a sensing element having a ferromagnetic metal and a tension inducing mechanism coupled to the ferromagnetic metal. The tension inducing mechanism is operable to change a tensile stress upon the ferromagnetic metal based on a change in pressure in the sensing element. Changes in pressure are detected based on changes in the magnetic switching characteristics of the ferromagnetic metal when subjected to an alternating magnetic field caused by the change in the tensile stress. The sensing element is embeddable in a closed system for detecting pressure changes without the need for any penetrations of the system for power or data acquisition by detecting changes in the magnetic switching characteristics of the ferromagnetic metal caused by the tensile stress.Type: GrantFiled: March 15, 2013Date of Patent: September 29, 2015Assignee: Consolidated Nuclear Security, LLCInventors: David K. Mee, Edward B. Ripley, Zachary C. Nienstedt, Alex W. Nienstedt, Layton N. Howell, Jr.