Patents by Inventor Samuel A. Miller

Samuel A. Miller has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220182772
    Abstract: Embodiments relate to an audio system for various artificial reality applications. The audio system performs large scale filter optimization for audio rendering, preserving spatial and intra-population characteristics using neural networks. Further, the audio system performs adaptive hearing enhancement-aware binaural rendering. The audio includes an in-ear device with an inertial measurement unit (IMU) and a camera. The camera captures image data of a local area, and the image data is used to correct for IMU drift. In some embodiments, the audio system calculates a transducer to ear response for an individual ear using an equalization prediction or acoustic simulation framework. Individual ear pressure fields as a function of frequency are generated. Frequency-dependent directivity patterns of the transducers are characterized in the free field. In some embodiments, the audio system includes a headset and one or more removable audio apparatuses for enhancing acoustic features of the headset.
    Type: Application
    Filed: February 22, 2022
    Publication date: June 9, 2022
    Inventors: Peter Harty Dodds, Nava K. Balsam, Vamsi Krishna Ithapu, William Owen Brimijoin, II, Samuel Clapp, Christi Miller, Michaela Warnecke, Nils Thomas Fritiof Lunner, Paul Thomas Calamia, Morteza Khaleghimeybodi, Pablo Francisco Faundez Hoffmann, Ravish Mehra, Salvael Ortega Estrada, Tetsuro Oishi
  • Patent number: 11351671
    Abstract: A method for controlling a robotic device includes monitor an action of an operator of the robotic device. The method also includes inferring an intended target based on the monitored action. The method further includes determining an intended action for the intended target. The method still further includes controlling the robotic device to perform the intended action.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: June 7, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Allison Thackston, Samuel Zapolsky, Katarina Miller, Laura Stelzner, Ron Goldman
  • Publication number: 20220113792
    Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.
    Type: Application
    Filed: October 8, 2021
    Publication date: April 14, 2022
    Applicant: Magic Leap, Inc.
    Inventors: Zachary C. Neinstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
  • Patent number: 11290706
    Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: March 29, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Lionel Ernest Edwin, Zachary C. Nienstedt, Ivan Li Chuen Yeoh, Samuel A. Miller, Yan Xu, Jordan Alexander Cazamias
  • Publication number: 20220092852
    Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.
    Type: Application
    Filed: December 3, 2021
    Publication date: March 24, 2022
    Applicant: Magic Leap, Inc.
    Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nicholas Atkinson Kramer, Kenneth William Tossell, Christian Ivan Robert Moore
  • Publication number: 20220092747
    Abstract: The systems and methods described can include approaches to calibrate head-mounted displays for improved viewing experiences. Some methods include receiving data of a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device; receiving data of a first captured image associated with deformed state of the first eyepiece of the head-mounted display device; determining a first transformation that maps the first captured image to the image; and applying the first transformation to a subsequent image for viewing on the first eyepiece of the head-mounted display device.
    Type: Application
    Filed: December 3, 2021
    Publication date: March 24, 2022
    Inventors: Lionel Ernest Edwin, Samuel A. Miller, Etienne Gregoire Grossmann, Brian Christopher Clark, Michael Robert Johnson, Wenyi Zhao, Nukul Sanjay Shah, Po-Kang Huang
  • Publication number: 20220076495
    Abstract: One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.
    Type: Application
    Filed: November 12, 2021
    Publication date: March 10, 2022
    Applicant: MAGIC LEAP, INC.
    Inventors: Brian T. Schowengerdt, Samuel A. Miller
  • Publication number: 20220057862
    Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.
    Type: Application
    Filed: September 2, 2021
    Publication date: February 24, 2022
    Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Bradley Vincent Stuart, Jeffrey Scott Sommers
  • Patent number: 11256090
    Abstract: An augmented reality display system includes an electromagnetic field emitter to emit a known magnetic field in a known coordinate system. The system also includes an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor resulting from the known magnetic field. The system further includes a depth sensor to measure a distance in the known coordinate system. Moreover, the system includes a controller to determine pose information of the electromagnetic sensor relative to the electromagnetic field emitter in the known coordinate system based at least in part on the parameter related to the magnetic flux measured by the electromagnetic sensor and the distance measured by the depth sensor. In addition, the system includes a display system to display virtual content to a user based at least in part on the pose information of the electromagnetic sensor relative to the electromagnetic field emitter.
    Type: Grant
    Filed: September 16, 2020
    Date of Patent: February 22, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Samuel A. Miller, Michael J. Woods, David C. Lundmark
  • Publication number: 20220047741
    Abstract: The device and method of the present disclosure provides for the sanitizing or disinfection of an eyepiece of an optical instrument such as a microscope without removing the microscope from its laboratory setting. The disclosed device comprises a generally cylindrical housing having an open distal end and a closed proximal end forming an interior cavity having an inner surface with a UV reflective coating and internally positioned UV-C LEDs. The open distal end is placed over an eyepiece and secured to a retention ring attached to the eyepiece, the housing and retention ring enveloping the eyepiece for irradiation by UV light. A user then may initiate an irradiation of the eyepiece via a switch which floods the interior cavity via the UV-C LEDs for disinfection of the eyepiece.
    Type: Application
    Filed: August 13, 2021
    Publication date: February 17, 2022
    Applicant: J.H. Technologies, Inc.
    Inventors: John L. Hubacz, Samuel Miller
  • Patent number: 11240622
    Abstract: A dual source spatialized audio system includes a general audio system and a personal audio system. The general system includes a general audio processor and general speakers to produce general sound. The personal system includes a frame to be worn on a head of a user and a plurality of personal speakers attached to the frame. The personal system also includes a head pose sensor to collect head pose data of the user. The personal system further includes a head pose processor to determine a head pose of the user from the head pose data. Moreover, the personal system includes a personal audio processor to generate personal audio data based on the head pose of the user. The personal speakers generate personal sound corresponding to the personal audio data. The personal processor receives timing information/metadata from the general audio processor to synchronize the personal sound with the general sound.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: February 1, 2022
    Assignee: Magic Leap, Inc.
    Inventors: David Thomas Roach, Samuel A. Miller, George Alistair Sanger, Brian Schmidt, Terry Micheal O'Gara, Anastasia Andreyevna Tajik, Jehangir Tajik
  • Patent number: 11226193
    Abstract: Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: January 18, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Ivan Li Chuen Yeoh, Lionel Ernest Edwin, Samuel A. Miller
  • Patent number: 11227435
    Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: January 18, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nicholas Atkinson Kramer, Kenneth William Tossell, Christian Ivan Robert Moore
  • Publication number: 20210400094
    Abstract: One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.
    Type: Application
    Filed: June 29, 2021
    Publication date: December 23, 2021
    Inventor: Samuel A. Miller
  • Patent number: 11205304
    Abstract: An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.
    Type: Grant
    Filed: May 7, 2015
    Date of Patent: December 21, 2021
    Assignee: Magic Leap, Inc.
    Inventor: Samuel A. Miller
  • Patent number: 11205303
    Abstract: One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.
    Type: Grant
    Filed: May 6, 2015
    Date of Patent: December 21, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Brian T. Schowengerdt, Samuel A. Miller
  • Publication number: 20210390787
    Abstract: A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location.
    Type: Application
    Filed: July 15, 2021
    Publication date: December 16, 2021
    Inventors: Silas Warren, Omar Khan, Samuel A. Miller, Tushar Arora
  • Publication number: 20210389593
    Abstract: An augmented reality display system includes a pair of variable focus lens elements that sandwich a waveguide stack. One of the lens elements is positioned between the waveguide stack and a user's eye to correct for refractive errors in the focusing of light projected from the waveguide stack to that eye. The lens elements may also be configured to provide appropriate optical power to place displayed virtual content on a desired depth plane. The other lens element is between the ambient environment and the waveguide stack, and is configured to provide optical power to compensate for aberrations in the transmission of ambient light through the waveguide stack and the lens element closest to the eye. In addition, an eye-tracking system monitors the vergence of the user's eyes and automatically and continuously adjusts the optical powers of the pair of lens elements based on the determined vergence of those eyes.
    Type: Application
    Filed: August 30, 2021
    Publication date: December 16, 2021
    Inventors: Samuel A. Miller, Paul M. Greco, Brian T. Schowengerdt
  • Patent number: 11200646
    Abstract: The systems and methods described can include approaches to calibrate head-mounted displays for improved viewing experiences. Some methods include receiving data of a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device; receiving data of a first captured image associated with deformed state of the first eyepiece of the head-mounted display device; determining a first transformation that maps the first captured image to the image; and applying the first transformation to a subsequent image for viewing on the first eyepiece of the head-mounted display device.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: December 14, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Lionel Ernest Edwin, Samuel A. Miller, Etienne Gregoire Grossmann, Brian Christopher Clark, Michael Robert Johnson, Wenyi Zhao, Nukul Sanjay Shah, Po-Kang Huang
  • Patent number: 11200730
    Abstract: Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: December 14, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Ivan Li Chuen Yeoh, Lionel Ernest Edwin, Samuel A. Miller