Patents by Inventor Robert Konrad

Robert Konrad has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12437869
    Abstract: Embodiments are related to a headset integrated into a healthcare platform. The headset comprises one or more sensors embedded into a frame of the headset, a controller coupled to the one or more sensors, and a transceiver coupled to the controller. The one or more sensors capture health information data for a user wearing the headset. The controller pre-processes at least a portion of the captured health information data to generate a pre-processed portion of the health information data. The transceiver communicates the health information data and the pre-processed portion of health information data to an intermediate device communicatively coupled to the headset. The intermediate device processes at least one of the health information data and the pre-processed portion of health information data to generate processed health information data for a health-related diagnostic of the user.
    Type: Grant
    Filed: January 20, 2022
    Date of Patent: October 7, 2025
    Assignee: Sesame AI, Inc.
    Inventors: Robert Konrad, Kevin Boyle, Nitish Padmanaban, Gordon Wetzstein
  • Patent number: 12287915
    Abstract: An event camera system for pupil detection may include a camera assembly and a controller, and may also include one or more off-axis light sources. The camera assembly may include one or more infrared (IR) light sources and an event camera. The one or more IR light sources are configured to emit pulses of IR light along an optical path toward an eyebox. The IR light is reflected from an eye in the eyebox, and the reflected light propagates back along the optical path toward the event camera for detection. The controller is configured to determine an orientation of the eye using data output from the event camera.
    Type: Grant
    Filed: November 15, 2022
    Date of Patent: April 29, 2025
    Assignee: Sesame AI, Inc.
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban
  • Patent number: 12124624
    Abstract: An event camera system for pupil detection may include a camera assembly and a controller, and may also include one or more off-axis light sources. The camera assembly may include one or more infrared (IR) light sources and an event camera. The one or more IR light sources are configured to emit pulses of IR light along an optical path toward an eyebox. The IR light is reflected from an eye in the eyebox, and the reflected light propagates back along the optical path toward the event camera for detection. The controller is configured to determine an orientation of the eye using data output from the event camera.
    Type: Grant
    Filed: November 15, 2022
    Date of Patent: October 22, 2024
    Assignee: Sesame AI, Inc.
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban
  • Publication number: 20240160012
    Abstract: An event camera system for pupil detection may include a camera assembly and a controller, and may also include one or more off-axis light sources. The camera assembly may include one or more infrared (IR) light sources and an event camera. The one or more IR light sources are configured to emit pulses of IR light along an optical path toward an eyebox. The IR light is reflected from an eye in the eyebox, and the reflected light propagates back along the optical path toward the event camera for detection. The controller is configured to determine an orientation of the eye using data output from the event camera.
    Type: Application
    Filed: November 15, 2022
    Publication date: May 16, 2024
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban
  • Publication number: 20240045215
    Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.
    Type: Application
    Filed: October 19, 2023
    Publication date: February 8, 2024
    Inventors: Michael Anthony KLUG, Robert KONRAD, Gordon WETZSTEIN, Brian T. SCHOWENGERDT, Michal Beau Dennison VAUGHN
  • Patent number: 11835724
    Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.
    Type: Grant
    Filed: February 13, 2023
    Date of Patent: December 5, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Michael Anthony Klug, Robert Konrad, Gordon Wetzstein, Brian T. Schowengerdt, Michal Beau Dennison Vaughn
  • Publication number: 20230240606
    Abstract: Embodiments are related to a system with a headset capable of monitoring psychomotor performance of a user of the headset based on eyelid tracking information. The headset includes a sensor assembly coupled to a frame of the headset, and a transceiver coupled to the sensor assembly. The sensor assembly is configured to track an eyelid of an eye of the user and capture eyelid tracking information. The transceiver is configured to obtain the eyelid tracking information from the sensor assembly and communicate the eyelid tracking information to a secondary device coupled to the headset for processing the eyelid tracking information and determination of sleep information for the user based in part on the processed eyelid tracking information.
    Type: Application
    Filed: January 19, 2023
    Publication date: August 3, 2023
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban
  • Publication number: 20230194879
    Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.
    Type: Application
    Filed: February 13, 2023
    Publication date: June 22, 2023
    Inventors: Michael Anthony Klug, Robert Konrad, Gordon Wetzstein, Brian T. Schowengerdt, Michal Beau Dennison Vaughn
  • Publication number: 20230195220
    Abstract: An event camera system for pupil detection may include a camera assembly and a controller, and may also include one or more off-axis light sources. The camera assembly may include one or more infrared (IR) light sources and an event camera. The one or more IR light sources are configured to emit pulses of IR light along an optical path toward an eyebox. The IR light is reflected from an eye in the eyebox, and the reflected light propagates back along the optical path toward the event camera for detection. The controller is configured to determine an orientation of the eye using data output from the event camera.
    Type: Application
    Filed: November 15, 2022
    Publication date: June 22, 2023
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban
  • Patent number: 11662574
    Abstract: A device includes a camera assembly and a controller. The camera assembly is configured to capture images of both eyes of a user. Using the captured images, the controller determines a location for each pupil of each eye of the user. The determined pupil locations and captured images are used to determine eye tracking parameters which are used to compute values of eye tracking functions. With the computed values and a model that maps the eye tracking functions to gaze depths, a gaze depth of the user is determined. An action is performed based on the determined gaze depth.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: May 30, 2023
    Assignee: Zinn Labs, Inc.
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban, Gordon Wetzstein
  • Patent number: 11625095
    Abstract: Embodiments are related to a plurality of gaze sensors embedded into a frame of a headset for detection of a gaze vector of a user wearing the headset and user's control at the headset. The gaze vector for an eye of the user can be within a threshold distance from one of the gaze sensors. By monitoring signals detected by the gaze sensors, it can be determined that the gaze vector is within the threshold distance from the gaze sensor. Based on this determination, at least one action associated with the headset is initiated.
    Type: Grant
    Filed: January 20, 2022
    Date of Patent: April 11, 2023
    Assignee: Zinn Labs, Inc.
    Inventors: Robert Konrad, Kevin Boyle, Nitish Padmanaban, Gordon Wetzstein
  • Patent number: 11614628
    Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: March 28, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Michael Anthony Klug, Robert Konrad, Gordon Wetzstein, Brian T. Schowengerdt, Michal Beau Dennison Vaughn
  • Patent number: 11543883
    Abstract: An event camera system for pupil detection may include a camera assembly and a controller, and may also include one or more off-axis light sources. The camera assembly may include one or more infrared (IR) light sources and an event camera. The one or more IR light sources are configured to emit pulses of IR light along an optical path toward an eyebox. The IR light is reflected from an eye in the eyebox, and the reflected light propagates back along the optical path toward the event camera for detection. The controller is configured to determine an orientation of the eye using data output from the event camera.
    Type: Grant
    Filed: December 16, 2021
    Date of Patent: January 3, 2023
    Assignee: Zinn Labs, Inc.
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban
  • Publication number: 20220238220
    Abstract: Embodiments are related to a headset integrated into a healthcare platform. The headset comprises one or more sensors embedded into a frame of the headset, a controller coupled to the one or more sensors, and a transceiver coupled to the controller. The one or more sensors capture health information data for a user wearing the headset. The controller pre-processes at least a portion of the captured health information data to generate a pre-processed portion of the health information data. The transceiver communicates the health information data and the pre-processed portion of health information data to an intermediate device communicatively coupled to the headset. The intermediate device processes at least one of the health information data and the pre-processed portion of health information data to generate processed health information data for a health-related diagnostic of the user.
    Type: Application
    Filed: January 20, 2022
    Publication date: July 28, 2022
    Inventors: Robert Konrad, Kevin Boyle, Nitish Padmanaban, Gordon Wetzstein
  • Publication number: 20220236796
    Abstract: Embodiments are related to a plurality of gaze sensors embedded into a frame of a headset for detection of a gaze vector of a user wearing the headset and user's control at the headset. The gaze vector for an eye of the user can be within a threshold distance from one of the gaze sensors. By monitoring signals detected by the gaze sensors, it can be determined that the gaze vector is within the threshold distance from the gaze sensor. Based on this determination, at least one action associated with the headset is initiated.
    Type: Application
    Filed: January 20, 2022
    Publication date: July 28, 2022
    Inventors: Robert Konrad, Kevin Boyle, Nitish Padmanaban, Gordon Wetzstein
  • Publication number: 20220197376
    Abstract: An event camera system for pupil detection may include a camera assembly and a controller, and may also include one or more off-axis light sources. The camera assembly may include one or more infrared (IR) light sources and an event camera. The one or more IR light sources are configured to emit pulses of IR light along an optical path toward an eyebox. The IR light is reflected from an eye in the eyebox, and the reflected light propagates back along the optical path toward the event camera for detection. The controller is configured to determine an orientation of the eye using data output from the event camera.
    Type: Application
    Filed: December 16, 2021
    Publication date: June 23, 2022
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban
  • Publication number: 20220146819
    Abstract: A device includes a camera assembly and a controller. The camera assembly is configured to capture images of both eyes of a user. Using the captured images, the controller determines a location for each pupil of each eye of the user. The determined pupil locations and captured images are used to determine eye tracking parameters which are used to compute values of eye tracking functions. With the computed values and a model that maps the eye tracking functions to gaze depths, a gaze depth of the user is determined. An action is performed based on the determined gaze depth.
    Type: Application
    Filed: November 9, 2021
    Publication date: May 12, 2022
    Inventors: Kevin Boyle, Robert Konrad, Nitish Padmanaban, Gordon Wetzstein
  • Publication number: 20220146834
    Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.
    Type: Application
    Filed: January 21, 2022
    Publication date: May 12, 2022
    Inventors: Michael Anthony Klug, Robert Konrad, Gordon Wetzstein, Brian T. Schowengerdt, Michal Beau Dennison Vaughn
  • Patent number: 11231584
    Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.
    Type: Grant
    Filed: October 20, 2017
    Date of Patent: January 25, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Michael Anthony Klug, Robert Konrad, Gordon Wetzstein, Brian T. Schowengerdt, Michal Beau Dennison Vaughn
  • Patent number: 11215837
    Abstract: A method for providing augmented reality contents to a wearer using a head-mounted display device that includes an eye tracking sensor, a light projector, a beam steerer, and a combiner includes determining, with the eye tracking sensor, a position of a pupil of an eye of the wearer. The method also includes projecting, with the light projector, light for rendering images based at least on the augmented reality contents, and changing, with the beam steerer, a direction of the light from the light projector based on the position of the pupil. The light from the beam steerer is directed toward the combiner and the light from the beam steerer and light from an outside of the head-mounted display device are combined, by the combiner, to provide an overlap of a rendered image and a real image that corresponds to the light from the outside of the head-mounted display device.
    Type: Grant
    Filed: August 9, 2019
    Date of Patent: January 4, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Douglas Robert Lanman, Robert Konrad, Robert Dale Cavin