Patents Assigned to Pupil Labs GmbH
  • Patent number: 12154383
    Abstract: A system and method for generating data suitable for determining one or more parameters of at least one eye of a subject. The method includes receiving image data of an eye at a first time from a camera of known camera intrinsics and defining an image plane. A first ellipse in the image data is determined. The method includes determining a first eye intersecting line in 3D expected to intersect a 3D center of the eyeball at the first time as a line which is, in the direction of the orientation vector, parallel-shifted to the first center line by an expected distance between the center of the eyeball and a center of the pupil.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: November 26, 2024
    Assignee: PUPIL LABS GmbH
    Inventors: Bernhard Petersch, Kai Dierkes
  • Patent number: 12140771
    Abstract: An eye tracking module and head-wearable device is disclosed. In one example, the eye tracking module includes a module housing which is at least substantially mirror symmetric with respect to a central plane and shaped to partly surround a nose of the user. A scene camera is arranged in and/or on the module housing. The eye tracking module further includes at least one of a first eye camera arranged in and/or on the lower portion of the module housing, wherein a first distance between the first eye camera and the central plane is at most about 20 mm, and a second eye camera arranged in and/or on the lower portion of the module housing, wherein a second distance between the second eye camera and the central plane at least substantially corresponds to the first distance.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: November 12, 2024
    Assignee: PUPIL LABS GmbH
    Inventor: Moritz Kassner
  • Publication number: 20240147031
    Abstract: An eye tracking module for a head-wearable device of a user includes an electronics carrier, an image sensor arranged on the electronics carrier, an optical path for receiving visible light at the image sensor from a first region of interest, and an IR-waveguide arranged with respect to the optical path such that received visible light is at least substantially not diverted and/or guided by the IR-waveguide. The IR-waveguide includes a first input aperture for receiving IR-light from a second region of interest which is different to the first region of interest, and an output aperture for outputting at least a part of the received IR-light towards the image sensor.
    Type: Application
    Filed: October 20, 2023
    Publication date: May 2, 2024
    Applicant: PUPIL LABS GmbH
    Inventor: Moritz KASSNER
  • Publication number: 20240015410
    Abstract: A camera module is disclosed. The camera module is for complementing a support structure of a head-wearable device to form a head-wearable eye tracking device. In one example, the camera module includes a one-piece base structure including a substantially transparent material, and comprising an upper portion, a first leg portion and a second leg portion, a camera connecting structure embedded in the one-piece base structure, a first eye camera connected with the camera connecting structure, and arranged in and/or on the first leg portion, a second eye camera connected with the camera connecting structure, and arranged in and/or on the second leg portion, and a scene camera connected with the camera connecting structure, and arranged in and/or on the upper portion.
    Type: Application
    Filed: June 30, 2023
    Publication date: January 11, 2024
    Applicant: PUPIL LABS GmbH
    Inventor: Moritz KASSNER
  • Publication number: 20230255476
    Abstract: Methods, devices and systems for generating data suitable for determining at least one eye state variable of at least one eye of a subject, and methods and systems for determining such eye state variables are provided. The at least one eye state variable being derivable from at least one image of the eve taken with a camera of known camera intrinsics. Synthetic image data of a first 3D model eye which models corneal refraction can be generated for different sets of eye state variables and may be used to determine said eye state variables using a further 3D eye model comprising at least one parameter. A characteristic of the pupil image in the synthetic images can be determined for later use to determine eye state variables based on image data of real eyes and under use of the further 3D eye model.
    Type: Application
    Filed: March 12, 2021
    Publication date: August 17, 2023
    Applicant: PUPIL LABS GmbH
    Inventors: Bernhard PETERSCH, Kai DIERKES
  • Patent number: 11676422
    Abstract: A system and method for generating data suitable for determining a parameter of a human eye. The method includes receiving a first image of the eye for a first time from a camera of known camera intrinsics defining an image plane, and determining a first ellipse in the first image. The method includes determining a first eye intersecting line expected to intersect a center of the eyeball at the first time as a line which is, in the direction of the orientation vector, parallel-shifted to the first center line by an expected distance between the center of the eyeball and a center of the pupil.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: June 13, 2023
    Assignee: PUPIL LABS GmbH
    Inventors: Kai Dierkes, Moritz Kassner
  • Patent number: 11556741
    Abstract: A method for creating and updating a database is disclosed. In one example, the method includes presenting a first stimulus to a first user wearing a head-wearable device, using a first camera of the head-wearable device to generate. When the first user is expected to respond to the first stimulus or expected to have responded to the first stimulus, using a second camera of the head-wearable device to generate a first right image of at least a portion of the right eye of the first user. A data connection is established between the head-wearable device and the database. A first dataset is generated comprising the first left image, the first right image and a first representation of a gaze-related parameter, the first representation being correlated with the first stimulus, and adding the first dataset to a device database.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: January 17, 2023
    Assignee: PUPIL LABS GmbH
    Inventors: Kai Dierkes, Marc Tonsen, Moritz Kassner
  • Patent number: 11537202
    Abstract: A system and method for generating data suitable for calibrating a head-wearable device is disclosed. In one example the device includes a first eye camera and a scene camera. The first eye camera is used to generate first images of at least a portion of a first eye of the user while the user is expected to look at the object and mimic the not translatory movement. Respective positions of the object in the field images are determined. The determined positions of the object are used to determine the first images respective ground truth values of at least one gaze-direction related parameter of the user.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: December 27, 2022
    Assignee: Pupil Labs GmbH
    Inventors: Moritz Kassner, Marc Tonsen, Kai Dierkes
  • Publication number: 20220342224
    Abstract: An eye tracking module and head-wearable device is disclosed. In one example, the eye tracking module includes a module housing which is at least substantially mirror symmetric with respect to a central plane and shaped to partly surround a nose of the user. A scene camera is arranged in and/or on the module housing. The eye tracking module further includes at least one of a first eye camera arranged in and/or on the lower portion of the module housing, wherein a first distance between the first eye camera and the central plane is at most about 20 mm, and a second eye camera arranged in and/or on the lower portion of the module housing, wherein a second distance between the second eye camera and the central plane at least substantially corresponds to the first distance.
    Type: Application
    Filed: February 19, 2020
    Publication date: October 27, 2022
    Applicant: PUPIL LABS GmbH
    Inventor: Moritz KASSNER
  • Patent number: 11393251
    Abstract: A method for detecting one or more gaze-related parameters of a user is disclosed. In one example, the method includes creating a left image of at least a portion of a left eye of the user using a first camera of a head-wearable device worn by the user, and creating a right image of at least a portion of a right eye of the user using a second camera of the head-wearable device. The left and right images are fed together as an input into a convolutional neural network. One or more gaze-related parameters are obtained from the convolutional neural network as a result of the left and right images input.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: July 19, 2022
    Assignee: Pupil Labs GmbH
    Inventors: Marc Tonsen, Kai Dierkes, Moritz Kassner, Bernhard Petersch
  • Publication number: 20220206573
    Abstract: A system and method for generating data suitable for determining a parameter of a human eye. The method includes receiving a first image of the eye for a first time from a camera of known camera intrinsics defining an image plane, and determining a first ellipse in the first image. The method includes determining a first eye intersecting line expected to intersect a center of the eyeball at the first time as a line which is, in the direction of the orientation vector, parallel-shifted to the first center line by an expected distance between the center of the eyeball and a center of the pupil.
    Type: Application
    Filed: June 5, 2019
    Publication date: June 30, 2022
    Applicant: PUPIL LABS GmbH
    Inventors: Kai DIERKES, Moritz KASSNER
  • Publication number: 20220207919
    Abstract: A system and method for generating data suitable for determining one or more parameters of at least one eye of a subject. The method includes receiving image data of an eye at a first time from a camera of known camera intrinsics and defining an image plane. A first ellipse in the image data is determined. The method includes determining a first eye intersecting line in 3D expected to intersect a 3D center of the eyeball at the first time as a line which is, in the direction of the orientation vector, parallel-shifted to the first center line by an expected distance between the center of the eyeball and a center of the pupil.
    Type: Application
    Filed: May 26, 2020
    Publication date: June 30, 2022
    Applicant: PUPIL LABS GmbH
    Inventors: Bernhard PETERSCH, Kai DIERKES
  • Publication number: 20220198789
    Abstract: A system and method for determining one or more parameters of a user's eye is disclosed. In one example, the system includes a computing unit and a head-wearable device including a first camera having a field of view, and a non-transparent component. The first camera and the non-transparent component are arranged relative to each other so that at least a portion of the eye and at least a portion of the non-transparent component are expected to be in the field of view of the first camera. The computing unit implements a neural network and is configured to receive an image from the first camera, feed the image as an input into the neural network, and determine the one or more parameters as an output of the neural network.
    Type: Application
    Filed: June 18, 2019
    Publication date: June 23, 2022
    Applicant: PUPIL LABS GmbH
    Inventor: Moritz KASSNER
  • Patent number: 11340461
    Abstract: A head-wearable spectacles device for determining one or more gaze-related parameters of a user is disclosed. In one example, the device includes a spectacles body having a middle plane and configured for being wearable on a user's head, a nose bridge portion, a left lateral portion, a right lateral portion, a left ocular opening and a right ocular opening. The middle plane intersects the nose bridge portion. The respective ocular opening is located between the nose bridge portion and the respective lateral portion. The device includes a left camera, a right camera, and a scene camera.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: May 24, 2022
    Assignee: Pupil Labs GmbH
    Inventors: Moritz Kassner, Hannes Geipel
  • Publication number: 20220083134
    Abstract: A system and method for generating data suitable for calibrating a head-wearable device is disclosed. In one example the device includes a first eye camera and a scene camera. The first eye camera is used to generate first images of at least a portion of a first eye of the user while the user is expected to look at the object and mimic the not translatory movement. Respective positions of the object in the field images are determined. The determined positions of the object are used to determine the first images respective ground truth values of at least one gaze-direction related parameter of the user.
    Type: Application
    Filed: January 16, 2019
    Publication date: March 17, 2022
    Applicant: Pupil Labs GmbH
    Inventors: Moritz KASSNER, Marc TONSEN, Kai DIERKES
  • Patent number: 11194161
    Abstract: A head-wearable spectacles device for determining one or more gaze-related parameters of a user is disclosed. In one example, the device includes a spectacles body having a middle plane and configured for being wearable on a user's head, and at least a left and a right ocular opening, wherein both ocular openings define a bounding cuboid having an upper surface, a lower surface, a left lateral surface, and a right lateral surface. The upper surface of the bounding cuboid is oriented perpendicular to the middle plane of the spectacles body.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: December 7, 2021
    Assignee: Pupil Labs GmbH
    Inventors: Moritz Kassner, Kai Dierkes, Marc Tonsen
  • Publication number: 20210247617
    Abstract: A head-wearable spectacles device for determining one or more gaze-related parameters of a user is disclosed. In one example, the device includes a spectacles body having a middle plane and configured for being wearable on a user's head, a nose bridge portion, a left lateral portion, a right lateral portion, a left ocular opening and a right ocular opening. The middle plane intersects the nose bridge portion. The respective ocular opening is located between the nose bridge portion and the respective lateral portion. The device includes a left camera, a right camera, and a scene camera.
    Type: Application
    Filed: November 29, 2018
    Publication date: August 12, 2021
    Applicant: Pupil Labs GmbH
    Inventors: Moritz Kassner, Hannes Geipel
  • Publication number: 20210049410
    Abstract: A method for creating and updating a database is disclosed. In one example, the method includes presenting a first stimulus to a first user wearing a head-wearable device, using a first camera of the head-wearable device to generate. When the first user is expected to respond to the first stimulus or expected to have responded to the first stimulus, using a second camera of the head-wearable device to generate a first right image of at least a portion of the right eye of the first user. A data connection is established between the head-wearable device and the database. A first dataset is generated comprising the first left image, the first right image and a first representation of a gaze-related parameter, the first representation being correlated with the first stimulus, and adding the first dataset to a device database.
    Type: Application
    Filed: February 9, 2018
    Publication date: February 18, 2021
    Applicant: Pupil Labs GmbH
    Inventors: Kai DIERKES, Marc TONSEN, Moritz KASSNER
  • Publication number: 20210041701
    Abstract: A head-wearable spectacles device for determining one or more gaze-related parameters of a user is disclosed. In one example, the device includes a spectacles body having a middle plane and configured for being wearable on a user's head, and at least a left and a right ocular opening, wherein both ocular openings define a bounding cuboid having an upper surface, a lower surface, a left lateral surface, and a right lateral surface. The upper surface of the bounding cuboid is oriented perpendicular to the middle plane of the spectacles body.
    Type: Application
    Filed: February 9, 2018
    Publication date: February 11, 2021
    Applicant: Pupil Labs GmbH
    Inventors: Moritz Kassner, Kai Dierkes, Marc Tonsen
  • Publication number: 20200364453
    Abstract: A method for detecting one or more gaze-related parameters of a user is disclosed. In one example, the method includes creating a left image of at least a portion of a left eye of the user using a first camera of a head-wearable device worn by the user, and creating a right image of at least a portion of a right eye of the user using a second camera of the head-wearable device. The left and right images are fed together as an input into a convolutional neural network. One or more gaze-related parameters are obtained from the convolutional neural network as a result of the left and right images input.
    Type: Application
    Filed: February 9, 2018
    Publication date: November 19, 2020
    Applicant: Pupil Labs GmbH
    Inventors: Marc TONSEN, Kai DIERKES, Moritz KASSNER, Bernhard PETERSCH