Patents by Inventor Tobias Eble
Tobias Eble has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240095879Abstract: In one implementation, a method of generating an image is performed by a device including one or more processors and non-transitory memory. The method includes generating a first resolution function based on a formula with a set of variables having a first set of values. The method includes generating a first image based on first content and the first resolution function. The method includes detecting a resolution constraint. The method includes generating a second resolution function based on the formula with the set of variables having a second set of values, wherein the second resolution function has a summation value that satisfies the resolution constraint. The method includes generating a second image based on second content and the second resolution function.Type: ApplicationFiled: September 18, 2023Publication date: March 21, 2024Inventors: Andreas Gapel, Nitin Nandakumar, Sabine Webel, Tobias Eble
-
Publication number: 20240087080Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.Type: ApplicationFiled: November 16, 2023Publication date: March 14, 2024Inventors: Tobias Eble, Ye Cong, Cody J. White, Arthur Yasheng Zhang, Randall Rauwendaal, Moinul Khan, Jim C. Chou, Hao Pan, Nicolas Bonnier
-
Patent number: 11915349Abstract: Various implementations disclosed herein interpret data that define curves to display the curves in a 2D or 3D environment. In some implementations, vertices are used to represent control points that specify the geometry of a curve. These vertices are changed in an extrusion process that moves and/or adds vertices to ensure that sufficient pixels are available for anti-aliasing during rasterization, while also providing changed vertices that can be interpreted to accurately render the curve's geometry.Type: GrantFiled: March 15, 2022Date of Patent: February 27, 2024Inventors: Nitin Nandakumar, Tobias Eble, Shenyao Ke
-
Publication number: 20240062413Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.Type: ApplicationFiled: October 26, 2023Publication date: February 22, 2024Inventors: Jeffrey S. Norris, Alexandre Da Veiga, Bruno M. Sommer, Ye Cong, Tobias Eble, Moinul Khan, Nicolas Bonnier, Hao Pan
-
Publication number: 20230419439Abstract: Various implementations disclosed herein include a method performed at an electronic device including one or more processors, a non-transitory memory, an image sensor, and a display device. The method includes obtaining, via the image sensor, an input image that includes an object. The method includes obtaining depth information characterizing the object, wherein the depth information characterizes a first distance between the image sensor and a portion of the object. The method includes determining a distance warp map for the input image based on a function of the depth information and a first offset value characterizing an estimated distance between eyes of a user and the display device. The method includes setting an operational parameter for the electronic device based on the distance warp map and generating, by the electronic device set to the operational parameter, a warped image from the input image.Type: ApplicationFiled: September 11, 2023Publication date: December 28, 2023Inventors: Tobias Eble, Pedro Manuel Da Silva Quelhas, Raffi A. Bedikian
-
Patent number: 11836885Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.Type: GrantFiled: May 6, 2019Date of Patent: December 5, 2023Inventors: Tobias Eble, Ye Cong, Cody J. White, Arthur Yasheng Zhang, Randall Rauwendaal, Moinul Khan, Jim C. Chou, Hao Pan, Nicolas Bonnier
-
Patent number: 11830214Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.Type: GrantFiled: May 29, 2019Date of Patent: November 28, 2023Assignee: APPLE INC.Inventors: Jeffrey S. Norris, Alexandre Da Veiga, Bruno M. Sommer, Ye Cong, Tobias Eble, Moinul Khan, Nicolas Bonnier, Hao Pan
-
Patent number: 11823343Abstract: A method and device for modifying virtual content according to various simulation characteristics includes obtaining first virtual content; obtaining one or more simulation characteristics; and generating second virtual content by modifying the first virtual content according to the one or more simulation characteristics; and presenting the second virtual content.Type: GrantFiled: March 22, 2021Date of Patent: November 21, 2023Assignee: APPLE INC.Inventors: Dhruv Aditya Govil, Sabine Webel, Olivier Denis Roger Gutknecht, Shruti Singhal, Tobias Eble, Pal Kristian Engstad, Ivan Gavrenkov
-
Publication number: 20230351672Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user’s environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.Type: ApplicationFiled: June 29, 2023Publication date: November 2, 2023Applicant: Apple Inc.Inventors: Arthur Y. Zhang, Ray L. Chang, Timothy R. Oriol, Ling Su, Gurjeet S. Saund, Guy Cote, Jim C. Chou, Hao Pan, Tobias Eble, Avi Bar-Zeev, Sheng Zhang, Justin A. Hensley, Geoffrey Stahl
-
Publication number: 20230334684Abstract: In one implementation, a method of scene camera retargeting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a scene camera, and a display. The method includes capturing, using the scene camera, an image of a scene. The method includes determining, using the one or more processors, a depth of the scene. The method further includes transforming, using the one or more processors, the image of the scene based on the depth and a difference between a point-of-view of the scene camera and a point-of-view of a user. The method further includes displaying, on the display, the transformed image.Type: ApplicationFiled: June 21, 2023Publication date: October 19, 2023Inventors: Tobias Eble, Thomas Post
-
Patent number: 11789688Abstract: Various implementations disclosed herein include devices, systems, and methods for presenting content based on environmental data. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes obtaining environmental data associated with a physical environment in which the device is located. In some implementations, the method includes selecting, from a plurality of presentation modes, a first presentation mode for content based on the environmental data. In some implementations, the method includes presenting the content in accordance with the first presentation mode.Type: GrantFiled: February 10, 2021Date of Patent: October 17, 2023Assignee: APPLE INC.Inventors: Shruti Singhal, Pal Kristian Engstad, Tobias Eble, Norman Nuo Wang, Ivan Gavrenkov, Olivier Denis Roger Gutknecht, Sabine Webel
-
Publication number: 20230324988Abstract: Various implementations disclosed herein include devices, systems, and methods that assess calibration between eye tracking and other components of a head-mounted device (HMD) using another device, such as a mobile device. For example, an example process may include obtaining first sensor data captured by a first sensor of a first device, the first sensor data including a representation of a portion of a second device, obtaining second sensor data captured by a second sensor of the second device, detecting a position of the first sensor of the first device based on the second sensor data, and assessing a calibration between the portion of the second device and the sensor of the second device based on the first sensor data and the detected position of the first sensor.Type: ApplicationFiled: June 24, 2021Publication date: October 12, 2023Inventors: Tobias EBLE, Tom SENGELAUB
-
Patent number: 11783444Abstract: Various implementations disclosed herein include a method performed at an electronic device including one or more processors, a non-transitory memory, an image sensor, and a display device. The method includes obtaining, via the image sensor, an input image that includes an object. The method includes obtaining depth information characterizing the object, wherein the depth information characterizes a first distance between the image sensor and a portion of the object. The method includes determining a distance warp map for the input image based on a function of the depth information and a first offset value characterizing an estimated distance between eyes of a user and the display device. The method includes setting an operational parameter for the electronic device based on the distance warp map and generating, by the electronic device set to the operational parameter, a warped image from the input image.Type: GrantFiled: September 22, 2020Date of Patent: October 10, 2023Assignee: APPLE INC.Inventors: Tobias Eble, Pedro Manuel Da Silva Quelhas, Raffi A. Bedikian
-
Publication number: 20230305625Abstract: Eye tracking is performed by determining an initial pupil position of a user in relation to a lens situated in front of the user, detecting a change in pupil position in relation to the lens to an updated pupil position in relation to the lens, and determining that the updated pupil position is outside a bounding box associated with the lens. The updated pupil position is a replacement pupil position with a replacement pupil position within the bounding box associated with the lens, and the updated pupil position is utilized for eye-tracking functionality. Eye tracking is also performed by determining that a first pixel associated with a gaze direction is outside a visibility region, identifying a replacement pixel within the visibility region, determining an updated gaze angle based on the replacement pixel, and performing eye tracking using the updated gaze angle.Type: ApplicationFiled: November 17, 2022Publication date: September 28, 2023Inventors: Jacob Wilson, Tobias Eble, Sabine Webel, Hariprasad Puthukkootil Rajagopal, Andreas Gapel, Ritesh Gangadhar Sholapur
-
Publication number: 20230290088Abstract: In one implementation, a method of displaying overlapping objects is performed at a device including an optical see-through display, one or more processors, and a non-transitory memory. The method includes obtaining a request to display a first object in front of a second object. The method includes modifying a transparency of the first object in a region corresponding to an overlap between the first object and the second object. The method includes displaying the first object in front of the second object while maintaining visibility of the second object through the overlap between the first object and the second object based on the modified transparency.Type: ApplicationFiled: May 23, 2023Publication date: September 14, 2023Inventor: Tobias Eble
-
Patent number: 11727619Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.Type: GrantFiled: June 18, 2021Date of Patent: August 15, 2023Assignee: Apple Inc.Inventors: Arthur Y Zhang, Ray L. Chang, Timothy R. Oriol, Ling Su, Gurjeet S. Saund, Guy Cote, Jim C. Chou, Hao Pan, Tobias Eble, Avi Bar-Zeev, Sheng Zhang, Justin A. Hensley, Geoffrey Stahl
-
Patent number: 11706383Abstract: In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.Type: GrantFiled: June 22, 2018Date of Patent: July 18, 2023Assignee: APPLE INC.Inventors: Tobias Eble, Sabine Webel
-
Patent number: 11699267Abstract: In one implementation, a method of displaying overlapping objects is performed at a device including an optical see-through display, one or more processors, and a non-transitory memory. The method includes obtaining a request to display a first object in front of a second object. The method includes modifying a transparency of the first object in a region corresponding to an overlap between the first object and the second object. The method includes displaying the first object in front of the second object while maintaining visibility of the second object through the overlap between the first object and the second object based on the modified transparency.Type: GrantFiled: January 26, 2021Date of Patent: July 11, 2023Assignee: APPLE INC.Inventor: Tobias Eble
-
Patent number: 11694352Abstract: In one implementation, a method of scene camera retargeting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a scene camera, and a display. The method includes capturing, using the scene camera, an image of a scene. The method includes determining, using the one or more processors, a depth of the scene. The method further includes transforming, using the one or more processors, the image of the scene based on the depth and a difference between a point-of-view of the scene camera and a point-of-view of a user. The method further includes displaying, on the display, the transformed image.Type: GrantFiled: May 3, 2022Date of Patent: July 4, 2023Assignee: APPLE INC.Inventors: Tobias Eble, Thomas Post
-
Patent number: 11694379Abstract: In one implementation, a method of displaying an animation is performed at a device including an optical see-through display, one or more processors, and a non-transitory memory. The method includes receiving a request to display a first animation of an object exhibiting a response characteristic. The method includes determining a metric characterizing an amount of processing power for the device to display the first animation on the optical see-through display. The method includes, in response to a determination that the metric exceeds a threshold associated with the device, selecting a second animation of the object exhibiting the response characteristic. The method includes displaying the second animation.Type: GrantFiled: January 28, 2021Date of Patent: July 4, 2023Assignee: APPLE INC.Inventors: Sabine Webel, Olivier Denis Roger Gutknecht, Pal Kristian Engstad, Ivan Gavrenkov, Tobias Eble, Shruti Singhal