Patents by Inventor Jakob Julian Engel
Jakob Julian Engel has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230334798Abstract: The disclosed computer-implemented method may include acquiring, from a client device within a real-world environment, information representative of the real-world environment, and transmitting the information representative of the real-world environment to a relocalization service. The method may further include receiving, from the relocalization service, (1) an anchor point that may include a mapped position within the real-world environment, and (2) a determined position within the real-world environment of a client device relative to the mapped position of the anchor point. The method may further include sending an identifier of the anchor point to an asset management service, and obtaining, from the asset management service, a digital asset. The method may further include presenting the digital asset at a position within an artificial environment relative to the mapped position of the anchor point. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: April 20, 2023Publication date: October 19, 2023Inventors: Alvaro Collet Romea, Jingming Dong, Xiaoyang Gao, Jiawen Zhang, Yuheng Ren, Raul Mur Artal, Christopher Sweeney, Jakob Julian Engel
-
Patent number: 11715269Abstract: The disclosed computer-implemented method may include acquiring, from a client device within a real-world environment, information representative of the real-world environment, and transmitting the information representative of the real-world environment to a relocalization service. The method may further include receiving, from the relocalization service, (1) an anchor point that may include a mapped position within the real-world environment, and (2) a determined position within the real-world environment of a client device relative to the mapped position of the anchor point. The method may further include sending an identifier of the anchor point to an asset management service, and obtaining, from the asset management service, a digital asset. The method may further include presenting the digital asset at a position within an artificial environment relative to the mapped position of the anchor point. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: August 23, 2021Date of Patent: August 1, 2023Assignee: Meta Platforms Technologies, LLCInventors: Alvaro Collet Romea, Jingming Dong, Xiaoyang Gao, Jiawen Zhang, Yuheng Ren, Raul Mur Artal, Christopher Sweeney, Jakob Julian Engel
-
Patent number: 11527011Abstract: In one embodiment, a method includes determining correspondence data between a sequence of images based on identified features in the sequence of images and predicted pose based on motion data, and determining current state information based on the correspondence data and the motion data. The current state information comprises at least a current pose of the wearable device relative to the environment capture by the one or more cameras. Furthermore, the method comprises receiving map points in a three-dimensional map and their associated descriptors based on the identified features in the sequence of images and identifying one or more of the map points in the sequence of images based on the associated descriptors associated with the map points. The current state information is further determined based on the identified one or more of the map points.Type: GrantFiled: September 27, 2021Date of Patent: December 13, 2022Assignee: Meta Platforms Technologies, LLCInventors: Jakob Julian Engel, Anastasios Mourikis, Raul Mur Artal
-
Publication number: 20220122291Abstract: In one embodiment, a method includes determining correspondence data between a sequence of images based on identified features in the sequence of images and predicted pose based on motion data, and determining current state information based on the correspondence data and the motion data. The current state information comprises at least a current pose of the wearable device relative to the environment capture by the one or more cameras. Furthermore, the method comprises receiving map points in a three-dimensional map and their associated descriptors based on the identified features in the sequence of images and identifying one or more of the map points in the sequence of images based on the associated descriptors associated with the map points. The current state information is further determined based on the identified one or more of the map points.Type: ApplicationFiled: September 27, 2021Publication date: April 21, 2022Inventors: Jakob Julian Engel, Anastasios Mourikis, Raul Mur Artal
-
Patent number: 11165982Abstract: A photo sensor includes a plurality of pixel blocks, each including one or more anchor pixels and one or more non-anchor pixels. The anchor pixels produce first sensor signals and the non-anchor pixels produce second sensor signals. An amplifier circuit amplifies the first and second sensor signals. A variable bit-depth analog to digital converter (ADC) circuit quantizes amplified versions of the first sensor signals into first digitized sensor signals with a first bit-depth. The ADC circuit also quantizes amplified versions of the second sensor signals into second digitized sensor signals with a second bit-depth that is lower than the first bit depth. The second bit-depth may be selected based on anchor pixel statistics derived from the one or more first digitized sensor signals.Type: GrantFiled: July 28, 2020Date of Patent: November 2, 2021Assignee: Facebook Technologies, LLCInventors: Xinqiao Liu, Jakob Julian Engel
-
Patent number: 11132841Abstract: The disclosed computer-implemented method may include acquiring, from a client device within a real-world environment, information representative of the real-world environment, and transmitting the information representative of the real-world environment to a relocalization service. The method may further include receiving, from the relocalization service, (1) an anchor point that may include a mapped position within the real-world environment, and (2) a determined position within the real-world environment of a client device relative to the mapped position of the anchor point. The method may further include sending an identifier of the anchor point to an asset management service, and obtaining, from the asset management service, a digital asset. The method may further include presenting the digital asset at a position within an artificial environment relative to the mapped position of the anchor point. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: November 30, 2018Date of Patent: September 28, 2021Assignee: Facebook Technologies, LLCInventors: Alvaro Collet Romea, Jingming Dong, Xiaoyang Gao, Jiawen Zhang, Yuheng Ren, Raul Mur Artal, Christopher Sweeney, Jakob Julian Engel
-
Patent number: 11042749Abstract: The disclosed computer-implemented method may include receiving, from devices in an environment, real-time data associated with the environment and determining, from the real-time data, current object data for the environment. The current object data may include both state data and relationship data for objects in the environment. The method may also include determining object deltas between the current object data and prior object data from an event graph. The prior object data may include prior state data and prior relationship data for the objects. The method may include detecting an unknown state for one of the objects, inferring a state for the object based on the event graph, and updating the event graph based on the object deltas and the inferred state. The method may further include sending updated event graph data to the devices. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: March 18, 2020Date of Patent: June 22, 2021Assignee: Facebook Technologies, LLCInventors: Richard Andrew Newcombe, Jakob Julian Engel, Julian Straub, Thomas John Whelan, Steven John Lovegrove, Yuheng Ren
-
Patent number: 10930077Abstract: The disclosed computer-implemented method may include determining a local position and a local orientation of a local device in an environment and receiving, by the local device and from a mapping system, object data for objects within the environment. The object data may include position data and orientation data for the objects and relationship data between the objects. The method may also include deriving, based on the object data received from the mapping system, and the local position and orientation of the local device, a contextual rendering of the objects that provides contextual data that modifies a user's view of the environment. The method may include displaying, using the local device, the contextual rendering of at least one of the plurality of objects to modify the user's view of the environment. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: September 14, 2018Date of Patent: February 23, 2021Assignee: Facebook Technologies, LLCInventors: Richard Andrew Newcombe, Jakob Julian Engel, Julian Straub, Thomas John Whelan, Steven John Lovegrove, Yuheng Ren
-
Publication number: 20210042958Abstract: In one embodiment, a method includes determining correspondence data between a sequence of images based on identified features in the sequence of images and predicted pose based on motion data, and determining current state information based on the correspondence data and the motion data. The current state information comprises at least a current pose of the wearable device relative to the environment capture by the one or more cameras. Furthermore, the method comprises receiving map points in a three-dimensional map and their associated descriptors based on the identified features in the sequence of images and identifying one or more of the map points in the sequence of images based on the associated descriptors associated with the map points. The current state information is further determined based on the identified one or more of the map points.Type: ApplicationFiled: August 9, 2019Publication date: February 11, 2021Inventors: Jakob Julian Engel, Anastasios Mourikis, Raul Mur Artal
-
Patent number: 10764526Abstract: A photo sensor includes a plurality of pixel blocks, each including one or more anchor pixels and one or more non-anchor pixels. The anchor pixels produce first sensor signals and the non-anchor pixels produce second sensor signals. An amplifier circuit amplifies the first and second sensor signals. A variable bit-depth analog to digital converter (ADC) circuit quantizes amplified versions of the first sensor signals into first digitized sensor signals with a first bit-depth. The ADC circuit also quantizes amplified versions of the second sensor signals into second digitized sensor signals with a second bit-depth that is lower than the first bit depth. The second bit-depth may be selected based on anchor pixel statistics derived from the one or more first digitized sensor signals.Type: GrantFiled: November 1, 2018Date of Patent: September 1, 2020Assignee: FACEBOOK TECHNOLOGIES, LLCInventors: Xinqiao Liu, Jakob Julian Engel
-
Publication number: 20200218898Abstract: The disclosed computer-implemented method may include receiving, from devices in an environment, real-time data associated with the environment and determining, from the real-time data, current object data for the environment. The current object data may include both state data and relationship data for objects in the environment. The method may also include determining object deltas between the current object data and prior object data from an event graph. The prior object data may include prior state data and prior relationship data for the objects. The method may include detecting an unknown state for one of the objects, inferring a state for the object based on the event graph, and updating the event graph based on the object deltas and the inferred state. The method may further include sending updated event graph data to the devices. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: March 18, 2020Publication date: July 9, 2020Inventors: Richard Andrew Newcombe, Jakob Julian Engel, Julian Straub, Thomas John Whelan, Steven John Lovegrove, Yuheng Ren
-
Publication number: 20200175764Abstract: The disclosed computer-implemented method may include acquiring, from a client device within a real-world environment, information representative of the real-world environment, and transmitting the information representative of the real-world environment to a relocalization service. The method may further include receiving, from the relocalization service, (1) an anchor point that may include a mapped position within the real-world environment, and (2) a determined position within the real-world environment of a client device relative to the mapped position of the anchor point. The method may further include sending an identifier of the anchor point to an asset management service, and obtaining, from the asset management service, a digital asset. The method may further include presenting the digital asset at a position within an artificial environment relative to the mapped position of the anchor point. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: November 30, 2018Publication date: June 4, 2020Inventors: Alvaro Collet Romea, Jingming Dong, Xiaoyang Gao, Jiawen Zhang, Yuheng Ren, Raul Mur Artal, Christopher Sweeney, Jakob Julian Engel
-
Patent number: 10635905Abstract: The disclosed computer-implemented method may include receiving, from devices in an environment, real-time data associated with the environment. The method may also include determining, from the real-time data, current mapping and object data. The current mapping data may include coordinate data for the environment and the current object data may include both state data and relationship data for objects in the environment. The method may also include determining mapping deltas between the current mapping data and baseline map data and determining object deltas between the current object data and an event graph. The event graph may include prior state data and prior relationship data for objects. The method may also include updating the baseline map data and the event graph based on the deltas and sending updated baseline map data and event graph data to the devices. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: September 14, 2018Date of Patent: April 28, 2020Assignee: Facebook Technologies, LLCInventors: Richard Andrew Newcombe, Jakob Julian Engel, Julian Straub, Thomas John Whelan, Steven John Lovegrove, Yuheng Ren
-
Publication number: 20200089953Abstract: The disclosed computer-implemented method may include receiving, from devices in an environment, real-time data associated with the environment. The method may also include determining, from the real-time data, current mapping and object data. The current mapping data may include coordinate data for the environment and the current object data may include both state data and relationship data for objects in the environment. The method may also include determining mapping deltas between the current mapping data and baseline map data and determining object deltas between the current object data and an event graph. The event graph may include prior state data and prior relationship data for objects. The method may also include updating the baseline map data and the event graph based on the deltas and sending updated baseline map data and event graph data to the devices. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: September 14, 2018Publication date: March 19, 2020Inventors: Richard Andrew Newcombe, Jakob Julian Engel, Julian Straub, Thomas John Whelan, Steven John Lovegrove, Yuheng Ren