Patents by Inventor John James Robertson

John James Robertson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11963105
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Grant
    Filed: February 10, 2023
    Date of Patent: April 16, 2024
    Assignee: Snap Inc.
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Publication number: 20240036336
    Abstract: A magnification application for use with augmented reality (AR) eyewear devices. The magnification application enables a user of an eyewear device to activate a magnification overlay on a display whenever a camera on the eyewear device detects that the field of view includes a registered virtual marker. The magnified overlay includes one or more frames of the captured video data, presented according to a predefined and configurable magnification power. A pointer including a vector and a visual tether guides the user toward the virtual marker. When the eyewear device location is near a perimeter associated with the virtual marker, the magnified overlay appears in a predefined and configurable frame on the display.
    Type: Application
    Filed: July 28, 2022
    Publication date: February 1, 2024
    Inventors: Alexander Sourov, John James Robertson
  • Publication number: 20230422176
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Application
    Filed: September 5, 2023
    Publication date: December 28, 2023
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Publication number: 20230350206
    Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services it provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
    Type: Application
    Filed: July 6, 2023
    Publication date: November 2, 2023
    Applicant: Snap Inc.
    Inventors: Sumant Hanumante, Bernhard Jung, Matthias Kalkgruber, Anton Kondratenko, Edward Lee Kim-Koon, Gerald Nilles, John James Robertson, Dmitry Ryuma, Alexander Sourov, Daniel Wolf
  • Publication number: 20230344929
    Abstract: Systems and methods for generating an alert on an eyewear device are provided. The systems and methods include receiving, by an eyewear device, from a mobile device, data indicative of a first combination of notification attributes that trigger a first alert on the eyewear device; determining that the mobile device has received a new notification based on additional data received from the mobile device; determining that a combination of attributes of the new notification matches the first combination of notification attributes; and in response to determining that the combination of the attributes of the new notification matches the first combination of notification attributes, retrieving, from a storage device of the eyewear device, a first visual indicator animation that represents the first alert; and activating a visual indicator of the eyewear device in accordance with the retrieved first visual indicator animation to generate the first alert on the eyewear device.
    Type: Application
    Filed: June 30, 2023
    Publication date: October 26, 2023
    Inventors: John James Robertson, Andrew Joseph Bartow, Samuel Ahn, Matthew Du
  • Publication number: 20230328479
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. One embodiment involves pairing a client device with a wearable device, capturing a first client location fix at a first time using the first application and location circuitry of the client device. The client device then receives content from the wearable device, where the content is associated with a content capture time and location state data. The client device then updates a location based on the available data to reconcile the different sets of location data. In some embodiments, additional sensor data, such as data from an accelerometer, is used is used to determine which location data is more accurate for certain content.
    Type: Application
    Filed: June 7, 2023
    Publication date: October 12, 2023
    Inventors: Yu Jiang Tham, John James Robertson, Antoine Ménard, Tamer El Calamawy
  • Patent number: 11785549
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Grant
    Filed: November 23, 2021
    Date of Patent: October 10, 2023
    Assignee: Snap Inc.
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Patent number: 11736604
    Abstract: Systems and methods for generating an alert on an eyewear device are provided. The systems and methods include receiving, by an eyewear device, from a mobile device, data indicative of a first combination of notification attributes that trigger a first alert on the eyewear device; determining that the mobile device has received a new notification based on additional data received from the mobile device; determining that a combination of attributes of the new notification matches the first combination of notification attributes; and in response to determining that the combination of the attributes of the new notification matches the first combination of notification attributes, retrieving, from a storage device of the eyewear device, a first visual indicator animation that represents the first alert; and activating a visual indicator of the eyewear device in accordance with the retrieved first visual indicator animation to generate the first alert on the eyewear device.
    Type: Grant
    Filed: April 8, 2022
    Date of Patent: August 22, 2023
    Assignee: SNAP INC.
    Inventors: John James Robertson, Andrew Joseph Bartow, Samuel Ahn, Matthew Du
  • Patent number: 11719939
    Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
    Type: Grant
    Filed: May 9, 2022
    Date of Patent: August 8, 2023
    Assignee: Snap Inc.
    Inventors: Sumant Hanumante, Bernhard Jung, Matthias Kalkgruber, Anton Kondratenko, Edward Lee Kim-Koon, Gerald Nilles, John James Robertson, Dmitry Ryuma, Alexander Sourov, Daniel Wolf
  • Patent number: 11716592
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. One embodiment involves pairing a client device with a wearable device, capturing a first client location fix at a first time using the first application and location circuitry of the client device. The client device then receives content from the wearable device, where the content is associated with a content capture time and location state data. The client device then updates a location based on the available data to reconcile the different sets of location data. In some embodiments, additional sensor data, such as data from an accelerometer, is used is used to determine which location data is more accurate for certain content.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: August 1, 2023
    Assignee: Snap Inc.
    Inventors: Yu Jiang Tham, John James Robertson, Antoine Ménard, Tamer El Calamawy
  • Publication number: 20230189155
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Application
    Filed: February 10, 2023
    Publication date: June 15, 2023
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Patent number: 11606755
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: March 14, 2023
    Assignee: Snap Inc.
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Publication number: 20230013680
    Abstract: A neural network system includes an eyewear device. The eyewear device has a movement tracker, such as an accelerometer, gyroscope, or an inertial measurement unit for measuring acceleration and rotation. The neural network system tracks, via the movement tracker, movement of the eyewear device from at least one finger contact inputted from a user on an input surface. The neural network system identifies a finger gesture by detecting at least one detected touch event based on variation of the tracked movement of the eyewear device over a time period. The neural network system adjusts the image presented on the image display of the eyewear device based on the identified finger gesture. The neural network system can also detect whether the user is wearing the eyewear device and identify an activity of the user wearing the eyewear device based on the variation of the tracked movement over the time period.
    Type: Application
    Filed: September 29, 2022
    Publication date: January 19, 2023
    Inventors: John James Robertson, Zsolt Mathe
  • Publication number: 20220373401
    Abstract: A method and apparatus for monitoring a surface temperature of eyewear proximate a processor to understand the surface temperature as a function of computer instructions, such as when the computer instructions are modified during software design. A sensor is coupled to the eyewear proximate the processor, such as at a temple of the eyewear including the processor, using one or more layers of tape. A server provides instructions to the processor for execution, such as instructions of an application, which instructions vary the utilization of the processor. A testing device, such as a digital multi-meter, is coupled to the sensor, as well as the server, and displays the surface temperature as a function of the processor utilization. The surface temperature of the eyewear is monitored to ensure the surface temperature does not exceed a temperature threshold.
    Type: Application
    Filed: May 10, 2022
    Publication date: November 24, 2022
    Inventors: Andrea Ashwood, Mingyang Chai, Gerald Nilles, John James Robertson, Mehmood Zafarullahkhan
  • Publication number: 20220365348
    Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
    Type: Application
    Filed: May 9, 2022
    Publication date: November 17, 2022
    Inventors: Sumant Hanumante, Bernhard Jung, Matthias Kalkgruber, Anton Kondratenko, Edward Lee Kim-Koon, Gerald Nilles, John James Robertson, Dmitry Ryuma, Alexander Sourov, Daniel Wolf
  • Patent number: 11500536
    Abstract: A neural network system includes an eyewear device. The eyewear device has a movement tracker, such as an accelerometer, gyroscope, or an inertial measurement unit for measuring acceleration and rotation. The neural network system tracks, via the movement tracker, movement of the eyewear device from at least one finger contact inputted from a user on an input surface. The neural network system identifies a finger gesture by detecting at least one detected touch event based on variation of the tracked movement of the eyewear device over a time period. The neural network system adjusts the image presented on the image display of the eyewear device based on the identified finger gesture. The neural network system can also detect whether the user is wearing the eyewear device and identify an activity of the user wearing the eyewear device based on the variation of the tracked movement over the time period.
    Type: Grant
    Filed: April 30, 2021
    Date of Patent: November 15, 2022
    Assignee: Snap Inc.
    Inventors: John James Robertson, Zsolt Mathe
  • Publication number: 20220232115
    Abstract: Systems and methods for generating an alert on an eyewear device are provided. The systems and methods include receiving, by an eyewear device, from a mobile device, data indicative of a first combination of notification attributes that trigger a first alert on the eyewear device; determining that the mobile device has received a new notification based on additional data received from the mobile device; determining that a combination of attributes of the new notification matches the first combination of notification attributes; and in response to determining that the combination of the attributes of the new notification matches the first combination of notification attributes, retrieving, from a storage device of the eyewear device, a first visual indicator animation that represents the first alert; and activating a visual indicator of the eyewear device in accordance with the retrieved first visual indicator animation to generate the first alert on the eyewear device.
    Type: Application
    Filed: April 8, 2022
    Publication date: July 21, 2022
    Inventors: John James Robertson, Andrew Joseph Bartow, Samuel Ahn, Matthew Du
  • Publication number: 20220159576
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Application
    Filed: November 23, 2021
    Publication date: May 19, 2022
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Patent number: 11330094
    Abstract: Systems and methods for generating an alert on an eyewear device are provided. The systems and methods include receiving, by an eyewear device, from a mobile device, data indicative of a first combination of notification attributes that trigger a first alert on the eyewear device; determining that the mobile device has received a new notification based on additional data received from the mobile device; determining that a combination of attributes of the new notification matches the first combination of notification attributes; and in response to determining that the combination of the attributes of the new notification matches the first combination of notification attributes, retrieving from a storage device of the eyewear device, a first visual indicator animation that represents the first alert; and activating a visual indicator of the eyewear device in accordance with the retrieved first visual indicator animation to generate the first alert on the eyewear device.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: May 10, 2022
    Assignee: Snap Inc.
    Inventors: John James Robertson, Andrew Joseph Bartow, Samuel Ahn, Matthew Du
  • Publication number: 20220103757
    Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
    Type: Application
    Filed: August 29, 2021
    Publication date: March 31, 2022
    Inventors: Bo Ding, Chintan Doshi, Alexander Kane, John James Robertson, Dmitry Ryuma