Patents by Inventor Gerald Nilles

Gerald Nilles has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11719939
    Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
    Type: Grant
    Filed: May 9, 2022
    Date of Patent: August 8, 2023
    Assignee: Snap Inc.
    Inventors: Sumant Hanumante, Bernhard Jung, Matthias Kalkgruber, Anton Kondratenko, Edward Lee Kim-Koon, Gerald Nilles, John James Robertson, Dmitry Ryuma, Alexander Sourov, Daniel Wolf
  • Patent number: 11714463
    Abstract: Systems and methods are presented for establishing a communication link between two or more electronic devices. A portable eyewear electronic device is configured to communicate with a handheld electronic device, such as a ring, that in turn is retained by an accessory electronic device to establish a wired communication link. The accessory electronic device may be retained or housed by a second accessory electronic device, such as a remote control or wearable device.
    Type: Grant
    Filed: January 26, 2022
    Date of Patent: August 1, 2023
    Assignee: Snap Inc.
    Inventors: Nir Daube, Gerald Nilles, Jonathan M. Rodriguez, II, Yu Jiang Tham
  • Patent number: 11705742
    Abstract: Disclosed herein are regulated power supplies. The power source delivers power to a system load and includes battery units. The power source also includes power flow devices coupled to the battery units that are configured to provide power from the battery units to the system load. Each power flow device corresponds to a respective one of the battery units, and includes a one direction current flow device connected in series with a current regulator between the respective battery unit and the system load.
    Type: Grant
    Filed: August 26, 2022
    Date of Patent: July 18, 2023
    Assignee: Snap Inc.
    Inventors: Gerald Nilles, Russell Douglas Patton, Raul Alejandro Perez, Patrick Timothy Mcsweeney Simons
  • Publication number: 20230214343
    Abstract: An eyewear device that includes a plurality of SoCs that share processing workload, and a USB port configured to perform low-power debugging and automation of the plurality of SoCs, such as using either a Universal Asynchronous Receiver-Transmitter (UART) or a Serial Wire Debug (SWD). The eyewear includes a USB hub configured such that the USB port can simultaneously communicate with the plurality of SoCs. The USB hub can be shut down to disable the USB hub, and all the SoCs can enter their low-power modes without being kept awake by a persistent USB connection. The eyewear includes a first switch and a control logic, wherein the control logic controls the first switch and enables the USB port to perform low-power debugging and automation of the SoCs. The eyewear further includes a second switch, wherein the control logic controls the second switch to enable the USB port to perform low-power debugging and automation of the SoCs via a processor, or to enable the USB port to control each of the SoCs.
    Type: Application
    Filed: December 31, 2021
    Publication date: July 6, 2023
    Inventors: Alex Feinman, Jason Heger, Shaheen Moubedi, Gerald Nilles, John Recchio, Praveen Babu Vadivelu
  • Patent number: 11681361
    Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.
    Type: Grant
    Filed: May 12, 2022
    Date of Patent: June 20, 2023
    Assignee: Snap Inc.
    Inventors: Jeroen Diederik Hol, Matthias Kalkgruber, Erick Mendez Mendez, Niall Murphy, Gerald Nilles, Mathieu Emmanuel Vignau
  • Publication number: 20230189155
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Application
    Filed: February 10, 2023
    Publication date: June 15, 2023
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Patent number: 11663941
    Abstract: Eyewear including a projector having a variable feedback loop controlling a forward current delivered to a colored light source. The colored light source is configured to generate a colored light beam to generate a displayed image. The variable feedback loop in one example has a variable resistance to selectively generate a high brightness image when the eyewear is operated outside, or in a high ambient light setting, and to selectively generate a nominal brightness image when the eyewear is operated inside. A controller selectively controls the drive current delivered to the colored light source to control the brightness mode of the image.
    Type: Grant
    Filed: March 17, 2022
    Date of Patent: May 30, 2023
    Assignee: Snap Inc.
    Inventors: Jason Heger, Gerald Nilles
  • Publication number: 20230117720
    Abstract: Eyewear device that includes two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear device, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate all peripheral components, and a second SoC performing computational tasks. This is a low-risk architecture since the second SoC is not required to operate any of the peripherals, and it has low standby power since the second SoC can be fully shutdown in a low-power mode. The second SoC does not have any direct access to camera data, so an interprocessor communication bus continuously transmits camera buffer data for most augmented reality (AR) compute tasks. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.
    Type: Application
    Filed: October 14, 2021
    Publication date: April 20, 2023
    Inventors: Jason Heger, Gerald Nilles, Patrick Timothy McSweeney Simons
  • Publication number: 20230124748
    Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have similar assigned responsibilities to operate the same types of peripheral components and perform similar processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a first computer vision (CV) camera, and a first display, and perform three-dimensional graphics and compositing. A second SoC operates a second color camera, a second CV camera, and a second display. The SoCs are synchronized since peripheral components are operated by both SoCs. Each of the SoCs have an operating system (OS), CV algorithms, and visual odometry (VIO), e.g., for tracking hand gestures of the user, and providing depth from stereo images from the color cameras. This configuration provides simplified organized logistics to efficiently operate various features, and balanced power consumption.
    Type: Application
    Filed: October 14, 2021
    Publication date: April 20, 2023
    Inventors: Jason Heger, Gerald Nilles, Patrick Timothy McSweeney Simons
  • Publication number: 20230123344
    Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate displays, and it performs three-dimensional graphics and compositing. A second SoC operates first and second color cameras, first and second computer vision (CV) cameras, an operating system (OS), CV algorithms, and visual odometry (VIO), and it performs hand gesture tracking of the user and provides depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.
    Type: Application
    Filed: October 14, 2021
    Publication date: April 20, 2023
    Inventors: Jason Heger, Gerald Nilles, Patrick Timothy McSweeney Simons
  • Publication number: 20230117690
    Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.
    Type: Application
    Filed: October 14, 2021
    Publication date: April 20, 2023
    Inventors: Jason Heger, Gerald Nilles, Dmitry Ryuma, Patrick Timothy McSweeney Simons, Daniel Wagner
  • Publication number: 20230109916
    Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.
    Type: Application
    Filed: October 7, 2021
    Publication date: April 13, 2023
    Inventors: Jason Heger, Gerald Nilles, Dmitry Ryuma, Patrick Timothy McSweeney Simons, Daniel Wagner
  • Publication number: 20230108702
    Abstract: A circuit includes a first system-on-chip (SoC) driven by a first clock generator and a second SoC driven by a second clock generator where the first clock generator and the second clock generator have independent time bases. The first and second clock generators are synchronized using an RLC circuit external to the first clock generator and the second clock generator that converts an output of the first clock generator into current pulses and injects the current pulses into the second clock generator to pull an output of the second clock generator into synchronization with the output of the first clock generator. The RLC circuit converts a voltage output of the first clock generator into current pulses at the resonant frequency or specific harmonics of the output of the first clock generator. The second clock generator may include a ring oscillator into which the current pulses are injected.
    Type: Application
    Filed: October 5, 2021
    Publication date: April 6, 2023
    Inventors: Jason Heger, Gerald Nilles
  • Patent number: 11606755
    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: March 14, 2023
    Assignee: Snap Inc.
    Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
  • Publication number: 20230063078
    Abstract: Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.
    Type: Application
    Filed: August 24, 2021
    Publication date: March 2, 2023
    Inventors: Praveen Babu Vadivelu, Jason Heger, Gerald Nilles, Alex Feinman, Dunxu Hu
  • Publication number: 20220417419
    Abstract: Apparatuses and systems for electronic wearable devices such as smart glasses are described. The wearable device can comprise a housing, an image capture component, a locking component, and a control component. The housing defines an imaging aperture. The image capture component is coupled to the housing and aligned with the imaging aperture. The image capture component is configured to capture image data of a field of view aligned with the imaging aperture. The locking component is coupled to the image capture component. The locking component modifies a capture state of the image capture component to selectively enable image capture in response to a selection releasing the locking component. The control component is coupled to the locking component. Interaction with the control component comprises the selection releasing the locking component and triggering modification of the capture state of the image capture component.
    Type: Application
    Filed: August 24, 2022
    Publication date: December 29, 2022
    Inventors: Jonathan M. Rodriguez, II, Gerald Nilles
  • Publication number: 20220416550
    Abstract: Disclosed herein are regulated power supplies. The power source delivers power to a system load and includes battery units. The power source also includes power flow devices coupled to the battery units that are configured to provide power from the battery units to the system load. Each power flow device corresponds to a respective one of the battery units, and includes a one direction current flow device connected in series with a current regulator between the respective battery unit and the system load.
    Type: Application
    Filed: August 26, 2022
    Publication date: December 29, 2022
    Inventors: Gerald Nilles, Russell Douglas Patton, Raul Alejandro Perez, Patrick Timothy Mcsweeney Simons
  • Publication number: 20220373401
    Abstract: A method and apparatus for monitoring a surface temperature of eyewear proximate a processor to understand the surface temperature as a function of computer instructions, such as when the computer instructions are modified during software design. A sensor is coupled to the eyewear proximate the processor, such as at a temple of the eyewear including the processor, using one or more layers of tape. A server provides instructions to the processor for execution, such as instructions of an application, which instructions vary the utilization of the processor. A testing device, such as a digital multi-meter, is coupled to the sensor, as well as the server, and displays the surface temperature as a function of the processor utilization. The surface temperature of the eyewear is monitored to ensure the surface temperature does not exceed a temperature threshold.
    Type: Application
    Filed: May 10, 2022
    Publication date: November 24, 2022
    Inventors: Andrea Ashwood, Mingyang Chai, Gerald Nilles, John James Robertson, Mehmood Zafarullahkhan
  • Publication number: 20220365348
    Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
    Type: Application
    Filed: May 9, 2022
    Publication date: November 17, 2022
    Inventors: Sumant Hanumante, Bernhard Jung, Matthias Kalkgruber, Anton Kondratenko, Edward Lee Kim-Koon, Gerald Nilles, John James Robertson, Dmitry Ryuma, Alexander Sourov, Daniel Wolf
  • Publication number: 20220365592
    Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.
    Type: Application
    Filed: May 12, 2022
    Publication date: November 17, 2022
    Inventors: Jeroen Diederik Hol, Matthias Kalkgruber, Erick Mendez Mendez, Niall Murphy, Gerald Nilles, Mathieu Emmanuel Vignau