Patents by Inventor Gerald Nilles
Gerald Nilles has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11719939Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.Type: GrantFiled: May 9, 2022Date of Patent: August 8, 2023Assignee: Snap Inc.Inventors: Sumant Hanumante, Bernhard Jung, Matthias Kalkgruber, Anton Kondratenko, Edward Lee Kim-Koon, Gerald Nilles, John James Robertson, Dmitry Ryuma, Alexander Sourov, Daniel Wolf
-
Patent number: 11714463Abstract: Systems and methods are presented for establishing a communication link between two or more electronic devices. A portable eyewear electronic device is configured to communicate with a handheld electronic device, such as a ring, that in turn is retained by an accessory electronic device to establish a wired communication link. The accessory electronic device may be retained or housed by a second accessory electronic device, such as a remote control or wearable device.Type: GrantFiled: January 26, 2022Date of Patent: August 1, 2023Assignee: Snap Inc.Inventors: Nir Daube, Gerald Nilles, Jonathan M. Rodriguez, II, Yu Jiang Tham
-
Patent number: 11705742Abstract: Disclosed herein are regulated power supplies. The power source delivers power to a system load and includes battery units. The power source also includes power flow devices coupled to the battery units that are configured to provide power from the battery units to the system load. Each power flow device corresponds to a respective one of the battery units, and includes a one direction current flow device connected in series with a current regulator between the respective battery unit and the system load.Type: GrantFiled: August 26, 2022Date of Patent: July 18, 2023Assignee: Snap Inc.Inventors: Gerald Nilles, Russell Douglas Patton, Raul Alejandro Perez, Patrick Timothy Mcsweeney Simons
-
Publication number: 20230214343Abstract: An eyewear device that includes a plurality of SoCs that share processing workload, and a USB port configured to perform low-power debugging and automation of the plurality of SoCs, such as using either a Universal Asynchronous Receiver-Transmitter (UART) or a Serial Wire Debug (SWD). The eyewear includes a USB hub configured such that the USB port can simultaneously communicate with the plurality of SoCs. The USB hub can be shut down to disable the USB hub, and all the SoCs can enter their low-power modes without being kept awake by a persistent USB connection. The eyewear includes a first switch and a control logic, wherein the control logic controls the first switch and enables the USB port to perform low-power debugging and automation of the SoCs. The eyewear further includes a second switch, wherein the control logic controls the second switch to enable the USB port to perform low-power debugging and automation of the SoCs via a processor, or to enable the USB port to control each of the SoCs.Type: ApplicationFiled: December 31, 2021Publication date: July 6, 2023Inventors: Alex Feinman, Jason Heger, Shaheen Moubedi, Gerald Nilles, John Recchio, Praveen Babu Vadivelu
-
Patent number: 11681361Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.Type: GrantFiled: May 12, 2022Date of Patent: June 20, 2023Assignee: Snap Inc.Inventors: Jeroen Diederik Hol, Matthias Kalkgruber, Erick Mendez Mendez, Niall Murphy, Gerald Nilles, Mathieu Emmanuel Vignau
-
Publication number: 20230189155Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.Type: ApplicationFiled: February 10, 2023Publication date: June 15, 2023Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
-
Patent number: 11663941Abstract: Eyewear including a projector having a variable feedback loop controlling a forward current delivered to a colored light source. The colored light source is configured to generate a colored light beam to generate a displayed image. The variable feedback loop in one example has a variable resistance to selectively generate a high brightness image when the eyewear is operated outside, or in a high ambient light setting, and to selectively generate a nominal brightness image when the eyewear is operated inside. A controller selectively controls the drive current delivered to the colored light source to control the brightness mode of the image.Type: GrantFiled: March 17, 2022Date of Patent: May 30, 2023Assignee: Snap Inc.Inventors: Jason Heger, Gerald Nilles
-
Publication number: 20230117720Abstract: Eyewear device that includes two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear device, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate all peripheral components, and a second SoC performing computational tasks. This is a low-risk architecture since the second SoC is not required to operate any of the peripherals, and it has low standby power since the second SoC can be fully shutdown in a low-power mode. The second SoC does not have any direct access to camera data, so an interprocessor communication bus continuously transmits camera buffer data for most augmented reality (AR) compute tasks. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.Type: ApplicationFiled: October 14, 2021Publication date: April 20, 2023Inventors: Jason Heger, Gerald Nilles, Patrick Timothy McSweeney Simons
-
Publication number: 20230124748Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have similar assigned responsibilities to operate the same types of peripheral components and perform similar processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a first computer vision (CV) camera, and a first display, and perform three-dimensional graphics and compositing. A second SoC operates a second color camera, a second CV camera, and a second display. The SoCs are synchronized since peripheral components are operated by both SoCs. Each of the SoCs have an operating system (OS), CV algorithms, and visual odometry (VIO), e.g., for tracking hand gestures of the user, and providing depth from stereo images from the color cameras. This configuration provides simplified organized logistics to efficiently operate various features, and balanced power consumption.Type: ApplicationFiled: October 14, 2021Publication date: April 20, 2023Inventors: Jason Heger, Gerald Nilles, Patrick Timothy McSweeney Simons
-
Publication number: 20230123344Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate displays, and it performs three-dimensional graphics and compositing. A second SoC operates first and second color cameras, first and second computer vision (CV) cameras, an operating system (OS), CV algorithms, and visual odometry (VIO), and it performs hand gesture tracking of the user and provides depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.Type: ApplicationFiled: October 14, 2021Publication date: April 20, 2023Inventors: Jason Heger, Gerald Nilles, Patrick Timothy McSweeney Simons
-
Publication number: 20230117690Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.Type: ApplicationFiled: October 14, 2021Publication date: April 20, 2023Inventors: Jason Heger, Gerald Nilles, Dmitry Ryuma, Patrick Timothy McSweeney Simons, Daniel Wagner
-
Publication number: 20230109916Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.Type: ApplicationFiled: October 7, 2021Publication date: April 13, 2023Inventors: Jason Heger, Gerald Nilles, Dmitry Ryuma, Patrick Timothy McSweeney Simons, Daniel Wagner
-
Publication number: 20230108702Abstract: A circuit includes a first system-on-chip (SoC) driven by a first clock generator and a second SoC driven by a second clock generator where the first clock generator and the second clock generator have independent time bases. The first and second clock generators are synchronized using an RLC circuit external to the first clock generator and the second clock generator that converts an output of the first clock generator into current pulses and injects the current pulses into the second clock generator to pull an output of the second clock generator into synchronization with the output of the first clock generator. The RLC circuit converts a voltage output of the first clock generator into current pulses at the resonant frequency or specific harmonics of the output of the first clock generator. The second clock generator may include a ring oscillator into which the current pulses are injected.Type: ApplicationFiled: October 5, 2021Publication date: April 6, 2023Inventors: Jason Heger, Gerald Nilles
-
Patent number: 11606755Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.Type: GrantFiled: May 26, 2021Date of Patent: March 14, 2023Assignee: Snap Inc.Inventors: Yu Jiang Tham, John James Robertson, Gerald Nilles, Jason Heger, Praveen Babu Vadivelu
-
Publication number: 20230063078Abstract: Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.Type: ApplicationFiled: August 24, 2021Publication date: March 2, 2023Inventors: Praveen Babu Vadivelu, Jason Heger, Gerald Nilles, Alex Feinman, Dunxu Hu
-
Publication number: 20220417419Abstract: Apparatuses and systems for electronic wearable devices such as smart glasses are described. The wearable device can comprise a housing, an image capture component, a locking component, and a control component. The housing defines an imaging aperture. The image capture component is coupled to the housing and aligned with the imaging aperture. The image capture component is configured to capture image data of a field of view aligned with the imaging aperture. The locking component is coupled to the image capture component. The locking component modifies a capture state of the image capture component to selectively enable image capture in response to a selection releasing the locking component. The control component is coupled to the locking component. Interaction with the control component comprises the selection releasing the locking component and triggering modification of the capture state of the image capture component.Type: ApplicationFiled: August 24, 2022Publication date: December 29, 2022Inventors: Jonathan M. Rodriguez, II, Gerald Nilles
-
Publication number: 20220416550Abstract: Disclosed herein are regulated power supplies. The power source delivers power to a system load and includes battery units. The power source also includes power flow devices coupled to the battery units that are configured to provide power from the battery units to the system load. Each power flow device corresponds to a respective one of the battery units, and includes a one direction current flow device connected in series with a current regulator between the respective battery unit and the system load.Type: ApplicationFiled: August 26, 2022Publication date: December 29, 2022Inventors: Gerald Nilles, Russell Douglas Patton, Raul Alejandro Perez, Patrick Timothy Mcsweeney Simons
-
Publication number: 20220373401Abstract: A method and apparatus for monitoring a surface temperature of eyewear proximate a processor to understand the surface temperature as a function of computer instructions, such as when the computer instructions are modified during software design. A sensor is coupled to the eyewear proximate the processor, such as at a temple of the eyewear including the processor, using one or more layers of tape. A server provides instructions to the processor for execution, such as instructions of an application, which instructions vary the utilization of the processor. A testing device, such as a digital multi-meter, is coupled to the sensor, as well as the server, and displays the surface temperature as a function of the processor utilization. The surface temperature of the eyewear is monitored to ensure the surface temperature does not exceed a temperature threshold.Type: ApplicationFiled: May 10, 2022Publication date: November 24, 2022Inventors: Andrea Ashwood, Mingyang Chai, Gerald Nilles, John James Robertson, Mehmood Zafarullahkhan
-
Publication number: 20220365348Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.Type: ApplicationFiled: May 9, 2022Publication date: November 17, 2022Inventors: Sumant Hanumante, Bernhard Jung, Matthias Kalkgruber, Anton Kondratenko, Edward Lee Kim-Koon, Gerald Nilles, John James Robertson, Dmitry Ryuma, Alexander Sourov, Daniel Wolf
-
Publication number: 20220365592Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.Type: ApplicationFiled: May 12, 2022Publication date: November 17, 2022Inventors: Jeroen Diederik Hol, Matthias Kalkgruber, Erick Mendez Mendez, Niall Murphy, Gerald Nilles, Mathieu Emmanuel Vignau