Patents by Inventor Raphaël Berner

Raphaël Berner has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250056136
    Abstract: A sensor device comprises a plurality of sensor units each of which being capable to detect an intensity of an influence on the sensor unit, and to detect as an event a positive or negative change of the intensity of the influence that is larger than a respective predetermined threshold, a filter unit configured to randomly select for readout a part of the events that were detected by the plurality of sensor units during at least one predetermined time period, a memory unit configured to store history data of detected events and/or of readout selection operations of the filter unit, and an output interface configured to receive and output the selected part of the events from the filter unit for each of the at least one predetermined time periods.
    Type: Application
    Filed: November 28, 2022
    Publication date: February 13, 2025
    Applicant: Sony Semiconductor Solutions Corporation
    Inventors: Raphael BERNER, Christian Peter BRÄNDLI, Mojdeh MOHAJERANI
  • Publication number: 20240292127
    Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
    Type: Application
    Filed: May 2, 2024
    Publication date: August 29, 2024
    Inventors: Raphael Berner, Christian Brändli
  • Publication number: 20240276117
    Abstract: In dynamic vision sensor (DVS) or change detection sensors, the chip or sensor is configured to control or modulate the event rate. For example, this control can be used to keep the event rate close to a desired rate or within desired bounds. Adapting the configuration of the sensor to the scene by changing the ON-event and/or the OFF-event thresholds, allows having necessary amount of data, but not much more than necessary, such that the overall system gets as much information about its state as possible.
    Type: Application
    Filed: April 16, 2024
    Publication date: August 15, 2024
    Inventors: Raphäel Berner, Christian Brändli, Massimo Zannoni
  • Patent number: 12058459
    Abstract: An NMOS-only operational transconductance amplifier (OTA) replaces the PMOS transistors with switched capacitor pseudo-resistors in the pixels of an optical sensor such as a dynamic vision sensor or event-based vision sensor. Thus, if a stacked CMOS image sensor (CIS) process is employed, then the upper wafer can be kept free from N-wells, while still having the complete OTA on the upper wafer. Thus, it is possible to have only one wafer-to-wafer connection per pixel. Moreover, by operating the switched capacitor pseudo-resistors as three terminal devices, the gain can further be increased.
    Type: Grant
    Filed: May 8, 2020
    Date of Patent: August 6, 2024
    Assignee: SONY ADVANCED VISUAL SENSING AG
    Inventors: Raphael Berner, Chistian Brändli
  • Patent number: 12010447
    Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
    Type: Grant
    Filed: June 7, 2023
    Date of Patent: June 11, 2024
    Assignee: SONY ADVANCED VISUAL SENSING AG
    Inventors: Raphael Berner, Christian Brändli
  • Publication number: 20240187750
    Abstract: An event-based vision sensor system comprises an event-based pixel array including pixels that detect light, a readout circuit for reading out events associated with light received by each pixel and with the position it occupies in the array, and a memory controller that enables writing of each event, or event-related data, associated with a certain pixel to a certain address in a memory.
    Type: Application
    Filed: February 15, 2024
    Publication date: June 6, 2024
    Inventors: Raphael Berner, Christian Brandli, Massimo Zannoni
  • Patent number: 11991466
    Abstract: In dynamic vision sensor (DVS) or change detection sensors, the chip or sensor is configured to control or modulate the event rate. For example, this control can be used to keep the event rate close to a desired rate or within desired bounds. Adapting the configuration of the sensor to the scene by changing the ON-event and/or the OFF-event thresholds, allows having necessary amount of data, but not much more than necessary, such that the overall system gets as much information about its state as possible.
    Type: Grant
    Filed: August 16, 2022
    Date of Patent: May 21, 2024
    Assignee: Sony Advanced Visual Sensing AG
    Inventors: Raphael Berner, Christian Brändli, Massimo Zannoni
  • Publication number: 20240107194
    Abstract: An event based pixel sensor system employing delay equalization between differently illuminated pixels.
    Type: Application
    Filed: December 4, 2023
    Publication date: March 28, 2024
    Inventor: Raphael Berner
  • Patent number: 11936995
    Abstract: An event-based vision sensor system comprises an event-based pixel array including pixels that detect light, a readout circuit for reading out events associated with light received by each pixel and with the position it occupies in the array, and a memory controller that enables writing of each event, or event-related data, associated with a certain pixel to a certain address in a memory.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: March 19, 2024
    Assignee: Sony Advanced Visual Sensing AG
    Inventors: Raphael Berner, Christian Brandli, Massimo Zannoni
  • Patent number: 11886637
    Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.
    Type: Grant
    Filed: December 13, 2022
    Date of Patent: January 30, 2024
    Assignee: Sony Advanced Visual Sensing AG
    Inventors: Christian Brandli, Raphael Berner, Michael Gassner
  • Publication number: 20240015416
    Abstract: A photoreceptor module (PR) includes a photoelectric conversion element (PD), a first amplifier circuit (110) and a second amplifier circuit (120). The first amplifier circuit (110) includes a first amplifier portion (112) and a first feedback portion (114), wherein an input of the first amplifier portion (112) and a cathode (C) of the photoelectric conversion element (PD) are electrically connected. The second amplifier circuit (120) includes a second amplifier portion (122) and a second feedback portion (124), wherein controlled path of the second feedback portion (124), a controlled path of the first feedback portion (114), and the photoelectric conversion element (PD) are electrically connected in series.
    Type: Application
    Filed: November 25, 2021
    Publication date: January 11, 2024
    Applicant: Sony Semiconductor Solutions Corporation
    Inventors: Raphael BERNER, Massimo ZANNONI
  • Patent number: 11856310
    Abstract: An event based pixel sensor system employing delay equalization between differently illuminated pixels.
    Type: Grant
    Filed: September 1, 2020
    Date of Patent: December 26, 2023
    Assignee: Sony Advanced Visual Sensing AG
    Inventor: Raphael Berner
  • Patent number: 11825229
    Abstract: A dynamic vision sensor such as an event based vision sensor employs analog to digital converters (ADC), such as ramp ADCs, that analog to digital converts the signals from photoreceptors. Only previous light values need to be stored in the pixels. This is accomplished by generating three ramps. In addition, log compression can be implemented by increasing the count linearly while increasing the reference voltage exponentially, or increasing the count logarithmically while increasing the reference voltage linearly.
    Type: Grant
    Filed: May 8, 2020
    Date of Patent: November 21, 2023
    Assignee: SONY ADVANCED VISUAL SENSING AG
    Inventors: Christian Brändli, Raphael Berner
  • Patent number: 11825218
    Abstract: An event based pixel sensor system employs regions of interest or regions of non-interest, which are preferably dynamic, to isolate change events and reduce data from non-interesting events.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: November 21, 2023
    Assignee: Sony Advanced Visual Sensing AG
    Inventors: Raphael Berner, Marc Osswald, Massimo Zannoni
  • Patent number: 11812169
    Abstract: A dynamic vision sensor such as an event based vision sensor employs analog to digital converters (ADC), such as ramp ADCs, that analog to digital converts the signals from photoreceptors. Current and previous light values are then stored and compared digitally. In addition, log compression can be implemented by increasing the count linearly while increasing the reference voltage exponentially, or increasing the count logarithmically while increasing the reference voltage linearly.
    Type: Grant
    Filed: May 8, 2020
    Date of Patent: November 7, 2023
    Assignee: Sony Advanced Visual Sensing AG
    Inventors: Christian Brändli, Raphael Berner
  • Publication number: 20230328406
    Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
    Type: Application
    Filed: June 7, 2023
    Publication date: October 12, 2023
    Inventors: Raphael Berner, Christian Brändli
  • Patent number: 11711631
    Abstract: A dynamic vision sensor (DVS) or change detection sensor reacts to changes in light intensity and in this way monitors how a scene changes. This disclosure covers both single pixel and array architectures. The DVS may contain one pixel or 2-dimensional or 1-dimensional array of pixels. The change of intensities registered by pixels are compared, and pixel addresses where the change is positive or negative are recorded and processed. Analyzing frames based on just three values for pixels, increase, decrease or unchanged, the proposed DVS can process visual information much faster than traditional computer vision systems, which correlate multi-bit color or gray level pixel values between successive frames.
    Type: Grant
    Filed: July 2, 2021
    Date of Patent: July 25, 2023
    Assignee: Sony Advanced Visual Sensing AG
    Inventors: Raphael Berner, Christian Brändli
  • Publication number: 20230185372
    Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.
    Type: Application
    Filed: December 13, 2022
    Publication date: June 15, 2023
    Inventors: Christian Brandli, Raphael Berner, Michael Gassner
  • Patent number: 11652126
    Abstract: An event-based vision sensor is fabricated using an advanced stacking technique, known as Three-Dimensional Integrated Circuit, which stacks more wafers (or dies) and interconnects them vertically. The electronic integrated circuits of the sensor are then distributed between the two or more electrically connected dies.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: May 16, 2023
    Assignee: SONY ADVANCED VISUAL SENSING AG
    Inventors: Raphael Berner, Christian Brändli, Massimo Zannoni
  • Patent number: 11526209
    Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: December 13, 2022
    Assignee: Sony Advanced Visual Sensing AG
    Inventors: Christian Brändli, Raphael Berner, Michael Gassner