Patents by Inventor Lucian Ion
Lucian Ion has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11972342Abstract: A image sensor includes a first integrated circuit layer including pixel sensors that are grouped based on position into pixel sensor groups, a second integrated circuit layer in electrical communication with the first integrated circuit layer, the second integrated circuit layer including image processing circuitry groups that are configured to each receive pixel information from a corresponding pixel sensor group, the image processing circuitry groups further configured to perform image processing operations on the pixel information to provide processed pixel information during operation of the image sensor, a third integrated circuit layer in electrical communication with the second integrated circuit layer, and the third integrated circuit layer including neural network circuitry groups that are configured to each receive the processed pixel information from a corresponding image processing circuitry group and perform analysis for object detection on the processed pixel information during operation of theType: GrantFiled: June 14, 2021Date of Patent: April 30, 2024Assignee: Waymo LLCInventors: Lucian Ion, Vlad Constantin Cardei, Carl Warren Craddock
-
Patent number: 11962924Abstract: An apparatus includes an image sensor having a plurality of pixels that form regions of interest (ROIs), analog-to-digital converter (ADC) banks, and multiplexers. Each respective multiplexer is electrically connected to (i) a corresponding ADC bank and (ii) a corresponding subset of the ROIs. The apparatus also includes control circuitry configured to obtain a full-resolution image of an environment by electrically connecting, by way of the multiplexers, each respective ADC bank to the associated respective ROI. The control circuitry is also configured to select a particular ROI based on the full-resolution image and obtain a plurality of ROI images of the particular ROI by (i) electrically connecting, to the particular ROI, a first ADC bank associated with the particular ROI and a second ADC bank associated with another ROI and (ii) digitizing pixels of the particular ROI by way of parallel operation of the first and second ADC banks.Type: GrantFiled: March 18, 2022Date of Patent: April 16, 2024Assignee: Waymo, LLCInventors: Lucian Ion, Nirav Dharia, Vlad Cardei
-
Publication number: 20240119560Abstract: Described examples relate to an apparatus comprising one or more image sensors coupled to a vehicle and at least one processor. The at least one processor may be configured to capture, in a burst sequence using the one or more image sensors, multiple frames of an image of a scene, the multiple frames having respective, relative offsets of the image across the multiple frames and perform super-resolution computations using the captured, multiple frames of the image of the scene. The at least one processor may also be configured to accumulate, based on the super-resolution computations, color planes and combine, using the one or more processors, the accumulated color planes to create a super-resolution image of the scene.Type: ApplicationFiled: December 6, 2023Publication date: April 11, 2024Inventors: Ignacio Garcia Dorado, Damien Kelly, Xiaoying He, Jia Feng, Bartlomiej Wronski, Peyman Milanfar, Lucian Ion
-
Patent number: 11933647Abstract: A system may include a first sensor of a first type and a second sensor of a second different type and having a detector. A field of view of the second sensor may be formed by a plurality of regions of interest (ROIs) defined by the detector. Control circuitry of the system may be configured to perform operations including obtaining, from the first sensor, first sensor data representing an environment, and determining, based on the first sensor data, information associated with a feature of interest within the environment. The operations may also include determining, based on the information, a particular ROI that corresponds to an expected position of the feature at a later time, obtaining a plurality of ROI sensor data from the particular ROI instead of obtaining full-resolution sensor data, and analyzing the plurality of ROI sensor data to determine one or more attributes of the feature.Type: GrantFiled: July 25, 2022Date of Patent: March 19, 2024Assignee: Waymo LLCInventors: Nirav Dharia, Giulia Guidi, Ralph Shepard, Vlad Cardei, Lucian Ion
-
Patent number: 11920770Abstract: Example embodiments described herein involve a system for testing a light-emitting module. The light-emitting module may include a mounting platform configured to hold a light-emitting module for a camera. The mounting platform may also be configured to rotate. The system may further include a housing holding a plurality of photodiodes arranged in an array over at least a 90 degree arc of a hemisphere. The system may also include a controller configured to control the photodiodes and the rotation of the mounting platform.Type: GrantFiled: January 13, 2023Date of Patent: March 5, 2024Assignee: Waymo LLCInventors: Choon Ping Chng, Cheng-Han Wu, Lucian Ion, Giulia Guidi
-
Patent number: 11880902Abstract: Described examples relate to an apparatus comprising one or more image sensors coupled to a vehicle and at least one processor. The at least one processor may be configured to capture, in a burst sequence using the one or more image sensors, multiple frames of an image of a scene, the multiple frames having respective, relative offsets of the image across the multiple frames and perform super-resolution computations using the captured, multiple frames of the image of the scene. The at least one processor may also be configured to accumulate, based on the super-resolution computations, color planes and combine, using the one or more processors, the accumulated color planes to create a super-resolution image of the scene.Type: GrantFiled: December 30, 2020Date of Patent: January 23, 2024Assignee: Waymo LLCInventors: Ignacio Garcia-Dorado, Damien Kelly, Xiaoying He, Jia Feng, Bartlomiej Wronski, Peyman Milanfar, Lucian Ion
-
Publication number: 20230368488Abstract: A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), and configured to operate at a frame rate higher than a threshold rate. The system also includes an image processing resource. The system further includes control circuitry configured to perform operations that include obtaining, from the image sensor, a full-resolution image of an environment. The full-resolution image contains each respective ROI of the plurality of ROIs. The operations also include selecting a particular ROI based on the full-resolution image, and detecting an object of interest in the particular ROI. The operations include determining a mode of operation by which subsequent image data generated by the particular ROI is to be processed. The operations further include processing, based on the mode of operation and the frame rate, the image data comprising a plurality of ROI images of the object of interest.Type: ApplicationFiled: July 24, 2023Publication date: November 16, 2023Inventors: Nirav Dharia, Lucian Ion
-
Publication number: 20230300477Abstract: A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), image processing resources, and a scheduler configured to perform operations including determining a priority level for a particular ROI of the plurality of ROIs based on a feature detected by one or more image processing resources of the image processing resources within initial image data associated with the particular ROI. The operations also include selecting, based on the feature detected within the initial image data, a particular image processing resource of the image processing resources by which subsequent image data generated by the particular ROI is to be processed. The operations further include inserting, based on the priority level, the subsequent image data into a processing queue of the particular image processing resource to schedule the subsequent image data for processing by the particular image processing resource.Type: ApplicationFiled: May 24, 2023Publication date: September 21, 2023Inventors: Vlad Cardei, Lucian Ion, Nirav Dharia
-
Patent number: 11756283Abstract: A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), and configured to operate at a frame rate higher than a threshold rate. The system also includes an image processing resource. The system further includes control circuitry configured to perform operations that include obtaining, from the image sensor, a full-resolution image of an environment. The full-resolution image contains each respective ROI of the plurality of ROIs. The operations also include selecting a particular ROI based on the full-resolution image, and detecting an object of interest in the particular ROI. The operations include determining a mode of operation by which subsequent image data generated by the particular ROI is to be processed. The operations further include processing, based on the mode of operation and the frame rate, the image data comprising a plurality of ROI images of the object of interest.Type: GrantFiled: December 16, 2020Date of Patent: September 12, 2023Assignee: Waymo LLCInventors: Nirav Dharia, Lucian Ion
-
Publication number: 20230269484Abstract: Example embodiments relate to microlensing for real-time sensing of stray light. An example device includes an image sensor that includes a plurality of light-sensitive pixels. The device also includes a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels. Further, the device includes a controller. The controller is configured to determine a first angle of incidence of a first light signal detected by the first subset of light-sensitive pixels. The controller is also configured to, based on the first determined angle of incidence, determine an amount of stray light incident on the image sensor.Type: ApplicationFiled: April 27, 2023Publication date: August 24, 2023Inventors: Benjamin Frevert, Lucian Ion, Nirav Dharia
-
Patent number: 11700459Abstract: A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), image processing resources, and a scheduler configured to perform operations including determining a priority level for a particular ROI of the plurality of ROIs based on a feature detected by one or more image processing resources of the image processing resources within initial image data associated with the particular ROI. The operations also include selecting, based on the feature detected within the initial image data, a particular image processing resource of the image processing resources by which subsequent image data generated by the particular ROI is to be processed. The operations further include inserting, based on the priority level, the subsequent image data into a processing queue of the particular image processing resource to schedule the subsequent image data for processing by the particular image processing resource.Type: GrantFiled: February 16, 2022Date of Patent: July 11, 2023Assignee: Waymo LLCInventors: Vlad Cardei, Lucian Ion, Nirav Dharia
-
Patent number: 11678059Abstract: Example embodiments relate to microlensing for real-time sensing of stray light. An example device includes an image sensor that includes a plurality of light-sensitive pixels. The device also includes a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels. Further, the device includes a controller. The controller is configured to determine a first angle of incidence of a first light signal detected by the first subset of light-sensitive pixels. The controller is also configured to, based on the first determined angle of incidence, determine an amount of stray light incident on the image sensor.Type: GrantFiled: April 20, 2022Date of Patent: June 13, 2023Assignee: Waymo LLCInventors: Benjamin Frevert, Lucian Ion, Nirav Dharia
-
Publication number: 20230142300Abstract: Example embodiments described herein involve a system for testing a light-emitting module. The light-emitting module may include a mounting platform configured to hold a light-emitting module for a camera. The mounting platform may also be configured to rotate. The system may further include a housing holding a plurality of photodiodes arranged in an array over at least a 90 degree arc of a hemisphere. The system may also include a controller configured to control the photodiodes and the rotation of the mounting platform.Type: ApplicationFiled: January 13, 2023Publication date: May 11, 2023Inventors: Choon Ping Chng, Cheng-Han Wu, Lucian Ion, Giulia Guidi
-
Publication number: 20230097592Abstract: Described examples relate to an apparatus comprising a memory for storing image frames and at least one processor. The at least one processor may be configured to receive a plurality of image frames from an image capture device and downsize each of the plurality image frames to generate a plurality of versions of each image frame at a plurality of different sizes. The at least one processor may also be configured to determine alignment information for a first version of a first image frame. The alignment information may include a first alignment vector for identifying image data in a first version of a second image frame that corresponds to image data in the first version of the first image frame. Further, the at least one processor may be configured to determine a first initial alignment vector for identifying image data in a first version of a third image frame based on at least the first alignment vector.Type: ApplicationFiled: September 30, 2021Publication date: March 30, 2023Inventors: Jia Feng, Lucian Ion
-
Patent number: 11600075Abstract: Systems and methods for night vision combining sensor image types. Some implementations may include obtaining a long wave infrared image from a long wave infrared sensor; detecting an object in the long wave infrared image; identifying a region of interest associated with the object; adjusting a control parameter of a near infrared sensor based on data associated with the region of interest; obtaining a near infrared image captured using the adjusted control parameter of the near infrared sensor; and determining a classification of the object based on data of the near infrared image associated with the region of interest.Type: GrantFiled: March 15, 2021Date of Patent: March 7, 2023Assignee: APPLE INC.Inventors: Lucian Ion, Daniel E. Potter, Evan C. Cull, Xiaofeng Tang
-
Patent number: 11578861Abstract: Example embodiments described herein involve a system for testing a light-emitting module. The light-emitting module may include a mounting platform configured to hold a light-emitting module for a camera. The mounting platform may also be configured to rotate. The system may further include a housing holding a plurality of photodiodes arranged in an array over at least a 90 degree arc of a hemisphere. The system may also include a controller configured to control the photodiodes and the rotation of the mounting platform.Type: GrantFiled: March 31, 2022Date of Patent: February 14, 2023Assignee: Waymo LLCInventors: Choon Ping Chng, Cheng-Han Wu, Lucian Ion, Giulia Guidi
-
Publication number: 20220357186Abstract: A system may include a first sensor of a first type and a second sensor of a second different type and having a detector. A field of view of the second sensor may be formed by a plurality of regions of interest (ROIs) defined by the detector. Control circuitry of the system may be configured to perform operations including obtaining, from the first sensor, first sensor data representing an environment, and determining, based on the first sensor data, information associated with a feature of interest within the environment. The operations may also include determining, based on the information, a particular ROI that corresponds to an expected position of the feature at a later time, obtaining a plurality of ROI sensor data from the particular ROI instead of obtaining full-resolution sensor data, and analyzing the plurality of ROI sensor data to determine one or more attributes of the feature.Type: ApplicationFiled: July 25, 2022Publication date: November 10, 2022Inventors: Nirav Dharia, Giulia Guidi, Ralph Shepard, Vlad Cardei, Lucian Ion
-
Patent number: 11428550Abstract: A system may include a first sensor of a first type and a second sensor of a second different type and having a detector. A field of view of the second sensor may be formed by a plurality of regions of interest (ROIs) defined by the detector. Control circuitry of the system may be configured to perform operations including obtaining, from the first sensor, first sensor data representing an environment, and determining, based on the first sensor data, information associated with a feature of interest within the environment. The operations may also include determining, based on the information, a particular ROI that corresponds to an expected position of the feature at a later time, obtaining a plurality of ROI sensor data from the particular ROI instead of obtaining full-resolution sensor data, and analyzing the plurality of ROI sensor data to determine one or more attributes of the feature.Type: GrantFiled: March 3, 2020Date of Patent: August 30, 2022Assignee: Waymo LLCInventors: Nirav Dharia, Giulia Guidi, Ralph Shepard, Vlad Cardei, Lucian Ion
-
Publication number: 20220247907Abstract: Example embodiments relate to microlensing for real-time sensing of stray light. An example device includes an image sensor that includes a plurality of light-sensitive pixels. The device also includes a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels. Further, the device includes a controller. The controller is configured to determine a first angle of incidence of a first light signal detected by the first subset of light-sensitive pixels. The controller is also configured to, based on the first determined angle of incidence, determine an amount of stray light incident on the image sensor.Type: ApplicationFiled: April 20, 2022Publication date: August 4, 2022Inventors: Benjamin Frevert, Lucian Ion, Nirav Dharia
-
Publication number: 20220221140Abstract: Example embodiments described herein involve a system for testing a light-emitting module. The light-emitting module may include a mounting platform configured to hold a light-emitting module for a camera. The mounting platform may also be configured to rotate. The system may further include a housing holding a plurality of photodiodes arranged in an array over at least a 90 degree arc of a hemisphere. The system may also include a controller configured to control the photodiodes and the rotation of the mounting platform.Type: ApplicationFiled: March 31, 2022Publication date: July 14, 2022Inventors: Choon Ping Chng, Cheng-Han Wu, Lucian Ion, Giulia Guidi