Patents by Inventor Ruian Xu

Ruian Xu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11935377
    Abstract: An apparatus comprising an interface and a processor. The interface may be configured to receive pixel data corresponding to a monitored area. The processor may be coupled to the interface and may be configured to (i) process the pixel data arranged as video frames, (ii) perform computer vision operations to detect an object in the video frames, (iii) extract characteristics about the object detected, (iv) generate a three-dimensional (3D) map of the object utilizing the pixel data corresponding to the object, (v) determine whether the object is within a three-dimensional (3D) virtual security zone based on the 3D map of the object, and (vi) generate a trigger signal in response to all or a portion of the object being within the 3D virtual security zone. The 3D virtual security zone is generally determined by a user during a setup procedure.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: March 19, 2024
    Assignee: Ambarella International LP
    Inventor: Ruian Xu
  • Patent number: 11922697
    Abstract: An apparatus comprising an interface and a processor. The interface may be configured to receive pixel data generated by a capture device and an activation signal generated by at least one of a plurality of sensors. The processor may be configured to process the pixel data arranged as video frames, perform computer vision on the video frames to detect objects, perform a classification of the objects, present a control signal in response to receiving the activation signal, determine whether there is a match between the classification and an object class and generate a calibration signal in response to the match. The computer vision may determine which zone that the objects have been detected in. Each zone may comprise a coverage region of one of the sensors. The calibration signal may adjust parameters of the sensors that correspond to the zone with the objects that do not have the match.
    Type: Grant
    Filed: May 2, 2022
    Date of Patent: March 5, 2024
    Assignee: Ambarella International LP
    Inventor: Ruian Xu
  • Patent number: 11854277
    Abstract: An apparatus includes a camera and a processing circuit. The camera may be configured to capture images of an environment around a vehicle. The processing circuit may be configured to (i) perform automated number-plate recognition using the images, (ii) store a history of detected license plates, and (iii) search the history of detected license plates in response to receiving a request from a communication device of a vehicle user for information matching the request.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: December 26, 2023
    Assignee: Ambarella International LP
    Inventor: Ruian Xu
  • Patent number: 11843760
    Abstract: An apparatus includes an interface circuit and a control circuit. The interface circuit may be configured to receive pixel data corresponding to a field of view of a camera. The control circuit may be configured to process the pixel data arranged as video frames and control an exposure time for capturing the pixel data and a turn on time of a structured light pattern to obtain a sequence of images comprising at least one image including the structured light pattern and at least one image where the structured light pattern is absent. The control circuit may be further configured to perform a depth analysis to generate depth information using the at least one image including the structured light pattern. The control circuit may store and execute an artificial neural network trained to (i) discern whether a face is at least one of a real face and a fake face, and (ii) make a liveness determination utilizing the depth information.
    Type: Grant
    Filed: January 28, 2022
    Date of Patent: December 12, 2023
    Assignee: Ambarella International LP
    Inventors: Zhe Zhang, Zhikan Yang, Ruian Xu
  • Patent number: 11798340
    Abstract: An apparatus includes an interface and a processor. The interface may be configured to receive pixel data corresponding to an entrance of a secured area. The processor may be configured to process the pixel data arranged as video frames, perform computer vision operations to detect objects, extract characteristics about the objects, determine a number of people in the video frames, receive an authorization signal from an access control device and generate a control signal. The authorization signal may be used by the access control device to grant access to the secured area. The number of people in the video frames may be determined after the authorization signal is received. The control signal may be generated when the number of people is greater than a number of entrants permitted by the authorization signal. The control signal may provide an indication of unauthorized access to the secured area.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: October 24, 2023
    Assignee: Ambarella International LP
    Inventor: Ruian Xu
  • Patent number: 11748991
    Abstract: An apparatus includes a first light source, a second light source, an image sensor circuit, and a processing circuit. The first light source is generally capable of emitting infrared light. The second light source is generally capable of emitting visible light. The image sensor circuit is generally responsive to both the infrared light and the visible light. The processing circuit is generally coupled to the image sensor circuit and configured to generate an image comprising both infrared information and color information.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: September 5, 2023
    Assignee: Ambarella International LP
    Inventors: Christopher N. Day, Ruian Xu
  • Patent number: 11704908
    Abstract: An apparatus including an interface and a processor. The interface may be configured to receive pixel data. The processor may be configured to generate a plurality of video frames in response to the pixel data received from the interface, perform computer vision operations to detect objects in the video frames, extract features of the objects in response to characteristics of the objects determined using the computer vision operations, identify a person in the video frames based on the features, detect an event based on the person identified and generate a notification in response to detecting the event and a permission status. The permission status may suppress sending the notification when the permission status for the person identified corresponds to denying the notification and enable sending the notification when the permission status does not correspond to denying the notification.
    Type: Grant
    Filed: March 4, 2021
    Date of Patent: July 18, 2023
    Assignee: Ambarella International LP
    Inventors: Ruian Xu, Didier LeGall
  • Patent number: 11616932
    Abstract: An apparatus including a capture device and one or more sensors. The capture device may be configured to operate in a standby mode of operation until a wakeup signal is received and operate in video capture mode of operation in response to the wakeup signal. The sensors may each be configured to detect a trigger condition and communicate the wakeup signal in response to detecting the trigger condition. The capture device may be configured to consume a first amount of power in the standby mode of operation and a second amount of power in the video capture mode of operation. The first amount of power may be less than the second amount of power. The capture device may be configured to generate pixel data in the video capture mode of operation. Each of the sensors may be remotely located on a vehicle with respect to the capture device.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: March 28, 2023
    Assignee: Ambarella International LP
    Inventors: Ruian Xu, Udit Budhia
  • Patent number: 11594254
    Abstract: An apparatus including an interface and a processor. The interface may be configured to receive pixel data generated by a capture device. The processor may be configured to generate video frames in response to the pixel data, perform computer vision operations on the video frames to detect objects, perform a classification of the objects detected based on characteristics of the objects, determine whether the classification of the objects corresponds to a user-defined event and generate encoded video frames from the video frames. The encoded video frames may be communicated to a cloud storage service. The encoded video frames may comprise a first sample of the video frames selected at a first rate when the user-defined event is not detected and a second sample of the video frames selected at a second rate while the user-defined event is detected. The second rate may be greater than the first rate.
    Type: Grant
    Filed: April 9, 2022
    Date of Patent: February 28, 2023
    Assignee: Ambarella International LP
    Inventors: Luyi Sun, Jian Tang, Ruian Xu
  • Patent number: 11570358
    Abstract: An apparatus comprises a camera and one or more sensors. The camera generally has a low power deactivated mode. The one or more sensors are generally remotely located with respect to the camera. The one or more sensors may be configured to communicate a signal to the camera in response to a trigger condition. The camera is generally configured to activate in response to receiving the signal from the one or more sensors.
    Type: Grant
    Filed: April 30, 2021
    Date of Patent: January 31, 2023
    Assignee: Ambarella International LP
    Inventor: Ruian Xu
  • Publication number: 20220230663
    Abstract: An apparatus including an interface and a processor. The interface may be configured to receive pixel data generated by a capture device. The processor may be configured to generate video frames in response to the pixel data, perform computer vision operations on the video frames to detect objects, perform a classification of the objects detected based on characteristics of the objects, determine whether the classification of the objects corresponds to a user-defined event and generate encoded video frames from the video frames. The encoded video frames may be communicated to a cloud storage service. The encoded video frames may comprise a first sample of the video frames selected at a first rate when the user-defined event is not detected and a second sample of the video frames selected at a second rate while the user-defined event is detected. The second rate may be greater than the first rate.
    Type: Application
    Filed: April 9, 2022
    Publication date: July 21, 2022
    Inventors: Luyi Sun, Jian Tang, Ruian Xu
  • Patent number: 11373685
    Abstract: An apparatus including an interface and a processor. The interface may be configured to receive pixel data generated by a capture device. The processor may be configured to generate video frames in response to the pixel data, perform computer vision operations on the video frames to detect objects, perform a classification of the objects detected based on characteristics of the objects, determine whether the classification of the objects corresponds to a user-defined event and generate encoded video frames from the video frames. The encoded video frames may be communicated to a cloud storage service. The encoded video frames may comprise a first sample of the video frames selected at a first rate when the user-defined event is not detected and a second sample of the video frames selected at a second rate while the user-defined event is detected. The second rate may be greater than the first rate.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: June 28, 2022
    Assignee: Ambarella International LP
    Inventors: Luyi Sun, Jian Tang, Ruian Xu
  • Publication number: 20220150462
    Abstract: An apparatus includes an interface circuit and a control circuit. The interface circuit may be configured to receive pixel data corresponding to a field of view of a camera. The control circuit may be configured to process the pixel data arranged as video frames and control an exposure time for capturing the pixel data and a turn on time of a structured light pattern to obtain a sequence of images comprising at least one image including the structured light pattern and at least one image where the structured light pattern is absent. The control circuit may be further configured to perform a depth analysis to generate depth information using the at least one image including the structured light pattern. The control circuit may store and execute an artificial neural network trained to (i) discern whether a face is at least one of a real face and a fake face, and (ii) make a liveness determination utilizing the depth information.
    Type: Application
    Filed: January 28, 2022
    Publication date: May 12, 2022
    Inventors: Zhe Zhang, Zhikan Yang, Ruian Xu
  • Patent number: 11323685
    Abstract: An apparatus includes an RGB-IR image sensor, a structured light projector, and a control circuit. The control circuit may be configured to control a shutter exposure time of the RGB-IR image sensor and a turn on time of the structured light projector to obtain a sequence of images captured by the RGB-IR image sensor, wherein the sequence of images comprises at least one image including a structured light pattern and at least one image where the structured light pattern is absent.
    Type: Grant
    Filed: September 8, 2020
    Date of Patent: May 3, 2022
    Assignee: Ambarella International LP
    Inventors: Zhe Zhang, Zhikan Yang, Ruian Xu
  • Patent number: 11284022
    Abstract: An apparatus includes an RGB-IR rolling shutter image sensor, a structured light projector, and a control circuit. The control circuit may be configured to control an exposure time of the RGB-IR rolling shutter image sensor and a turn on time of the structured light projector to obtain a structured light pattern in images captured by the RGB-IR rolling shutter image sensor.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: March 22, 2022
    Assignee: Ambarella International LP
    Inventors: Zhe Zhang, Long Zhao, Zhikan Yang, Ruian Xu
  • Publication number: 20220070432
    Abstract: An apparatus includes an RGB-IR image sensor, a structured light projector, and a control circuit. The control circuit may be configured to control a shutter exposure time of the RGB-IR image sensor and a turn on time of the structured light projector to obtain a sequence of images captured by the RGB-IR image sensor, wherein the sequence of images comprises at least one image including a structured light pattern and at least one image where the structured light pattern is absent.
    Type: Application
    Filed: September 8, 2020
    Publication date: March 3, 2022
    Inventors: Zhe Zhang, Zhikan Yang, Ruian Xu
  • Publication number: 20220070453
    Abstract: An apparatus including an interface and a processor. The interface may be configured to receive pixel data generated by a capture device. The processor may be configured perform computer vision operations on the video frames to detect objects, perform a classification of the objects detected based on characteristics of the objects, determine whether the classification of the objects corresponds to an event, generate a full video stream in response to all of the video frames and generate encoded video frames. The full video stream may be recorded to a storage medium local to the apparatus. The encoded video frames may be communicated to a cloud service. The encoded video frames may comprise a first sample of the video frames selected at a first rate when the event is not detected and a second sample of the video frames selected at a second rate while the event is detected.
    Type: Application
    Filed: March 29, 2021
    Publication date: March 3, 2022
    Inventors: Jian Tang, Ruian Xu
  • Publication number: 20220059132
    Abstract: An apparatus including an interface and a processor. The interface may be configured to receive pixel data generated by a capture device. The processor may be configured to generate video frames in response to the pixel data, perform computer vision operations on the video frames to detect objects, perform a classification of the objects detected based on characteristics of the objects, determine whether the classification of the objects corresponds to a user-defined event and generate encoded video frames from the video frames. The encoded video frames may be communicated to a cloud storage service. The encoded video frames may comprise a first sample of the video frames selected at a first rate when the user-defined event is not detected and a second sample of the video frames selected at a second rate while the user-defined event is detected. The second rate may be greater than the first rate.
    Type: Application
    Filed: December 18, 2020
    Publication date: February 24, 2022
    Inventors: Luyi Sun, Jian Tang, Ruian Xu
  • Publication number: 20220046194
    Abstract: An apparatus includes an RGB-IR rolling shutter image sensor, a structured light projector, and a control circuit. The control circuit may be configured to control an exposure time of the RGB-IR rolling shutter image sensor and a turn on time of the structured light projector to obtain a structured light pattern in images captured by the RGB-IR rolling shutter image sensor.
    Type: Application
    Filed: August 18, 2020
    Publication date: February 10, 2022
    Inventors: Zhe Zhang, Long Zhao, Zhikan Yang, Ruian Xu
  • Patent number: 11076099
    Abstract: An apparatus comprises a camera and one or more sensors. The camera generally has a low power deactivated mode. The one or more sensors are generally remotely located with respect to the camera. The one or more sensors may be configured to communicate a signal to the camera in response to a trigger condition. The camera is generally configured to activate in response to receiving the signal from the one or more sensors.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: July 27, 2021
    Assignee: Ambarella International LP
    Inventor: Ruian Xu