Patents by Inventor Niels Haering

Niels Haering has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11151610
    Abstract: Video of one or more vehicle occupants is obtained and analyzed. Heart rate information is determined from the video. The heart rate information is used in cognitive state analysis. The heart rate information and resulting cognitive state analysis are correlated to stimuli, such as digital media, which is consumed or with which a vehicle occupant interacts. The heart rate information is used to infer cognitive states. The inferred cognitive states are used to output a mood measurement. The cognitive states are used to modify the behavior of a vehicle. The vehicle is an autonomous or semi-autonomous vehicle. Training is employed in the analysis. Machine learning is engaged to facilitate the training. Near-infrared image processing is used to obtain the video. The analysis is augmented by audio information obtained from the vehicle occupant.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: October 19, 2021
    Assignee: Affectiva, Inc.
    Inventors: Rana el Kaliouby, Viprali Bhatkar, Niels Haering, Youssef Kashef, Ahmed Adel Osman
  • Patent number: 10768769
    Abstract: A system and method for video surveillance and searching are disclosed. Video is analyzed and events are automatically detected. Based on the automatically detected events, textual descriptions are generated. The textual descriptions may be used to supplement video viewing and event viewing, and to provide for textual searching for events.
    Type: Grant
    Filed: February 23, 2017
    Date of Patent: September 8, 2020
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Tae Eun Choe, Mun Wai Lee, Kiran Gunda, Niels Haering
  • Publication number: 20200225790
    Abstract: A system and method for video surveillance and searching are disclosed. Video is analyzed and events are automatically detected. Based on the automatically detected events, textual descriptions are generated. The textual descriptions may be used to supplement video viewing and event viewing, and to provide for textual searching for events.
    Type: Application
    Filed: February 23, 2017
    Publication date: July 16, 2020
    Inventors: Tae Eun Choe, Mun Wai Lee, Kiran Gunda, Niels Haering
  • Publication number: 20200134672
    Abstract: Video of one or more vehicle occupants is obtained and analyzed. Heart rate information is determined from the video. The heart rate information is used in cognitive state analysis. The heart rate information and resulting cognitive state analysis are correlated to stimuli, such as digital media, which is consumed or with which a vehicle occupant interacts. The heart rate information is used to infer cognitive states. The inferred cognitive states are used to output a mood measurement. The cognitive states are used to modify the behavior of a vehicle. The vehicle is an autonomous or semi-autonomous vehicle. Training is employed in the analysis. Machine learning is engaged to facilitate the training. Near-infrared image processing is used to obtain the video. The analysis is augmented by audio information obtained from the vehicle occupant.
    Type: Application
    Filed: December 30, 2019
    Publication date: April 30, 2020
    Applicant: Affectiva, Inc.
    Inventors: Rana el Kaliouby, Viprali Bhatkar, Niels Haering, Youssef Kashef, Ahmed Adel Osman
  • Patent number: 10630971
    Abstract: A method to determine a base focal length of a pan-tilt-zoom (PTZ) camera system. The method includes generating a spherical mosaic with a feature track by the camera system and determining, by the camera system, a base focal length by analyzing a conic trajectory created by the feature track on an image plane.
    Type: Grant
    Filed: November 1, 2017
    Date of Patent: April 21, 2020
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Himaanshu Gupta, Andrew J. Chosak, Geoffrey R. Taylor, Paul C. Brewer, Niels Haering, Alan J. Lipton
  • Patent number: 10517521
    Abstract: Video of one or more people is obtained and analyzed. Heart rate information is determined from the video. The heart rate information is used in mental state analysis. The heart rate information and resulting mental state analysis are correlated to stimuli, such as digital media, which is consumed or with which a person interacts. The heart rate information is used to infer mental states. The inferred mental states are used to output a mood measurement. The mental state analysis, based on the heart rate information, is used to optimize digital media or modify a digital game. Training is employed in the analysis. Machine learning is engaged to facilitate the training.
    Type: Grant
    Filed: May 8, 2017
    Date of Patent: December 31, 2019
    Assignee: Affectiva, Inc.
    Inventors: Rana el Kaliouby, Viprali Bhatkar, Niels Haering, Youssef Kashef, Ahmed Adel Osman
  • Publication number: 20190246073
    Abstract: A system for detecting behavior of a target may include: a target detection engine, adapted to detect at least one target from one or more objects from a video surveillance system recording a scene; a path builder, adapted to create at least one mature path model from analysis of the behavior of a plurality of targets in the scene, wherein the at least one mature path model includes a model of expected target behavior with respect to the at least one path model; and a target behavior analyzer, adapted to analyze and identify target behavior with respect to the at least one mature path model. The system may further include an alert generator, adapted to generate an alert based on the identified behavior.
    Type: Application
    Filed: April 16, 2019
    Publication date: August 8, 2019
    Inventors: Niels HAERING, Zeeshan RASHEED, Li YU, Andrew J. CHOSAK
  • Patent number: 10291884
    Abstract: A system for detecting behavior of a target may include: a target detection engine, adapted to detect at least one target from one or more objects from a video surveillance system recording a scene; a path builder, adapted to create at least one mature path model from analysis of the behavior of a plurality of targets in the scene, wherein the at least one mature path model includes a model of expected target behavior with respect to the at least one path model; and a target behavior analyzer, adapted to analyze and identify target behavior with respect to the at least one mature path model. The system may further include an alert generator, adapted to generate an alert based on the identified behavior.
    Type: Grant
    Filed: August 8, 2014
    Date of Patent: May 14, 2019
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Niels Haering, Zeeshan Rasheed, Li Yu, Andrew J. Chosak
  • Patent number: 10033979
    Abstract: A video surveillance system, device and methods may accurately model the shape of a human object monitored by a video stream. 3D human models, such as a coarse 3D human model and a detailed 3D human model may be estimated by mapping individual body part components to a frame. For example, a coarse 3D human model may be obtained by mapping the cylindrical body parts to a plurality of skeleton pose estimates on a part by part basis. A detailed 3D human model may be estimated by mapping detailed human body parts to respective the cylindrical body parts of the coarse 3D human model on a part by part basis. The detailed 3D human model may be used to detect accessories of the human object being monitored, as well as overall dimensions, body part dimensions, age, and gender of the human object being monitored.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: July 24, 2018
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Atul Kanaujia, Niels Haering, Mun Wai Lee
  • Patent number: 9936170
    Abstract: A content analysis engine receives video input and performs analysis of the video input to produce one or more gross change primitives. A view engine coupled to the content analysis engine receives the one or more gross change primitives from the content analysis engine and provides view identification information. A rules engine coupled to the view engine receives the view identification information from the view engine and provides one or more rules based on the view identification information. An inference engine performs video analysis based on the one or more rules provided by the rules engine and the one or more gross change primitives.
    Type: Grant
    Filed: November 25, 2015
    Date of Patent: April 3, 2018
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Weihong Yin, Andrew J. Chosak, John I. W. Clark, Geoffrey Egnal, Matthew F. Frazier, Niels Haering, Alan J. Lipton, Donald G. Madden, Michael C. Mannebach, Gary W. Myers, James S. Sfekas, Peter L. Venetianer, Zhong Zhang
  • Publication number: 20180070075
    Abstract: A method to determine a base focal length of a pan-tilt-zoom (PTZ) camera system. The method includes generating a spherical mosaic with a feature track by the camera system and determining, by the camera system, a base focal length by analyzing a conic trajectory created by the feature track on an image plane.
    Type: Application
    Filed: November 1, 2017
    Publication date: March 8, 2018
    Inventors: Himaanshu GUPTA, Andrew J. CHOSAK, Geoffrey R. TAYLOR, Paul C. BREWER, Niels HAERING, Alan J. LIPTON
  • Patent number: 9892606
    Abstract: A video surveillance system extracts video primitives and extracts event occurrences from the video primitives using event discriminators. The system can undertake a response, such as an alarm, based on extracted event occurrences.
    Type: Grant
    Filed: June 28, 2005
    Date of Patent: February 13, 2018
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Peter L. Venetianer, Alan J. Lipton, Andrew J. Chosak, Matthew F. Frazier, Niels Haering, Gary W. Myers, Weihong Yin, Zhong Zhang, Robert Cutting
  • Patent number: 9805566
    Abstract: A video surveillance system may include at least one sensing unit capable of being operated in a scanning mode and a video processing unit coupled to the sensing unit, the video processing unit to receive and process image data from the sensing unit and to detect scene events and target activity.
    Type: Grant
    Filed: May 5, 2016
    Date of Patent: October 31, 2017
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Andrew J. Chosak, Paul C. Brewer, Geoffrey Egnal, Himaanshu Gupta, Niels Haering, Alan J. Lipton, Li Yu
  • Publication number: 20170300150
    Abstract: A system and method for video surveillance and searching are disclosed. Video is analyzed and events are automatically detected. Based on the automatically detected events, textual descriptions are generated. The textual descriptions may be used to supplement video viewing and event viewing, and to provide for textual searching for events.
    Type: Application
    Filed: February 23, 2017
    Publication date: October 19, 2017
    Inventors: Tae Eun Choe, Mun Wai Lee, Kiran Gunda, Niels Haering
  • Publication number: 20170238860
    Abstract: Video of one or more people is obtained and analyzed. Heart rate information is determined from the video. The heart rate information is used in mental state analysis. The heart rate information and resulting mental state analysis are correlated to stimuli, such as digital media, which is consumed or with which a person interacts. The heart rate information is used to infer mental states. The inferred mental states are used to output a mood measurement. The mental state analysis, based on the heart rate information, is used to optimize digital media or modify a digital game. Training is employed in the analysis. Machine learning is engaged to facilitate the training.
    Type: Application
    Filed: May 8, 2017
    Publication date: August 24, 2017
    Applicant: Affectiva, Inc.
    Inventors: Rana el Kaliouby, Viprali Bhatkar, Niels Haering, Youssef Kashef, Ahmed Adel Osman
  • Patent number: 9723992
    Abstract: Mental state analysis is performed by obtaining video of an individual as the individual interacts with a computer, either by performing various operations or by consuming a media presentation. The video is analyzed to determine eye-blink information on the individual, such as eye-blink rate or eye-blink duration. A mental state of the individual is then inferred based on the eye blink information. The blink-rate information and associated mental states can be used to modify an advertisement, a media presentation, or a digital game.
    Type: Grant
    Filed: March 15, 2014
    Date of Patent: August 8, 2017
    Assignee: Affectiva, Inc.
    Inventors: Thibaud Senechal, Rana el Kaliouby, Niels Haering
  • Patent number: 9642536
    Abstract: Video of one or more people is obtained and analyzed. Heart rate information is determined from the video and the heart rate information is used in mental state analysis. The heart rate information and resulting mental state analysis are correlated to stimuli, such as digital media which is consumed or with which a person interacts. The heart rate information is used to infer mental states. The mental state analysis, based on the heart rate information, can be used to optimize digital media or modify a digital game.
    Type: Grant
    Filed: March 15, 2014
    Date of Patent: May 9, 2017
    Assignee: Affectiva, Inc.
    Inventors: Youssef Kashef, Rana el Kaliouby, Ahmed Adel Osman, Niels Haering, Viprali Bhatkar
  • Patent number: 9602738
    Abstract: A system and method for video surveillance and searching are disclosed. Video is analyzed and events are automatically detected. Based on the automatically detected events, textual descriptions are generated. The textual descriptions may be used to supplement video viewing and event viewing, and to provide for textual searching for events.
    Type: Grant
    Filed: November 21, 2012
    Date of Patent: March 21, 2017
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Tae Eun Choe, Mun Wai Lee, Kiran Gunda, Niels Haering
  • Publication number: 20160321888
    Abstract: A video surveillance system may include at least one sensing unit capable of being operated in a scanning mode and a video processing unit coupled to the sensing unit, the video processing unit to receive and process image data from the sensing unit and to detect scene events and target activity.
    Type: Application
    Filed: May 5, 2016
    Publication date: November 3, 2016
    Inventors: Andrew J. Chosak, Paul C. Brewer, Geoffrey Egnal, Himaanshu Gupta, Niels Haering, Alan J. Lipton, Li Yu
  • Patent number: 9363487
    Abstract: A video surveillance system may include at least one sensing unit capable of being operated in a scanning mode and a video processing unit coupled to the sensing unit, the video processing unit to receive and process image data from the sensing unit and to detect scene events and target activity.
    Type: Grant
    Filed: September 8, 2005
    Date of Patent: June 7, 2016
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Andrew J. Chosak, Paul C. Brewer, Geoffrey Egnal, Himaanshu Gupta, Niels Haering, Alan J. Lipton, Li Yu