Patents by Inventor Niels Haering

Niels Haering has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20160127699
    Abstract: A content analysis engine receives video input and performs analysis of the video input to produce one or more gross change primitives. A view engine coupled to the content analysis engine receives the one or more gross change primitives from the content analysis engine and provides view identification information. A rules engine coupled to the view engine receives the view identification information from the view engine and provides one or more rules based on the view identification information. An inference engine performs video analysis based on the one or more rules provided by the rules engine and the one or more gross change primitives.
    Type: Application
    Filed: November 25, 2015
    Publication date: May 5, 2016
    Inventors: Weihong Yin, Andrew J. Chosak, John I. W. Clark, Geoffrey Egnal, Matthew F. Frazier, Niels Haering, Alan J. Lipton, Donald G. Madden, Michael C. Mannebach, Gary W. Myers, James S. Sfekas, Peter L. Venetianer, Zhong Zhang
  • Patent number: 9240051
    Abstract: A video camera may overlook a monitored area from any feasible position. An object flow estimation module monitor the moving direction of the objects in the monitored area. It may separate the consistently moving objects from the other objects. A object count estimation module may compute the object density (e.g. crowd). A object density classification module may classify the density into customizable categories.
    Type: Grant
    Filed: November 21, 2006
    Date of Patent: January 19, 2016
    Assignee: Avigilon Fortress Corporation
    Inventors: Haiying Liu, Peter L. Venetianer, Niels Haering, Omar Javed, Alan J. Lipton, Andrew Martone, Zeeshan Rasheed, Weihong Yin, Li Yu, Zhong Zhang
  • Patent number: 9204107
    Abstract: A content analysis engine receives video input and performs analysis of the video input to produce one or more gross change primitives. A view engine coupled to the content analysis engine receives the one or more gross change primitives from the content analysis engine and provides view identification information. A rules engine coupled to the view engine receives the view identification information from the view engine and provides one or more rules based on the view identification information. An inference engine performs video analysis based on the one or more rules provided by the rules engine and the one or more gross change primitives.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: December 1, 2015
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Weihong Yin, Andrew J. Chosak, John I. W. Clark, Geoffrey Egnal, Matthew F. Frazier, Niels Haering, Alan J. Lipton, Donald G. Madden, Michael C. Mannebach, Gary W. Myers, James S. Sfekas, Péter L. Venetianer, Zhong Zhang
  • Patent number: 9158975
    Abstract: A system for video monitoring a retail business process includes a video analytics engine to process video obtained by a video camera and generate video primitives regarding the video, A user interface is used to define at least one activity of interest regarding an area being viewed, each activity of interest identifying at least one of a rule or a query regarding the area being viewed. An activity inference engine processes the generated video primitives based on each defined activity of interest to determine if an activity of interest occurred in the video.
    Type: Grant
    Filed: July 13, 2007
    Date of Patent: October 13, 2015
    Assignee: Avigilon Fortress Corporation
    Inventors: Alan J. Lipton, Peter L. Venetianer, Niels Haering, Paul C. Brewer, Weihong Yin, Zhong Zhang, Li Yu, Yongtong Hu, Gary W. Myers, Andrew J. Chosak, Robert A. Cutting, W. Andrew Scanlon
  • Patent number: 9020261
    Abstract: A method for segmenting video data into foreground and background portions utilizes statistical modeling of the pixels. A statistical model of the background is built for each pixel, and each pixel in an incoming video frame is compared with the background statistical model for that pixel. Pixels are determined to be foreground or background based on the comparisons. The method for segmenting video data may be further incorporated into a method for implementing an intelligent video surveillance system. The method for segmenting video data may be implemented in hardware.
    Type: Grant
    Filed: May 3, 2013
    Date of Patent: April 28, 2015
    Assignee: Avigilon Fortress Corporation
    Inventors: Alan J. Lipton, Niels Haering, Zeeshan Rasheed, Omar Javed, Zhong Zhang, Weihong Yin, Peter L. Venetianer, Gary W. Myers
  • Publication number: 20140341433
    Abstract: A system for detecting behavior of a target may include: a target detection engine, adapted to detect at least one target from one or more objects from a video surveillance system recording a scene; a path builder, adapted to create at least one mature path model from analysis of the behavior of a plurality of targets in the scene, wherein the at least one mature path model includes a model of expected target behavior with respect to the at least one path model; and a target behavior analyzer, adapted to analyze and identify target behavior with respect to the at least one mature path model. The system way further include an alert generator, adapted to generate an alert based on the identified behavior.
    Type: Application
    Filed: August 8, 2014
    Publication date: November 20, 2014
    Inventors: Niels HAERING, Zeeshan Rasheed, Li Yu, Andrew J. Chosak
  • Patent number: 8823804
    Abstract: A system for detecting behavior of a target may include: a target detection engine, adapted to detect at least one target from one or more objects from a video surveillance system recording a scene; a path builder, adapted to create at least one mature path model from analysis of the behavior of a plurality of targets in the scene, wherein the at least one mature path model includes a model of expected target behavior with respect to the at least one path model; and a target behavior analyzer, adapted to analyze and identify target behavior with respect to the at least one mature path model. The system may further include an alert generator, adapted to generate an alert based on the identified behavior.
    Type: Grant
    Filed: January 19, 2012
    Date of Patent: September 2, 2014
    Assignee: ObjectVideo, Inc.
    Inventors: Niels Haering, Zeeshan Rasheed, Li Yu, Andrew J. Chosak
  • Publication number: 20140200417
    Abstract: Mental state analysis is performed by obtaining video of an individual as the individual interacts with a computer, either by performing various operations or by consuming a media presentation. The video is analyzed to determine eye-blink information on the individual, such as eye-blink rate or eye-blink duration. A mental state of the individual is then inferred based on the eye blink information. The blink-rate information and associated mental states can be used to modify an advertisement, a media presentation, or a digital game.
    Type: Application
    Filed: March 15, 2014
    Publication date: July 17, 2014
    Applicant: Affectiva, Inc.
    Inventors: Thibaud Senechal, Rana el Kaliouby, Niels Haering
  • Publication number: 20140200416
    Abstract: Video of one or more people is obtained and analyzed. Heart rate information is determined from the video and the heart rate information is used in mental state analysis. The heart rate information and resulting mental state analysis are correlated to stimuli, such as digital media which is consumed or with which a person interacts. The heart rate information is used to infer mental states. The mental state analysis, based on the heart rate information, can be used to optimize digital media or modify a digital game.
    Type: Application
    Filed: March 15, 2014
    Publication date: July 17, 2014
    Applicant: Affectiva, Inc.
    Inventors: Youssef Kashef, Rana el Kaliouby, Ahmed Adel Osman, Niels Haering, Viprali Bhatkar
  • Publication number: 20130278764
    Abstract: A content analysis engine receives video input and performs analysis of the video input to produce one or more gross change primitives. A view engine coupled to the content analysis engine receives the one or more gross change primitives from the content analysis engine and provides view identification information. A rules engine coupled to the view engine receives the view identification information from the view engine and provides one or more rules based on the view identification information. An inference engine performs video analysis based on the one or more rules provided by the rules engine and the one or more gross change primitives.
    Type: Application
    Filed: March 15, 2013
    Publication date: October 24, 2013
    Inventors: Weihong Yin, Andrew J. Chosak, John I. W. Clark, Geoffrey Egnal, Matthew F. Frazier, Niels Haering, Alan J. Lipton, Donald G. Madden, Michael C. Mannebach, Gary W. Myers, James S. Sfekas, Péter L. Venetianer, Zhong Zhang
  • Patent number: 8564661
    Abstract: A video surveillance system is set up, calibrated, tasked, and operated. The system extracts video primitives and extracts event occurrences from the video primitives using event discriminators. The extracted video primitives and event occurrences may be used to create and define additional video analytic rules. The system can undertake a response, such as an alarm, based on extracted event occurrences.
    Type: Grant
    Filed: July 26, 2007
    Date of Patent: October 22, 2013
    Assignee: ObjectVideo, Inc.
    Inventors: Alan J. Lipton, John I. W. Clark, Zhong Zhang, Peter L. Venetianer, Thomas Strat, Mark Allmen, William Severson, Niels Haering, Andrew Chosak, Matthew Frazier, James Sfekas, Tasuki Hirata
  • Publication number: 20130250050
    Abstract: A video surveillance system, device and methods may accurately model the shape of a human object monitored by a video stream. 3D human models, such as a coarse 3D human model and a detailed 3D human model may be estimated by mapping individual body part components to a frame. For example, a coarse 3D human model may be obtained by mapping the cylindrical body parts to a plurality of skeleton pose estimates on a part by part basis. A detailed 3D human model may be estimated by mapping detailed human body parts to respective the cylindrical body parts of the coarse 3D human model on a part by part basis. The detailed 3D human model may be used to detect accessories of the human object being monitored, as well as overall dimensions, body part dimensions, age, and gender of the human object being monitored.
    Type: Application
    Filed: March 15, 2013
    Publication date: September 26, 2013
    Applicant: OBJECTVIDEO, INC.
    Inventors: Atul Kanaujia, Niels Haering, Mun Wai Lee
  • Publication number: 20130242095
    Abstract: A method for segmenting video data into foreground and background portions utilizes statistical modeling of the pixels. A statistical model of the background is built for each pixel, and each pixel in an incoming video frame is compared with the background statistical model for that pixel. Pixels are determined to be foreground or background based on the comparisons. The method for segmenting video data may be further incorporated into a method for implementing an intelligent video surveillance system. The method for segmenting video data may be implemented in hardware.
    Type: Application
    Filed: May 3, 2013
    Publication date: September 19, 2013
    Applicant: OBJECTVIDEO, INC.
    Inventors: Alan J. Lipton, Niels Haering, Zeeshan Rasheed, Omar Javed, Zhong Zhang, Weihong Yin, Peter L. Venetianer, Gary W. Myers
  • Patent number: 8497906
    Abstract: A method of video processing may include analyzing input video information to determine if a current video frame is directed to a same view as a previous video frame; determining whether a new view is present; and indicating a need to use video processing information pertaining to the new view if a new view is determined to be present.
    Type: Grant
    Filed: May 17, 2010
    Date of Patent: July 30, 2013
    Assignee: ObjectVideo, Inc.
    Inventors: Weihong Yin, Andrew J. Chosak, John I. W. Clark, Geoffrey Egnal, Matthew F. Frazier, Niels Haering, Alan J. Lipton, Donald G. Madden, Michael C. Mannebach, Gary W. Myers, James S. Sfekas, Péter L. Venetianer, Zhong Zhang
  • Patent number: 8457401
    Abstract: A method for segmenting video data into foreground and background (324) portions utilizes statistical modeling of the pixels ? statistical model of the background is built for each pixel, and each pixel in an incoming video frame is compared (326) with the background statistical model for that pixel. Pixels are determined to be foreground or background based on the comparisons. The method for segmenting video data may be further incorporated into a method for implementing an intelligent video surveillance system The method for segmenting video data may be implemented in hardware.
    Type: Grant
    Filed: March 1, 2007
    Date of Patent: June 4, 2013
    Assignee: ObjectVideo, Inc.
    Inventors: Alan J. Lipton, Niels Haering, Zeeshan Rasheed, Omar Javed, Zhong Zhang, Weihong Yin, Peter L. Venetianer, Gary W. Myers
  • Publication number: 20130129307
    Abstract: A system and method for video surveillance and searching are disclosed. Video is analyzed and events are automatically detected. Based on the automatically detected events, textual descriptions are generated. The textual descriptions may be used to supplement video viewing and event viewing, and to provide for textual searching for events.
    Type: Application
    Filed: November 21, 2012
    Publication date: May 23, 2013
    Applicant: OBJECTVIDEO, INC.
    Inventors: Tae Eun Choe, Mun Wai Lee, Kiran Gunda, Niels Haering
  • Patent number: 8405720
    Abstract: In one exemplary embodiment a method calibrates a pan-tilt-zoom (PTZ) camera system. The PTZ camera system may include a PTZ camera. The method may perform at least one of the following steps: determining a radial distortion of the PTZ camera; determining a base focal length of the PTZ camera; determining a zoom and magnification profile of the PTZ camera; determining an actuation delay of the PTZ camera system; determining a pan position mode speed and/or a tilt position mode speed of the PTZ camera; determining a pan velocity profile and/or a tilt velocity profile of the PTZ camera; determining a zoom position profile and/or a zoom duration profile of the PTZ camera; determining a query delay of the PTZ camera system; and determining a minimum query interval of the PTZ camera system.
    Type: Grant
    Filed: August 8, 2008
    Date of Patent: March 26, 2013
    Assignee: ObjectVideo, Inc.
    Inventors: Himaanshu Gupta, Andrew J. Chosak, Geoffrey R. Taylor, Paul C. Brewer, Niels Haering, Alan J. Lipton
  • Publication number: 20120268594
    Abstract: A system for detecting behavior of a target may include: a target detection engine, adapted to detect at least one target from one or more objects from a video surveillance system recording a scene; a path builder, adapted to create at least one mature path model from analysis of the behavior of a plurality of targets in the scene, wherein the at least one mature path model includes a model of expected target behavior with respect to the at least one path model; and a target behavior analyzer, adapted to analyze and identify target behavior with respect to the at least one mature path model. The system may further include an alert generator, adapted to generate an alert based on the identified behavior.
    Type: Application
    Filed: January 19, 2012
    Publication date: October 25, 2012
    Applicant: ObjectVideo, Inc.
    Inventors: Niels HAERING, Zeeshan RASHEED, Li YU, Andrew J. CHOSAK
  • Patent number: 8180490
    Abstract: A video imager may be used to measure the natural and/or artificial light levels in a space. The lighting estimates may be passed to a controller via a communication network. The lighting estimates may be in the form of actual radiance values, brightness, or other forms. The controller may determine if and which areas of the space require more light or if and which areas of the space have more light than required. Based on the lighting estimates, the controller may issue commands to turn on/off or dim/brighten the light from various ones or combinations of light sources in or around the space via actuators. The controller may also directly interface with the light sources.
    Type: Grant
    Filed: January 4, 2008
    Date of Patent: May 15, 2012
    Assignee: ObjectVideo, Inc.
    Inventors: Khurram Hassan-Shafique, Niels Haering, Soma Biswas, Alan J. Lipton
  • Patent number: 7949150
    Abstract: A video sequence of a field of view within an environment is received. Targets are detected in the video sequence. Target geo-positional information is received. Correspondences between the targets detected in the video sequence and the target geo-positional information are determined and used to calibrate the camera and to geo-register a field of view of the camera.
    Type: Grant
    Filed: April 2, 2007
    Date of Patent: May 24, 2011
    Assignee: ObjectVideo, Inc.
    Inventors: Niels Haering, Zeeshan Rasheed, Khurram Hassan-Shafique, Asaad Hakeem, Omar Javed, Xiao Chun Cao, Haiying Liu, Li Yu, Donald G. Madden, Andrew J. Chosak, Geoffrey Taylor, Himaanshu Gupta, Alan J. Lipton