Patents by Inventor Debbie E. Nachtegall

Debbie E. Nachtegall has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10991121
    Abstract: Systems and methods for optimizing operator-state detection including tracking position of an operator-facing camera are described. Systems and methods include receiving a first image captured by an operator-facing camera, detecting a first position of the operator-facing camera with respect to the calibration object, ascertaining the first position with respect to at least one fiducial marker within a passenger compartment of a vehicle, capturing, via controller, a second image using the operator-facing camera, determining the second image is captured by the operator-facing camera from a second position with respect to the at least one fiducial marker, and analyzing, based on determining the second image is captured by the operator-facing camera from the second position, the second image to identify facial features of the operator. The receiving, detecting, ascertaining, determining, and analyzing are performed via a controller.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: April 27, 2021
    Assignee: GM Global Technology Operations LLC
    Inventors: Debbie E. Nachtegall, Nathan P. Makarewicz, Paul W. Alexander
  • Publication number: 20200167951
    Abstract: Systems and methods for optimizing operator-state detection including tracking position of an operator-facing camera are described. Systems and methods include receiving a first image captured by an operator-facing camera, detecting a first position of the operator-facing camera with respect to the calibration object, ascertaining the first position with respect to at least one fiducial marker within a passenger compartment of a vehicle, capturing, via controller, a second image using the operator-facing camera, determining the second image is captured by the operator-facing camera from a second position with respect to the at least one fiducial marker, and analyzing, based on determining the second image is captured by the operator-facing camera from the second position, the second image to identify facial features of the operator. The receiving, detecting, ascertaining, determining, and analyzing are performed via a controller.
    Type: Application
    Filed: November 27, 2018
    Publication date: May 28, 2020
    Applicant: GM Global Technology Operations LLC
    Inventors: Debbie E. Nachtegall, Nathan P. Makarewicz, Paul W. Alexander
  • Patent number: 9967522
    Abstract: A driver monitoring camera system for a vehicle includes a camera system and an optical beam shaper. The camera system has an exit field of view central axis oriented more vertical than horizontal with respect to a set of orthogonal x, y and z axes, where the z-axis defines a direction line indicative of a vertical direction. The optical beam shaper is disposed in optical communication with the camera system and optically between the camera system and an operator of the vehicle. The optical beam shaper is structurally configured to direct an image of a face of an operator of the vehicle toward the exit field of view of the camera system, and is structurally configured to compress the image in the vertical direction to define a compressed image having a height to width aspect ratio of less an uncompressed height to width aspect ratio of the image.
    Type: Grant
    Filed: February 27, 2013
    Date of Patent: May 8, 2018
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Debbie E. Nachtegall, Eric L. Raphael, Frank J. Jobak
  • Patent number: 9773179
    Abstract: A method for monitoring a vehicle operator can be executed by a controller and includes the following steps: (a) receiving image data of a vehicle operator's head; (b) tracking facial feature points of the vehicle operator based on the image data; (c) creating a 3D model of the vehicle operator's head based on the facial feature points in order to determine a 3D position of the vehicle operator's head; (d) determining a gaze direction of the vehicle operator based on a position of the facial feature points and the 3D model of the vehicle operator's head; (e) determining a gaze vector based on the gaze direction and the 3D position of the vehicle operator's head; and (f) commanding an indicator to activate when the gaze vector is outside a predetermined parameter.
    Type: Grant
    Filed: January 26, 2016
    Date of Patent: September 26, 2017
    Assignee: GM Global Technology Operations LLC
    Inventors: Francisco Vicente, Zehua Huang, Xuehan Xiong, Fernando De La Torre, Wende Zhang, Dan Levi, Debbie E. Nachtegall
  • Patent number: 9623811
    Abstract: A deployable camera system for a vehicle includes a body defining a cavity therein, and a camera including a housing having an exterior surface. The camera is reversibly transitionable between a stowed position in which the camera is recessed into the cavity and the exterior surface is substantially flush with the body, and a deployed position wherein the camera protrudes from the cavity and the exterior surface is not substantially flush with the body. The deployable camera system includes a first shape memory alloy element transitionable between a first state and a second state in response to a first thermal activation signal.
    Type: Grant
    Filed: January 30, 2014
    Date of Patent: April 18, 2017
    Assignees: GM Global Technology Operations LLC, DYNALLOY, INC.
    Inventors: Paul W. Alexander, Debbie E Nachtegall, Nancy L. Johnson, Scott R. Webb, James Ryan Yates, James Holbrook Brown, Aragorn Zolno
  • Publication number: 20160224852
    Abstract: A method for monitoring a vehicle operator can be executed by a controller and includes the following steps: (a) receiving image data of a vehicle operator's head; (b) tracking facial feature points of the vehicle operator based on the image data; (c) creating a 3D model of the vehicle operator's head based on the facial feature points in order to determine a 3D position of the vehicle operator's head; (d) determining a gaze direction of the vehicle operator based on a position of the facial feature points and the 3D model of the vehicle operator's head; (e) determining a gaze vector based on the gaze direction and the 3D position of the vehicle operator's head; and (f) commanding an indicator to activate when the gaze vector is outside a predetermined parameter.
    Type: Application
    Filed: January 26, 2016
    Publication date: August 4, 2016
    Applicants: GM GLOBAL TECHNOLOGY OPERATIONS LLC, Carnegie Mellon University
    Inventors: Francisco Vicente, Zehua Huang, Xuehan Xiong, Fernando De La Torre, Wende Zhang, Dan Levi, Debbie E. Nachtegall
  • Patent number: 9405982
    Abstract: A method for detecting an eyes-off-the-road condition based on an estimated gaze direction of a driver of a vehicle includes monitoring facial feature points of the driver within image input data captured by an in-vehicle camera device. A location for each of a plurality of eye features for an eyeball of the driver is detected based on the monitored facial features. A head pose of the driver is estimated based on the monitored facial feature points. The gaze direction of the driver is estimated based on the detected location for each of the plurality of eye features and the estimated head pose.
    Type: Grant
    Filed: September 30, 2013
    Date of Patent: August 2, 2016
    Assignees: GM GLOBAL TECHNOLOGY OPERATIONS LLC, CARNEGIE MELLON UNIVERSITY
    Inventors: Wende Zhang, Dan Levi, Debbie E. Nachtegall, Fernando De La Torre, Dong Huang
  • Patent number: 9230180
    Abstract: A method for determining an Eyes-Off-The-Road (EOTR) condition exists includes capturing image data corresponding to a driver from a monocular camera device. A detection of whether the driver is wearing eye glasses based on the image data using an eye glasses classifier. When it is detected that the driver is wearing eye glasses, a driver face location is detected from the captured image data and it is determined whether the EOTR condition exists based on the driver face location using an EOTR classifier.
    Type: Grant
    Filed: September 30, 2013
    Date of Patent: January 5, 2016
    Assignees: GM GLOBAL TECHNOLOGY OPERATIONS LLC, CARNEGIE MELLON UNIVERSITY
    Inventors: Wende Zhang, Dan Levi, Debbie E. Nachtegall, Fernando De la Torre, Franscisco Vicente
  • Patent number: 9045074
    Abstract: A driver alert system includes a computer processor disposed in a vehicle. The computer processor is configured to receive driver attention data over a vehicle network during a driving event. The computer processor executes logic to process the driver attention data and evaluate the driver attention data for a triggering event. The system also includes a steering wheel unit disposed in the vehicle and lights that are integrated on a front windshield-facing surface of a steering wheel of the steering wheel unit. The lights are positioned at an angle to reflect light off of a front windshield of the vehicle. The system also includes a controller disposed in the steering wheel unit. The controller is communicatively coupled to the lights and the vehicle network. The controller receives a request from the computer processor to activate the lights when the triggering event has occurred.
    Type: Grant
    Filed: December 12, 2012
    Date of Patent: June 2, 2015
    Assignee: GM Global Technology Operations LLC
    Inventors: Jeffrey S. Piasecki, Charles A. Green, Debbie E. Nachtegall
  • Publication number: 20140240478
    Abstract: A driver monitoring camera system for a vehicle includes a camera system and an optical beam shaper. The camera system has an exit field of view central axis oriented more vertical than horizontal with respect to a set of orthogonal x, y and z axes, where the z-axis defines a direction line indicative of a vertical direction. The optical beam shaper is disposed in optical communication with the camera system and optically between the camera system and an operator of the vehicle. The optical beam shaper is structurally configured to direct an image of a face of an operator of the vehicle toward the exit field of view of the camera system, and is structurally configured to compress the image in the vertical direction to define a compressed image having a height to width aspect ratio of less an uncompressed height to width aspect ratio of the image.
    Type: Application
    Filed: February 27, 2013
    Publication date: August 28, 2014
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Debbie E. Nachtegall, Eric L. Raphael, Frank J. Jobak
  • Publication number: 20140211010
    Abstract: A deployable camera system for a vehicle includes a body defining a cavity therein, and a camera including a housing having an exterior surface. The camera is reversibly transitionable between a stowed position in which the camera is recessed into the cavity and the exterior surface is substantially flush with the body, and a deployed position wherein the camera protrudes from the cavity and the exterior surface is not substantially flush with the body. The deployable camera system includes a first shape memory alloy element transitionable between a first state and a second state in response to a first thermal activation signal.
    Type: Application
    Filed: January 30, 2014
    Publication date: July 31, 2014
    Applicants: DYNALLOY, INC., GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Paul W. Alexander, Debbie E. Nachtegall, Nancy L. Johnson, Scott R. Webb, James Ryan Yates, James Holbrook Brown, Aragorn Zolno
  • Publication number: 20140205143
    Abstract: A method for determining an Eyes-Off-The-Road (EOTR) condition exists includes capturing image data corresponding to a driver from a monocular camera device. A detection of whether the driver is wearing eye glasses based on the image data using an eye glasses classifier. When it is detected that the driver is wearing eye glasses, a driver face location is detected from the captured image data and it is determined whether the EOTR condition exists based on the driver face location using an EOTR classifier.
    Type: Application
    Filed: September 30, 2013
    Publication date: July 24, 2014
    Applicants: Carnegie Mellon University, GM Global Technology Operations LLC
    Inventors: WENDE ZHANG, Dan Levi, Debbie E. Nachtegall, Fernando De La Torre, Franscisco Vicente
  • Publication number: 20140204193
    Abstract: A method for detecting an eyes-off-the-road condition based on an estimated gaze direction of a driver of a vehicle includes monitoring facial feature points of the driver within image input data captured by an in-vehicle camera device. A location for each of a plurality of eye features for an eyeball of the driver is detected based on the monitored facial features. A head pose of the driver is estimated based on the monitored facial feature points. The gaze direction of the driver is estimated based on the detected location for each of the plurality of eye features and the estimated head pose.
    Type: Application
    Filed: September 30, 2013
    Publication date: July 24, 2014
    Applicants: CARNEGIE MELLON UNIVERSITY, GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Dan Levi, Debbie E. Nachtegall, Fernando De La Torre, Dong Huang
  • Publication number: 20140159887
    Abstract: A driver alert system includes a computer processor disposed in a vehicle. The computer processor is configured to receive driver attention data over a vehicle network during a driving event. The computer processor executes logic to process the driver attention data and evaluate the driver attention data for a triggering event. The system also includes a steering wheel unit disposed in the vehicle and lights that are integrated on a front windshield-facing surface of a steering wheel of the steering wheel unit. The lights are positioned at an angle to reflect light off of a front windshield of the vehicle. The system also includes a controller disposed in the steering wheel unit. The controller is communicatively coupled to the lights and the vehicle network. The controller receives a request from the computer processor to activate the lights when the triggering event has occurred.
    Type: Application
    Filed: December 12, 2012
    Publication date: June 12, 2014
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Jeffrey S. Piasecki, Charles A. Green, Debbie E. Nachtegall
  • Patent number: 6968073
    Abstract: An eye-safe light curtain is generated by a plurality of LED's illuminating a cylindrical lens having a corrugated cylindrical surface. A camera generates a first image of an avoidance zone boundary of an air bag inflator with the light curtain off, and a second image of with the light curtain on along the avoidance zone boundary. The first image is subtracted from the second image, and the resulting difference image is binned to enhance signal strength. A penetration of the avoidance zone is classified from features of the leading edge of the binned image, and the air bag inflator is disabled if the avoidance zone is penetrated by an occupant at risk of injury from the deployment thereof. An image of the light curtain may be recovered for high ambient lighting conditions by adapting the exposure time of the camera responsive to the percentage of pixels in a mask region of the first image having values exceeding a threshold.
    Type: Grant
    Filed: April 24, 2002
    Date of Patent: November 22, 2005
    Assignee: Automotive Systems Laboratory, Inc.
    Inventors: Michael E. O'Boyle, Gregory G. Schamp, Owen A. Davies, James C. Demro, Debbie E. Nachtegall, William P. Wernette