Patents by Inventor Ryan M. Frakes

Ryan M. Frakes has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10093247
    Abstract: A system and method for determining when to display frontal curb view images to a driver of a vehicle, and what types of images to display. A variety of factors—such as vehicle speed, GPS/location data, the existence of a curb in forward-view images, and vehicle driving history—are evaluated as potential triggers for the curb view display, which is intended for situations where the driver is pulling the vehicle into a parking spot which is bounded in front by a curb or other structure. When forward curb-view display is triggered, a second evaluation is performed to determine what image or images to display which will provide the best view of the vehicle's position relative to the curb. The selected images are digitally synthesized or enhanced, and displayed on a console-mounted or in-dash display device.
    Type: Grant
    Filed: May 16, 2014
    Date of Patent: October 9, 2018
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Bakhtiar Brian Litkouhi, Ryan M. Frakes
  • Patent number: 9886636
    Abstract: A system and method for creating an enhanced virtual top-down view of an area in front of a vehicle, using images from left-front and right-front cameras. The enhanced virtual top-down view not only provides the driver with a top-down view perspective which is not directly available from raw camera images, but also removes the distortion and exaggerated perspective effects which are inherent in wide-angle lens images. The enhanced virtual top-down view also includes corrections for three types of problems which are typically present in de-warped images—including artificial protrusion of vehicle body parts into the image, low resolution and noise around the edges of the image, and a “double vision” effect for objects above ground level.
    Type: Grant
    Filed: May 16, 2014
    Date of Patent: February 6, 2018
    Assignee: GM Global Technology Operations LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Bakhtiar Brian Litkouhi, Ryan M. Frakes
  • Patent number: 9858639
    Abstract: A method of displaying a captured image on a display device. A real image is captured by an image capture device. The image capture device uses a field-of-view lens that distorts the real image. A camera model is applied to the captured real image. The camera model maps objects in the captured real image to an image sensor plane of the image capture device to generate a virtual image. The image sensor plane is reconfigurable to virtually alter a shape of the image sensor plane to a non-planar surface. The virtual image formed on the non-planar image surface of the image sensor is projected to the display device.
    Type: Grant
    Filed: November 18, 2015
    Date of Patent: January 2, 2018
    Assignee: GM Global Technology Operations LLC
    Inventors: Wende Zhang, Jinsong Wang, Bakhtiar B. Litkouhi, Kent S. Lybecker, Ryan M. Frakes
  • Patent number: 9834143
    Abstract: A system and method for creating an enhanced perspective view of an area in front of a vehicle, using images from left-front and right-front cameras. The enhanced perspective view removes the distortion and exaggerated perspective effects which are inherent in wide-angle lens images. The enhanced perspective view uses a camera model including a virtual image surface and other processing techniques which provide corrections for two types of problems which are typically present in de-warped perspective images—including a stretching effect at the peripheral area of a wide-angle image de-warped by rectilinear projection, and double image of objects in an area where left-front and right-front camera images overlap.
    Type: Grant
    Filed: May 16, 2014
    Date of Patent: December 5, 2017
    Assignee: GM Global Technology Operations LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Bakhtiar Brian Litkouhi, Ryan M. Frakes
  • Publication number: 20160375831
    Abstract: A system and method for providing visual assistance through a graphic overlay super-imposed on a back-up camera image displayed on, for example, a touch screen for assisting a vehicle operator when backing up a towing vehicle to align a hitch ball with a trailer drawbar coupler. The method includes providing camera modeling to correlate the camera image in camera coordinates to world coordinates, where the camera modeling provides a graphic overlay to include an alignment line having a height in the camera image that is determined by an estimated height of the trailer drawbar coupler. The touch screen also operates as a human-machine interface (HMI) that improves the visual assistance by providing one or more of image panning, image zoom, picture-in-picture (PIP), and a virtual top-down hitch-view.
    Type: Application
    Filed: June 9, 2016
    Publication date: December 29, 2016
    Inventors: JINSONG WANG, WENDE ZHANG, RYAN M. FRAKES, MICHAEL A. WUERGLER, ROBERT D. SIMS, III, MOHANNAD MURAD
  • Patent number: 9445011
    Abstract: A vehicle imaging system includes an image capture device capturing an image exterior of a vehicle. The captured image includes at least a portion of a sky scene. A processor generates a virtual image of a virtual sky scene from the portion of the sky scene captured by the image capture device. The processor determines a brightness of the virtual sky scene from the virtual image. The processor dynamically adjusts a brightness of the captured image based the determined brightness of the virtual image. A rear view mirror display device displays the adjusted captured image.
    Type: Grant
    Filed: August 8, 2013
    Date of Patent: September 13, 2016
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, James Clem, Charles A. Green, Ryan M. Frakes, Travis S. Hester
  • Patent number: 9405104
    Abstract: An apparatus for capturing an image includes a plurality of lens elements coaxially encompassed within a lens housing. A split-sub-pixel imaging chip includes an IR-pass filter coating applied on selected sub-pixels. The sub-pixels include a long exposure sub-pixel and a short-exposure sub-pixel for each of a plurality of green blue and red pixels.
    Type: Grant
    Filed: September 30, 2013
    Date of Patent: August 2, 2016
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Ryan M. Frakes, Travis S. Hester
  • Patent number: 9336574
    Abstract: Method for applying super-resolution to images captured by a camera device of a vehicle includes receiving a plurality of image frames captured by the camera device. For each image frame, a region of interest is identified within the image frame requiring resolution related to detail per pixel to be increased. Spatially-implemented super-resolution is applied to the region of interest within each image to enhance image sharpness within the region of interest.
    Type: Grant
    Filed: September 30, 2013
    Date of Patent: May 10, 2016
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Ryan M. Frakes, Travis S. Hester
  • Patent number: 9327610
    Abstract: A system and method for individually discharging battery cells in a high voltage vehicle battery. The system includes a battery controller that monitors and controls the state-of-charge of each of the battery cells and a cell balancing circuit for maintaining the charge of the cells substantially equal. The controller receives a signal from a vehicle crash detector indicating that the vehicle has been in a crash, and in response instructs the cell balancing circuit to discharge all of the battery cells.
    Type: Grant
    Filed: September 12, 2012
    Date of Patent: May 3, 2016
    Assignee: GM Global Technology Operations LLC
    Inventors: Peter Andres, Ryan M. Frakes, Paul W. Kelley
  • Publication number: 20160098815
    Abstract: A method of displaying a captured image on a display device. A real image is captured by an image capture device. The image capture device uses a field-of-view lens that distorts the real image. A camera model is applied to the captured real image. The camera model maps objects in the captured real image to an image sensor plane of the image capture device to generate a virtual image. The image sensor plane is reconfigurable to virtually alter a shape of the image sensor plane to a non-planar surface. The virtual image formed on the non-planar image surface of the image sensor is projected to the display device.
    Type: Application
    Filed: November 18, 2015
    Publication date: April 7, 2016
    Inventors: WENDE ZHANG, JINSONG WANG, BAKHTIAR B. LITKOUHI, KENT S. LYBECKER, RYAN M. FRAKES
  • Patent number: 9304301
    Abstract: An apparatus for capturing an image includes a plurality of lens elements coaxially encompassed within a lens housing. One of the lens elements includes an aspheric lens element having a surface profile configured to enhance a desired region of a captured image. At least one glare-reducing element coaxial with the plurality of lens elements receives light subsequent to the light sequentially passing through each of the lens elements. An imaging chip receives the light subsequent to the light passing through the at least one glare-reducing element. The imaging chip includes a plurality of green, blue and red pixels.
    Type: Grant
    Filed: September 30, 2013
    Date of Patent: April 5, 2016
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Ryan M. Frakes, Travis S. Hester
  • Patent number: 9307207
    Abstract: A method for generating a glare-reduced image from images captured by a camera device of a subject vehicle includes obtaining a short-exposure image and a long-exposure image and generating a resulting high dynamic range image based on the short-exposure and long-exposure images. Pixel values are monitored within both the short- and long-exposure images. A light source region is identified within both the short- and long-exposure images based on the monitored pixel values. A glaring region is identified based on the identified light source region and one of calculated pixel ratios and calculated pixel differences between the monitored pixel values of the long- and short-exposure images. The identified glaring region upon the resulting high dynamic range image is modified with the identified light source region within the short-exposure image. The glare-reduced image is generated based on the modified identified glaring region upon the resulting HDR image.
    Type: Grant
    Filed: September 30, 2013
    Date of Patent: April 5, 2016
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Ryan M. Frakes, Travis S. Hester
  • Patent number: 9225942
    Abstract: A method for displaying a captured image on a display device. A real image is captured by a vision-based imaging device. A virtual image is generated from the captured real image based on a mapping by a processor. The mapping utilizes a virtual camera model with a non-planar imaging surface. Projecting the virtual image formed on the non-planar image surface of the virtual camera model to the display device.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: December 29, 2015
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Bakhtiar Brian Litkouhi, Kent S. Lybecker, Ryan M. Frakes
  • Publication number: 20150115571
    Abstract: A system and method for providing visual assistance through a graphic overlay super-imposed on a back-up camera image for assisting a vehicle operator when backing up a vehicle to align a tow ball with a trailer tongue. The method includes providing camera modeling to correlate the camera image in vehicle coordinates to world coordinates, where the camera modeling provides the graphic overlay to include a tow line having a height in the camera image that is determined by an estimated height of the trailer tongue. The method also includes providing vehicle dynamic modeling for identifying the motion of the vehicle as it moves around a center of rotation. The method then predicts the path of the vehicle as it is being steered including calculating the center of rotation.
    Type: Application
    Filed: September 3, 2014
    Publication date: April 30, 2015
    Inventors: Wende Zhang, James N. Nickolaou, Ryan M. Frakes
  • Publication number: 20150109444
    Abstract: A method of displaying a captured image on a display device of a driven vehicle. A scene exterior of the driven vehicle is captured by an at least one vision-based imaging and at least one sensing device. A time-to-collision is determined for each object detected. A comprehensive time-to-collision is determined for each object as a function of each of the determined time-to-collisions for each object. An image of the captured scene is generated by a processor. The image is dynamically expanded to include sensed objects in the image. Sensed objects are highlighted in the dynamically expanded image. The highlighted objects identifies objects proximate to the driven vehicle that are potential collisions to the driven vehicle. The dynamically expanded image with highlighted objects and associated collective time-to-collisions are displayed for each highlighted object in the display device that is determined as a potential collision.
    Type: Application
    Filed: November 5, 2013
    Publication date: April 23, 2015
    Applicant: GM Global Technology Operations LLC
    Inventors: Wende Zhang, Jinsong Wang, Bakhtiar B. Litkouhi, Dennis B. Kazensky, Jeffrey S. Piasecki, Charles A. Green, Ryan M. Frakes, Raymond J. Kiefer
  • Publication number: 20150042799
    Abstract: A method of displaying a captured image on a display device of a driven vehicle. A scene exterior of the driven vehicle is captured by an at least one vision-based imaging device mounted on the driven vehicle. Objects in a vicinity of the driven vehicle are sensed. An image of the captured scene is generated by a processor. The image is dynamically expanded to include sensed objects in the image. The sensed objects are highlighted in the dynamically expanded image. The highlighted objects identify vehicles proximate to the driven vehicle that are potential collisions to the driven vehicle. The dynamically expanded image is displayed with highlighted objects in the display device.
    Type: Application
    Filed: October 22, 2013
    Publication date: February 12, 2015
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Bakhtiar B. Litkouhi, Dennis B. Kazensky, Jeffrey S. Piasecki, Charles A. Green, Ryan M. Frakes
  • Publication number: 20140347469
    Abstract: A system and method for creating an enhanced perspective view of an area in front of a vehicle, using images from left-front and right-front cameras. The enhanced perspective view removes the distortion and exaggerated perspective effects which are inherent in wide-angle lens images. The enhanced perspective view uses a camera model including a virtual image surface and other processing techniques which provide corrections for two types of problems which are typically present in de-warped perspective images—including a stretching effect at the peripheral area of a wide-angle image de-warped by rectilinear projection, and double image of objects in an area where left-front and right-front camera images overlap.
    Type: Application
    Filed: May 16, 2014
    Publication date: November 27, 2014
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende ZHANG, Jinsong WANG, Kent S. LYBECKER, Jeffrey S. PIASECKI, Bakhtiar Brian LITKOUHI, Ryan M. FRAKES
  • Publication number: 20140347470
    Abstract: A system and method for creating an enhanced virtual top-down view of an area in front of a vehicle, using images from left-front and right-front cameras. The enhanced virtual top-down view not only provides the driver with a top-down view perspective which is not directly available from raw camera images, but also removes the distortion and exaggerated perspective effects which are inherent in wide-angle lens images. The enhanced virtual top-down view also includes corrections for three types of problems which are typically present in de-warped images—including artificial protrusion of vehicle body parts into the image, low resolution and noise around the edges of the image, and a “double vision” effect for objects above ground level.
    Type: Application
    Filed: May 16, 2014
    Publication date: November 27, 2014
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: WENDE ZHANG, JINSONG WANG, KENT S. LYBECKER, JEFFREY S. PIASECKI, BAKHTIAR BRIAN LITKOUHI, RYAN M. FRAKES
  • Publication number: 20140347485
    Abstract: A system and method for determining when to display frontal curb view images to a driver of a vehicle, and what types of images to display. A variety of factors—such as vehicle speed, GPS/location data, the existence of a curb in forward-view images, and vehicle driving history—are evaluated as potential triggers for the curb view display, which is intended for situations where the driver is pulling the vehicle into a parking spot which is bounded in front by a curb or other structure. When forward curb-view display is triggered, a second evaluation is performed to determine what image or images to display which will provide the best view of the vehicle's position relative to the curb. The selected images are digitally synthesized or enhanced, and displayed on a console-mounted or in-dash display device.
    Type: Application
    Filed: May 16, 2014
    Publication date: November 27, 2014
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wende Zhang, Jinsong Wang, Kent S. Lybecker, Jeffrey S. Piasecki, Bakhtiar Brian Litkouhi, Ryan M. Frakes
  • Publication number: 20140193032
    Abstract: Method for applying super-resolution to images captured by a camera device of a vehicle includes receiving a plurality of image frames captured by the camera device. For each image frame, a region of interest is identified within the image frame requiring resolution related to detail per pixel to be increased. Spatially-implemented super-resolution is applied to the region of interest within each image to enhance image sharpness within the region of interest.
    Type: Application
    Filed: September 30, 2013
    Publication date: July 10, 2014
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: WENDE ZHANG, JINSONG WANG, KENT S. LYBECKER, JEFFREY S. PIASECKI, RYAN M. FRAKES, TRAVIS S. HESTER