Navigation Patents (Class 348/113)
  • Patent number: 8494741
    Abstract: A vehicle control device performs a program including the step of obtaining a target point for movement based on information from a vehicle exterior camera, the step of obtaining a distance X to the target point, the step of resetting a distance counter, the step of causing the vehicle to enter accelerated running at set acceleration, the step of causing the vehicle to change from the accelerated running to constant-speed running when the distance counter reaches X, and the step of causing the vehicle to change from the constant-speed running to decelerated running when the distance counter reaches X.
    Type: Grant
    Filed: November 19, 2004
    Date of Patent: July 23, 2013
    Assignee: Toyota Jidosha Kabushiki Kaisha
    Inventor: Hideki Takamatsu
  • Patent number: 8494225
    Abstract: An automated guidance system for a moving frame. The automated guidance system has an imaging system disposed on the frame; a motion sensing system coupled to the frame and configured for sensing movement of the frame; and a processor communicably connected to the vision system for receiving image data from the vision system and generating optical flow from image data of frame surrounding. The processor is communicably connected to the motion sensing system for receiving motion data of the frame from the motion sensing system. The processor is configured for determining, from kinematically aided dense optical flow correction to frame kinematic errors, due to errors in motion data from the motion sensing system.
    Type: Grant
    Filed: February 18, 2011
    Date of Patent: July 23, 2013
    Inventor: Julian L. Center
  • Patent number: 8487991
    Abstract: A method for estimating a vanishing point in a roadway using a current image generated by a camera on a vehicle includes defining an exemplary vanishing point for each of a plurality of sample images, identifying features within each of the plurality of sample images, monitoring the current image generated by the camera, identifying features within the current image, matching the current image to at least one of the sample images based upon the identified features within the current image and the identified features within the plurality of sample images, determining a vanishing point based upon the matching and the exemplary vanishing points for each of the matched sample images, and utilizing the vanishing point to navigate the vehicle.
    Type: Grant
    Filed: October 19, 2009
    Date of Patent: July 16, 2013
    Assignees: GM Global Technology Operations LLC, Carnegie Mellon University
    Inventors: Wende Zhang, Qi Wu, Tsuhan Chen
  • Patent number: 8462204
    Abstract: A vehicular vision system includes at least a first image capture sensor and a second image capture sensor disposed at a vehicle and spatially separated and having respective fields of view with respect to the direction of travel of the equipped vehicle. A control receives a first image input from the first image capture sensor and a second image input from the second image capture sensor and generates a composite image synthesized from at least the first image input and the second image input. A display system displays the composite image on a single video screen located in a cabin of the equipped vehicle and viewable by a driver of the equipped vehicle when the driver is normally operating the equipped vehicle. The single video screen of the display system may have a display luminance that is variable responsive to a sensing of an ambient light level.
    Type: Grant
    Filed: July 1, 2009
    Date of Patent: June 11, 2013
    Assignee: Donnelly Corporation
    Inventors: Kenneth Schofield, Mark L. Larson, Keith J. Vadas
  • Patent number: 8462993
    Abstract: A map information display apparatus for displaying map information on the basis of information on image-capturing times and image-capturing positions that are respectively associated with a plurality of captured images includes a captured image extraction unit configured to extract images captured within a predetermined time period that includes the image-capturing time of a predetermined captured image from among the plurality of captured images; a map area selection unit configured to select an area of a map so as to include the image-capturing positions of the captured images extracted by the captured image extraction unit by using as a reference the image-capturing position of the predetermined captured image; and a map information display unit configured to display map information in such a manner that the area of the map, which is selected by the map area selection unit, is displayed.
    Type: Grant
    Filed: April 16, 2012
    Date of Patent: June 11, 2013
    Assignee: Sony Corporation
    Inventor: Masanao Tsutsui
  • Patent number: 8456512
    Abstract: An electronic device and a method enable capturing a 360° panoramic image by a digital camera having a fixed angle lens. A number of frames is set for capturing the 360° panoramic image of the digital camera unit. The electronic device receives an initial azimuth of the digital camera unit from an electronic compass and determines rotation points of the digital camera unit. A current azimuth from an electronic compass of the electronic device is received and the rotated angle of the digital camera unit is calculated. The electronic device captures at least one image if the digital camera unit rotates to one of the rotation points.
    Type: Grant
    Filed: August 25, 2010
    Date of Patent: June 4, 2013
    Assignee: FIH (Hong Kong) Limited
    Inventor: Chih-Hua Lin
  • Patent number: 8447440
    Abstract: A method comprising running a persistent self-righting behavior comprising sensing an orientation of the remote vehicle and performing a progression of flipper movements until the remote vehicle is righted, and performing a retrotraverse behavior comprising: generating a list of time stamped waypoints separated by at least a minimum difference in time and distance; storing the list of time stamped waypoints in the memory; and generating, using a control system, a current return path interconnecting previously-traversed waypoints in reverse order of timestamps upon losing communication with the operator control unit or upon receiving a command from the operator control unit.
    Type: Grant
    Filed: March 5, 2012
    Date of Patent: May 21, 2013
    Assignee: iRobot Coporation
    Inventors: Emilie Phillips, Pavlo E. Rudakevych, Orjeta Taka, James Gordon Wolfe, Jr., Tom Frost
  • Patent number: 8421865
    Abstract: A method of calibrating a vehicular multi-camera system includes equipping a vehicle with a plurality of cameras wherein each camera of the plurality of cameras captures image data, equipping the vehicle with an image processor, inputting image data from each of the plurality of cameras to the image processor, the image processor processing input image data in order to calibrate the vehicular multi-camera system, and wherein calibration of the vehicular multi-camera system is achieved independently of a model of the real world.
    Type: Grant
    Filed: May 1, 2012
    Date of Patent: April 16, 2013
    Assignee: Magna Electronics Europe GmbH & Co. KG
    Inventors: Christian Euler, Markus Adameck
  • Patent number: 8416294
    Abstract: A positioning device comprising: a movement measurement unit that measures relative position variation; a positioning unit that enables measurement of positional information; and a control unit that starts continuous measurement of position variation by the movement measurement unit and measurement of positional information by the positioning unit at each predetermined timing for at least a specified position, and determines a position determination spot based on positional information of any of the at least two positions in a case that the difference between the amount of position variation and the amount of relative position variation is determined by the determining unit to be within a predetermined range, and calculates positional information of the specified position based on positional information of the position determination spot and information of position variation that has been continuously measured by the movement measurement unit.
    Type: Grant
    Filed: December 6, 2010
    Date of Patent: April 9, 2013
    Assignee: Casio Computer Co., Ltd.
    Inventor: Naoto Toda
  • Patent number: 8405723
    Abstract: A method and system for maintaining the line of sight of an airborne camera fixed on a target by compensating for overflight velocity of the aircraft. The compensation system automatically commands an angular velocity of the line of sight to maintain the camera pointing at the target being overflown. This angular velocity of the line of sight is computed based upon the aircraft overflight velocity and upon a vector from the aircraft to the target. This automatic compensation for aircraft overflight velocity causes the line of sight to remain fixed upon the target. The compensation system drives a gimbal system upon which the camera is mounted to perform this compensation automatically.
    Type: Grant
    Filed: October 6, 2009
    Date of Patent: March 26, 2013
    Assignee: Insitu, Inc.
    Inventors: Andreas H. von Flotow, Mathieu Mercadal
  • Patent number: 8405725
    Abstract: A video processor module suitable for use in a vehicle includes a video processor and a plurality of imaging sensor interfaces having at least a first imaging sensor interface configured for communication with a first imaging sensor of the equipped vehicle and a second imaging sensor interface configured for communication with a second imaging sensor of the equipped vehicle, with the first and second imaging sensor interfaces receiving image data captured by the first and second imaging sensors of the equipped vehicle, respectively. The video processor may include an object detection section, a camera selection section, a camera control section and/or a memory section. The video processor module may include a vehicle interface section.
    Type: Grant
    Filed: February 18, 2010
    Date of Patent: March 26, 2013
    Assignee: Donnelly Corporation
    Inventors: Martha A. McMahon, Troy O. Cooprider
  • Patent number: 8384778
    Abstract: An instrument for of observation images exhibits a high ground resolution and a high frequency of coverage of the Earth. Such an instrument includes a spatial images acquisition layer (1) including satellites (4), a terrestrial images processing layer (3), including images processing devices (5), and a telecommunications layer (2) that is suitable to ensure a transfer of the images from the spatial layer (1) to the terrestrial layer (3), wherein each satellite (4) includes at least one images acquisition device with fixed aim exhibiting a spatial resolution of the order of one meter; each images processing device (5) includes at least one communications line (8) coupling the images processing device (5) and at least one immediately adjacent images processing device, a processing unit that is suitable to process the images received, element for storage of the processed images, and a connection to a digital network.
    Type: Grant
    Filed: August 28, 2008
    Date of Patent: February 26, 2013
    Assignee: Centre National d'Etudes Spatiales (C.N.E.S.)
    Inventor: Jean-Pierre Antikidis
  • Patent number: 8379924
    Abstract: A vehicle environment monitoring system is provided that is based on a three-dimensional vector model. The three-dimensional vector model of the vehicle's environment is generated on the basis of the image data captured by at least one three-dimensional camera. Out of the image data, particular data are extracted for generating the three-dimensional vector model in order to reduce the data volume. For data extraction, a data extraction algorithm is applied that is determined in accordance with at least one parameter that relates to the situation of the vehicle. Therefore, targeted data extraction is performed for generating a three-dimensional model that is particularly adapted for an application that is desired in the current vehicle situation. The applications of the vector model include driver assistance, external monitoring and vehicle control, as well as recording in an event data recorder.
    Type: Grant
    Filed: March 31, 2009
    Date of Patent: February 19, 2013
    Assignee: Harman Becker Automotive Systems GmbH
    Inventor: Roland Schaufler
  • Patent number: 8374421
    Abstract: Methods and systems for robot and cloud communication are described. A robot may interact with the cloud to perform any number of actions using video captured from a point-of-view or in the vicinity of the robot. The cloud may be configured to extract still frames from compressed video received from the robot at a frame rate determined based on a number of factors, including the robot's surrounding environment, the available bandwidth, or actions being performed. The cloud may be configured to request that a compressed video with higher frame rate be sent so that the cloud can extract still frames at a higher frame rate. Further, the cloud may be configured to request that a second compressed video from a second perspective be sent to provide additional environment information.
    Type: Grant
    Filed: October 18, 2011
    Date of Patent: February 12, 2013
    Assignee: Google Inc.
    Inventor: Ryan Hickman
  • Patent number: 8368755
    Abstract: Considering the locations of a self-vehicle and other vehicles changing from moment to moment, an image signal is chosen in relation to the location, orientation, viewing angle, and moving speed of a camera mounted on each vehicle, and information on a region to be a driver's blind spot is provided in real time by means of images and voice. When there is the other vehicles whose camera meets requirements such as the location, orientation, viewing angle, and moving speed for photographing a region to be the self-vehicle's blind spot, it is possible to provide information on the blind spot by the image picked up by the camera. However, since the other vehicle's location also changes with a lapse of time, it is not possible to keep photographing the blind spot with the same camera.
    Type: Grant
    Filed: December 14, 2006
    Date of Patent: February 5, 2013
    Assignee: Hitachi, Ltd.
    Inventors: Toshio Nishida, Hirotomo Sai
  • Patent number: 8368761
    Abstract: Disclosed herein is an image correction method for a camera system, which minimizes the amount of data that must be stored by a camera system and which can conveniently correct mounting errors of cameras. In the image correction method for a camera system, image data about a reference ground, which is captured by a camera and on which at least one ground mark is indicated, is acquired. Coordinates of a captured ground mark are obtained based on the image data. A preset Look-Up Table (LUT) is corrected using errors between the coordinates of the captured ground mark and coordinates of a preset reference mark. The ground mark and the reference mark may respectively have four or more corresponding correction points.
    Type: Grant
    Filed: November 24, 2010
    Date of Patent: February 5, 2013
    Assignees: Hyundai Motor Company, Kia Motors Corporation
    Inventor: Wung Chul Chung
  • Patent number: 8363103
    Abstract: A drive assist display apparatus displays the backward or frontward of a vehicle. It is assumed that planes are perpendicular with the front-back direction, the downward, leftward and rightward directions being perpendicular with the front-back direction. Square subjects assumed to be on the planes are displayed as squares or rectangles having equal to one another on respective regions in accordance with the direction. The regions include a forward correction image display region in the vicinity of other display regions. The vicinity area has the same display image corresponding to a straight line coincident with a vertical straight line with respect to the ground surface or being in the vehicle front-back direction. The bottom side of a leftward or rightward correction image display region and the left or right side of a downward correction image display region are straight lines coincident with respective vehicle front-back direction straight lines.
    Type: Grant
    Filed: July 20, 2011
    Date of Patent: January 29, 2013
    Assignee: Panasonic Corporation
    Inventors: Tadao Ichinose, Koji Takahashi
  • Patent number: 8350894
    Abstract: A method is disclosed for performing stereoscopic imaging. The method may involve obtaining a first image of a scene, at a first time, using a camera disposed on a platform, where the distance between the camera and the scene is changing. The camera may be used to obtain a second image of the scene, at a second time, with one of the first and second images being larger than the other. One of the images that is larger than the other may be resized so that the sizes of the two images are substantially similar. Both of the images may be rotated a predetermined degree so that the images form a stereo pair that may be viewed with a stereoscope viewing component or made into an anaglyph for viewing with an anaglyph viewing component.
    Type: Grant
    Filed: April 17, 2009
    Date of Patent: January 8, 2013
    Assignee: The Boeing Company
    Inventors: Robert W. Turner, David W. Hoffman
  • Patent number: 8339255
    Abstract: A display system of the present invention includes a liquid crystal platform section (200) which outputs display data for displaying, on a liquid crystal display section (100), an image in accordance with information obtained from an automobile. The liquid crystal platform section (200) includes a DIC (201) which generates display data and calculates a display position of the image to be displayed on the liquid crystal display section (100) from the obtained information and which causes the generated display data to be displayed in the calculated image display position. The DIC (201) updates display so that the image moves at frame intervals from a start position of image display to the image display position calculated from the automobile information currently obtained, when an interval at which the information is obtained is longer than each of the frame intervals for displaying the image.
    Type: Grant
    Filed: November 14, 2008
    Date of Patent: December 25, 2012
    Assignee: Sharp Kabushiki Kaisha
    Inventors: Kazuhiko Yoda, Masayuki Fujisawa, Fumiaki Fujimoto
  • Patent number: 8320616
    Abstract: A method of estimating position and orientation of a vehicle using image data is provided. The method includes capturing an image of a region external to the vehicle using a camera mounted to the vehicle, and identifying in the image a set of feature points of the region. The method further includes subsequently capturing another image of the region from a different orientation of the camera, and identifying in the image the same set of feature points. A pose estimation of the vehicle is generated based upon the identified set of feature points and corresponding to the region. Each of the steps are repeated at with respect to a different region at least once so as to generate at least one succeeding pose estimation of the vehicle. The pose estimations are then propagated over a time interval by chaining the pose estimation and each succeeding pose estimation one with another according to a sequence in which each was generated.
    Type: Grant
    Filed: August 21, 2007
    Date of Patent: November 27, 2012
    Assignee: University of Florida Research Foundation, Inc.
    Inventors: Michael Kent Kaiser, Nicholas Raphael Gans, Warren Everett Dixon, Siddhartha Satish Mehta
  • Publication number: 20120287262
    Abstract: An in-vehicle information apparatus according to the invention includes a main unit having a display device, and a navigation unit providing a navigation function to the main unit. The navigation unit includes a navigation processing unit which executes a process concerning the navigation function, a sub unit providing an addition function to the navigation unit, and a navigation unit screen generating unit which generates a navigation unit screen for displaying information concerning a function which the navigation unit provides. The main unit includes an operation unit which receives an input for selecting a function from a user, a main unit screen generating unit which generates a main unit screen for displaying information concerning a function which the main unit provides, and a video selector which selects one of the navigation unit screen and the main unit screen and provides the selected one to the display device.
    Type: Application
    Filed: January 26, 2011
    Publication date: November 15, 2012
    Applicant: CLARION CO., LTD.
    Inventors: Kiyoshi Nakayama, Masato Takahashi
  • Patent number: 8305204
    Abstract: According to an aspect of this disclosure, a vehicle surrounding confirmation apparatus includes a narrow-field-of-view image generating portion generating a narrow-field-of-view image, showing a portion of a vehicle surrounding, from a captured image of the vehicle surrounding obtained by an image capturing portion, an obstacle recognizing portion recognizing an obstacle existing at the vehicle surrounding, a determining portion determining whether or not the obstacle, recognized by the obstacle recognizing portion, is included within the narrow-field-of-view image, an obstacle image extracting portion extracting an area, in which an image of the obstacle is shown, from the captured image as an obstacle image, when the obstacle, recognized by the obstacle recognizing portion, is not determined to be included within the narrow-field-of-view image, and a display image generating portion generating a display image from the narrow-field-of-view image and the obstacle image, thereby outputting the generated displ
    Type: Grant
    Filed: December 1, 2009
    Date of Patent: November 6, 2012
    Assignee: Aisin Seiki Kabushiki Kaisha
    Inventors: Noboru Nagamine, Kazuya Watanabe, Takeshi Naito, Tadashi Asano
  • Patent number: 8294766
    Abstract: Systems and methods are providing for navigating a three-dimensional model using deterministic movement of an electronic device. An electronic device can load and provide an initial display of a three dimensional model (e.g., of an environment or of an object). As the user moves the electronic device, motion sensing components, positioning circuitry, and other components can detect the device movement and adjust the displayed portion of the three-dimensional model to reflect the movement of the device. By walking with the device in the user's real environment, a user can virtually navigate a representation of a three-dimensional environment. In some embodiments, a user can record an object or environment using an electronic device, and tag the recorded images or video with movement information describing the movement of the device during the recording. The recorded information can then be processed with the movement information to generate a three-dimensional model of the recorded environment or object.
    Type: Grant
    Filed: January 28, 2009
    Date of Patent: October 23, 2012
    Assignee: Apple Inc.
    Inventors: Richard Tsai, Andrew Just, Brandon Harris
  • Publication number: 20120249774
    Abstract: An image-based sensor system for a mobile unit makes use of light emitters and imagers to acquire illumination patterns of emitted light impinging on the floor and/or walls surrounding the unit. The illumination pattern is used to estimate location and/or orientation of the unit. These estimates are used for one or more functions of stabilization, calibration, localization, and mapping of or with respect to the unit.
    Type: Application
    Filed: April 4, 2011
    Publication date: October 4, 2012
    Applicant: CyPhy Works, Inc.
    Inventors: Samuel A. Johnson, Helen Greiner, Andrew Shein
  • Patent number: 8279279
    Abstract: An image processing apparatus permits a user to readily recognize a current state of an angle of view. When an angle of view is switched from a wide-angle to a narrow-angle, range display is performed for a predetermined time prior to the switching. Range display includes a narrow-angle image frame formed with lines indicating a border of an image displayed for a predetermined time prior to the switching. After the predetermined time, a narrow-angle image is displayed and the range display is no longer displayed. The range display allows a user to readily recognize that the wide-angle image has been switched to the narrow-angle image by recognizing to what area in a pre-switching wide angle of view image the post-switching narrow-angle image corresponds.
    Type: Grant
    Filed: August 26, 2008
    Date of Patent: October 2, 2012
    Assignees: DENSO CORPORATION, Nippon Soken, Inc.
    Inventors: Toshihiro Hattori, Masayuki Imanishi
  • Patent number: 8275170
    Abstract: Provided is an apparatus and method for detecting a horizon which is necessary to detect a camera movement when compositing sea images in a marker-free sea-image camera tracking system. In the method, an ROI is selected near a horizon in a still image of the moving image of the sea, and each maximum point corresponding to the maximum brightness difference is detected from brightness differences between two pixels of each pair having two symmetrical pixels in each column of the ROI. The horizon is detected through a line-fitting using the maximum points. Therefore, the result of horizon detection can be very stable and a horizon can be easily detected in a sea scene having hundreds of frames.
    Type: Grant
    Filed: December 7, 2007
    Date of Patent: September 25, 2012
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jae Kwang Lee, Chang Joon Park, In Ho Lee
  • Patent number: 8274562
    Abstract: A camera for identifying soiling on a protective screen, such as a vehicle windscreen, is focused on a scene through the protective screen and can be used to identify soiling and for other applications, e.g. to identify driving lanes and/or objects in the scene. Soiling is identified merely by evaluating successively recorded image frames, and artificial reference frames or reference objects are not required. A prerequisite is that the relative speed vrel between the camera and at least one recorded object in the scene is not equal to zero and its trajectory in the image is predicted. By comparing the relevant image frame sections, possible soiling on subregions of the protective screen is identified.
    Type: Grant
    Filed: February 21, 2006
    Date of Patent: September 25, 2012
    Assignee: ADC Automotive Distance Control Systems GmbH
    Inventors: Michael Walter, Matthias Zobel
  • Patent number: 8260545
    Abstract: A method is described for generating a navigation chart. The navigation chart includes a plurality of allocated areas corresponding to symbols for a plurality of chart features. The method includes identifying an unallocated area of the navigation chart proximate to a symbol for one chart feature of the plurality of chart features. A first label and a second label are determined for the one chart feature. The first label includes a plurality of feature attribute indicators, and the second label includes a subset of the plurality of feature attribute indicators. A label is selected from among the first label and the second label based on dimensions of the unallocated area. At least a portion of the unallocated area is allocated to the selected label, and the navigation chart is displayed.
    Type: Grant
    Filed: November 20, 2009
    Date of Patent: September 4, 2012
    Assignee: The Boeing Company
    Inventors: Sven D. Aspen, Kevin S. Schlatter, Robert Henry, Stephen A. Lewis, Danny M. Price, Robert Black
  • Patent number: 8255092
    Abstract: A system for allowing an operator to switch between remote vehicle tele-operation and one or more remote vehicle autonomous behaviors. The system comprises: an operator control unit receiving input from the operator including instructions for the remote vehicle to execute an autonomous behavior; a control system on the remote vehicle for receiving the instruction to execute an autonomous behavior from the operator control unit; and a GPS receiver, an inertial measurement unit, and a navigation CPU on the remote vehicle. Upon receiving the instruction to execute an autonomous behavior, the remote vehicle executes that autonomous behavior using input from the GPS receiver, the inertial measurement unit (IMU), and the navigation CPU.
    Type: Grant
    Filed: April 14, 2008
    Date of Patent: August 28, 2012
    Assignee: Irobot Corporation
    Inventors: Emilie Phillips, Pavlo E. Rudakevych, Orjeta Taka, James Gordon Wolfe, Jr., Tom Frost
  • Patent number: 8253797
    Abstract: A method for constructing a georeferencing-enabled camera model and its deployment in georeferencing targets located in video sequences due to a single video camera. A video surveillance camera is modeled by a collection of rays converging at a virtual camera point and the retina resolution cell coordinates associated with those rays wherein the ray equations are first established, in the course of a calibration process, for a given camera view, with the aid of other views of the same video surveillance camera, as necessary, and using such a model for mapping image coordinates to terrain coordinates and vice versa in the intended view or its adaptation for use in other views of the same video surveillance camera.
    Type: Grant
    Filed: March 5, 2008
    Date of Patent: August 28, 2012
    Assignee: PureTech Systems Inc.
    Inventors: Fereydoun Maali, Monroe M. Thomas
  • Patent number: 8223277
    Abstract: A display device displays a D-seat image and a P-seat image on a display screen in a time-sharing manner, and forms a non-display state by inserting a black image BL or the like when changing the viewing angle of the display screen by controlling a liquid crystal shutter provided on the display screen in synchronization with the switching between the D-seat image and the P-seat image. With this display device, it is possible to prevent the image in one field of view from entering the other field of view, even if there are differences in the switching timing of the liquid crystal shutter.
    Type: Grant
    Filed: February 21, 2007
    Date of Patent: July 17, 2012
    Assignee: Fujitsu Ten Limited
    Inventors: Tetsuya Ohtoshi, Minoru Maehata
  • Publication number: 20120176491
    Abstract: An apparatus and method for estimating a position of a mobile device based on one or more images is disclosed. Positioning information is derived from an image containing an SAS (self-addressing source such as a QR code), thereby setting a first vector V1 and an SAS pose. The image is also used to determine a displacement between the mobile device and the self-addressing source, thereby setting a second vector V2. Using the first vector V1, the SAS pose and the second vector V2, the mobile device may estimate its position with high accuracy and may also recalibrate dead-reckoning navigation and a gyrometer.
    Type: Application
    Filed: June 30, 2011
    Publication date: July 12, 2012
    Applicant: QUALCOMM Incorporated
    Inventors: Lionel J. Garin, Ayman Naguib, Charles A. Bergan
  • Publication number: 20120176492
    Abstract: An apparatus and method to enhance dead-reckoning navigation using inertial sensor measurements based on images from a camera are disclosed. A camera build into a mobile device is used to calibrate inertial sensors and rotation matrices. Images from a camera may be used (1) to remove a gravitational element from accelerometer measurements; (2) to set a scaling factor and an offset for a gyrometer; and (3) to set initial and updated values for rotation matrices.
    Type: Application
    Filed: June 30, 2011
    Publication date: July 12, 2012
    Applicant: QUALCOMM Incorporated
    Inventor: Lionel J. Garin
  • Patent number: 8212878
    Abstract: An on-vehicle camera calibration apparatus includes: an on-vehicle camera; a camera parameter calculation unit configured to calculate camera parameters from a characteristic amount of a road surface sign photographed by the on-vehicle camera and recognized by an image processing and to output the camera parameters, wherein the camera parameters include an installation height and installation angle of the on-vehicle camera in photographing; and a camera parameter calibration unit configured to perform optical axis calibration control of the on-vehicle camera by the camera parameters output from the camera parameter calculation unit.
    Type: Grant
    Filed: June 28, 2007
    Date of Patent: July 3, 2012
    Assignee: Hitachi, Ltd.
    Inventors: Takeshi Shima, Shoji Muramatsu, Yuji Otsuka, Tatsuhiko Monji, Kota Irie
  • Patent number: 8213749
    Abstract: A system and method synthesizing images of a locale to generate a composite image that provide a panoramic view of the locale. A video camera moves along a street recording images of objects along the street. A GPS receiver and inertial navigation system provide the position of the camera as the images are being recorded. The images are indexed with the position data provided by the GPS receiver and inertial navigation system. The composite image is created on a column-by-column basis by determining which of the acquired images contains the desired pixel column, extracting the pixels associated with the column, and stacking the columns side by side. The composite images are stored in an image database and associated with a street name and number range of the street being depicted in the image. The image database covers a substantial amount of a geographic area allowing a user to visually navigate the area from a user terminal.
    Type: Grant
    Filed: September 17, 2010
    Date of Patent: July 3, 2012
    Assignee: Verderi, LLC
    Inventors: Enrico Di Bernardo, Luis F. Goncalves
  • Patent number: 8199976
    Abstract: An image pickup device that acquires images is controlled by an image pickup device controller that accepts image acquisition requests from multiple application programs, and an application scheduler selects application programs to be executed. Information indicative of the image data volumes and image data acquisition rates required for each of the multiple application programs is stored and used to select multiple concurrently executable application programs on the basis of the image data volumes and image data acquisition rates. An image acquisition scheduler determines the timing and intervals at which the multiple executable application programs repeat receiving image data from the image pickup device, without overlapping in terms of time. In addition, an operations section, which explicitly presents concurrently executable application programs to a user and commands the startup of these programs, is displayed on a navigation screen menu.
    Type: Grant
    Filed: July 19, 2011
    Date of Patent: June 12, 2012
    Assignee: Hitachi, Ltd.
    Inventors: Shoji Muramatsu, Yuuji Otsuka, Hiroshi Takenaga, Tatsuhiko Monji, Jiro Takezaki, Isao Furusawa
  • Patent number: 8194135
    Abstract: A system and method for rendering unobstructed views in a gaming environment are provided. The system includes a memory for storing a camera navigation/control model, a central processing unit for executing the camera navigation/control model to provide unobstructed and non-disorienting target character views, and a graphics processing unit configured to render the unobstructed views of the target in an image for display. In addition, the camera navigation/control model includes an object detection model, line-of-sight restoration models to restore a line-of-sight view of an obstructed target, and a camera navigation path model. A line-of-sight restoration method is used to move the camera to provide an unobstructed view of the target.
    Type: Grant
    Filed: September 24, 2008
    Date of Patent: June 5, 2012
    Assignee: Sony Computer Entertainment America LLC
    Inventor: Gavin Michael James
  • Patent number: 8179435
    Abstract: A system which provides a driver with an image obtained by photographing an area around a vehicle, the system comprising: a photographing unit which photographs an area around the vehicle which is out of the driver's line of sight because of a structure of the vehicle; an image processing unit which processes an image of the area around the vehicle photographed by the photographing unit; and a display unit which displays the image processed by the image processing unit, wherein the image processing unit performs coordinate transformation for the image photographed by the photographing unit based on information of a point-of-sight position of the driver and information of a setting state of the display unit to display an image the same as a view of the outside of the vehicle as is directly seen from the point-of-sight position of the driver through a setting area of the display unit.
    Type: Grant
    Filed: September 14, 2006
    Date of Patent: May 15, 2012
    Assignee: Nissan Motor Co., Ltd.
    Inventors: Takeshi Akatsuka, Ken Oizumi
  • Patent number: 8174568
    Abstract: A system and method for efficiently locating in 3D an object of interest in a target scene using video information captured by a plurality of cameras. The system and method provide for multi-camera visual odometry wherein pose estimates are generated for each camera by all of the cameras in the multi-camera configuration. Furthermore, the system and method can locate and identify salient landmarks in the target scene using any of the cameras in the multi-camera configuration and compare the identified landmark against a database of previously identified landmarks. In addition, the system and method provide for the integration of video-based pose estimations with position measurement data captured by one or more secondary measurement sensors, such as, for example, Inertial Measurement Units (IMUs) and Global Positioning System (GPS) units.
    Type: Grant
    Filed: December 3, 2007
    Date of Patent: May 8, 2012
    Assignee: SRI International
    Inventors: Supun Samarasekera, Rakesh Kumar, Taragay Oskiper, Zhiwei Zhu, Oleg Naroditsky, Harpreet Sawhney
  • Patent number: 8175340
    Abstract: A map information display apparatus for displaying map information on the basis of information on image-capturing times and image-capturing positions that are respectively associated with a plurality of captured images includes a captured image extraction unit configured to extract images captured within a predetermined time period that includes the image-capturing time of a predetermined captured image from among the plurality of captured images; a map area selection unit configured to select an area of a map so as to include the image-capturing positions of the captured images extracted by the captured image extraction unit by using as a reference the image-capturing position of the predetermined captured image; and a map information display unit configured to display map information in such a manner that the area of the map, which is selected by the map area selection unit, is displayed.
    Type: Grant
    Filed: July 24, 2008
    Date of Patent: May 8, 2012
    Assignee: Sony Corporation
    Inventor: Masanao Tsutsui
  • Patent number: 8135175
    Abstract: An image processing system and the like capable of accurately recognizing lane edges defined by dotted lane marks are provided. According to an image processing system (100) of the present invention, a first processing unit (110) searches a road surface image captured by a vehicle-mounted camera for a “small area,” which is composed of high- or low-luminance pixels and satisfies “eligibility conditions” on the “size,” “shape,” and “arrangement” in the road surface image. Additionally, a second processing unit (120) recognizes “lane edges” of the lane along which the vehicle travels on the basis of the “small area.” Furthermore, a third processing unit (130) sets a “search range” of the small area searched by the first processing unit (110) on the basis of a result of the foregoing recognition of the lane edges by the second processing unit (120).
    Type: Grant
    Filed: May 22, 2006
    Date of Patent: March 13, 2012
    Assignee: Honda Motor Co., Ltd.
    Inventors: Tomoyoshi Aoki, Sachio Kobayashi, Naoki Mori, Takuma Nakamori
  • Patent number: 8120652
    Abstract: A system for automatically controlling vehicle equipment includes a controller to generate control signals. The control signals are derived based on information obtained from the image sensor as well as other detected parameters pertaining to the detected light source(s), the vehicle having the inventive control system, and the ambient environment. The control circuit may simply turn certain vehicle equipment, for example exterior lights, on or off, or change the brightness, aim, focus, etc. to produce various beam patterns that maximize the illuminated area in front of the vehicle without causing excessive glare in the eyes of other drivers.
    Type: Grant
    Filed: September 16, 2008
    Date of Patent: February 21, 2012
    Assignee: Gentex Corporation
    Inventors: Jon H Bechtel, Joseph S Stam
  • Patent number: 8120645
    Abstract: An adjuster plate is provided between a front rail and a camera unit body having cameras. Pre-dimensioned positioning pins protrude from upper and lower surfaces of the adjuster plate. The positioning pins protruding from the upper surface of the adjuster plate are positioned by being fitted in pin fitting holes provided in the front rail. The positioning pins protruding from the lower surface of the adjuster plate are positioned by being fitted in pin fitting holes provided in the camera unit body. Even when the positions of the pin fitting holes in the front rail are changed, it is possible to cope with the change by only changing the protruding positions of the positioning pins.
    Type: Grant
    Filed: April 17, 2009
    Date of Patent: February 21, 2012
    Assignee: Fuji Jukogyo Kabushiki Kaisha
    Inventors: Satoshi Katahira, Nobuo Namiki
  • Patent number: 8107684
    Abstract: The subject of the invention is a method for geolocalization of one or more stationary targets from an aircraft by means of a passive optronic sensor. The sensor acquires at least one image I1 containing the target P from a position C1 of the aircraft and an image I2 containing the target P from a position C2 of the aircraft. The images I1 and I2 have an area of overlap. The overlap area has at least one target P identified which is common to the two images I1 and I2. The position of each target P is determined in each of the two images. The distance d is calculated between each target P and a point C, situated for example in the vicinity of C1 and C2, as a function of the angle ?1 between a reference direction and the line of sight of the image I1, the angle ?2 between the same reference direction and the line of sight of the image I2, of the position of each target P in the image I1 and in the image I2.
    Type: Grant
    Filed: February 7, 2007
    Date of Patent: January 31, 2012
    Assignee: Thales
    Inventors: Gilles Bridenne, Michel Prenat
  • Patent number: 8102421
    Abstract: An image processing device determines, cuts and extracts a processing area from an image data monitored by a camera mounted onto a driver's vehicle based on a distance between a front target object and a driver's vehicle, a horizontal position of the driver's vehicle, and a strength of a radar wave transmitted from a radar device and then reflected by objects in front of the driver's vehicle. The radar device is mounted to the driver's vehicle and transmits the radar wave to the front area of the driver's vehicle. The image processing device extracts vertical edges and horizontal edges from the image data in the processing area, and subtracts the horizontal edge values from the vertical edge values, and finally detects whether or not the front target object is a three-dimensional object based on the calculated result of the subtraction of the edges.
    Type: Grant
    Filed: April 14, 2009
    Date of Patent: January 24, 2012
    Assignee: Denso Corporation
    Inventor: Kenta Hoki
  • Patent number: 8102420
    Abstract: Taught is a portable digital photographing system combining position navigation information and image information, wherein the position navigation information and the captured image information is combined and processed by a digital signal processing unit. The combined information then is stored in a register and displayed through an interface circuit. The portable digital photographing system can merge the location, time, and position information into the image or video. In addition, an electronic map corresponding to a position navigation information can be displayed on a display monitor.
    Type: Grant
    Filed: March 24, 2008
    Date of Patent: January 24, 2012
    Inventors: Yuejun Yan, Yuepeng Yan
  • Patent number: 8098889
    Abstract: A method for vehicle detection and tracking includes acquiring video data including a plurality of frames, comparing a first frame of the acquired video data against a set of one or more vehicle detectors to form vehicle hypotheses, pruning and verifying the vehicle hypotheses using a set of course-to-fine constraints to detect a vehicle, and tracking the detected vehicle within one or more subsequent frames of the acquired video data by fusing shape template matching with one or more vehicle detectors.
    Type: Grant
    Filed: January 15, 2008
    Date of Patent: January 17, 2012
    Assignees: Siemens Corporation, Continental Automotive GmbH
    Inventors: Ying Zhu, Gregory Baratoff, Thorsten Köhler
  • Patent number: 8094937
    Abstract: A system and method for labeling feature clusters in frames of image data for optical navigation uses distances between feature clusters in a current frame of image data and feature clusters in a previous frame of image data to label the feature clusters in the current frame of image data using identifiers associated with the feature cluster in the previous frame of image data that have been correlated with the feature clusters in the current frame of image data.
    Type: Grant
    Filed: April 17, 2007
    Date of Patent: January 10, 2012
    Assignee: Avago Technologies ECBU IP (Singapore) Pte. Ltd.
    Inventors: Edward Kah Ching Teoh, Zi Hao Tan
  • Patent number: 8094188
    Abstract: A present novel and non-trivial system, apparatus, and method for enhancing an image presented to the pilot on an aircraft display unit. Locations of visible and invisible objects related to aviation such as airports, navigation aids and facilities, and airspace are enhanced by providing location highlighters of the objects. Data representative of the terrain and location of objects located in a scene outside the aircraft are retrieved from one or more data sources. An image generating processor generates an image data set representative of a three-dimensional perspective of a scene outside the aircraft, wherein the image data set is determined as a function of the terrain data and highlighter data associated with the location data. The image data set may be provided to a Head-Down Display unit, Head-Up Display unit, or both for display.
    Type: Grant
    Filed: April 1, 2008
    Date of Patent: January 10, 2012
    Assignee: Rockwell Collins, Inc.
    Inventors: Roger L. Yum, Travis S. VanDerKamp, David A. Frank
  • Patent number: RE44115
    Abstract: An apparatus for taking an electronic message from a user and actively notifying a receiver is disclosed. The apparatus includes a message input device for receiving the electronic message from the user, a message storing device for storing the electronic message therein, a message playing device for playing the electronic message, a vibration detector for detecting a certain level of vibration, a controller electrically connected to the message input device, the message storing device, the message playing device and the vibration detector, and a case accommodating the message input device, the message storing device, the message playing device, the vibration detector and the controller therein. The vibration detector sends out a trigger signal in response to the vibration, and the controller allows the electronic message to be read out from the message storing device and played by the message playing device in response to the trigger signal.
    Type: Grant
    Filed: November 1, 2007
    Date of Patent: April 2, 2013
    Assignee: Transpacific Plasma, LLC
    Inventor: Yu-Chieh Lin