Abstract: A system and method synthesizing images of a locale to generate a composite image that provide a panoramic view of the locale. A video camera moves along a street recording images of objects along the street. A GPS receiver and inertial navigation system provide the position of the camera as the images are being recorded. The images are indexed with the position data. The composite image is created on a column-by-column basis by determining which of the acquired images contains the desired pixel column, extracting the pixels associated with the column, and stacking the columns side by side. The composite images are stored in an image database and associated with a street name and number range of the street being depicted in the image. The image database covers a substantial amount of a geographic area allowing a user to visually navigate the area from a user terminal.

Abstract: A method of recognizing a self location of an image acquisition device by acquiring an image of two or more reference objects is provided.

Abstract: A camera based positioner (CBP) for near-field measurement and a method therefor, and a near-field measurement system are provided. A measurement probe and an antenna under test (AUT) are automatically aligned to a position for near-field antenna measurement by recognizing a position and a rotation angle of the AUT based on an interval and an angle between neighboring laser sources represented in an image taken by emitting laser beams from at least two laser sources located with a predetermined interval and a predetermined angle.

Abstract: A method of calibrating a vehicular multi-camera system includes equipping a vehicle with a plurality of cameras wherein each camera of the plurality of cameras captures image data, equipping the vehicle with an image processor, inputting image data from each of the plurality of cameras to the image processor, the image processor processing input image data in order to calibrate the vehicular multi-camera system, and wherein calibration of the vehicular multi-camera system is achieved independently of a model of the real world.

Abstract: A positioning device comprising: a movement measurement unit that measures relative position variation; a positioning unit that enables measurement of positional information; and a control unit that starts continuous measurement of position variation by the movement measurement unit and measurement of positional information by the positioning unit at each predetermined timing for at least a specified position, and determines a position determination spot based on positional information of any of the at least two positions in a case that the difference between the amount of position variation and the amount of relative position variation is determined by the determining unit to be within a predetermined range, and calculates positional information of the specified position based on positional information of the position determination spot and information of position variation that has been continuously measured by the movement measurement unit.

Abstract: A stereo-image processing apparatus includes a stereo-image taking means configured to take a plurality of images from different viewpoints, a parallax detecting means configured to detect a parallax of a subject on the basis of the images taken by the stereo-image taking means, an object detecting means configured to detect objects on the basis of the parallax detected by the parallax detecting means and a parallax offset value, and a parallax-offset-value correcting means configured to correct the parallax offset value on the basis of a change in a parallax corresponding to an object whose size in real space does not change with time, of the objects detected by the object detecting means, and a change in an apparent size of the object.

Abstract: A mobile terminal and method for automatic geotagging are disclosed. The mobile terminal includes a camera for capturing an image and for generating image data, a location information module for determining location information of the mobile terminal, and a controller configured to concurrently operate the camera and the location information module in response to a user input and to store the location information with the image data.

Abstract: A method and system for maintaining the line of sight of an airborne camera fixed on a target by compensating for overflight velocity of the aircraft. The compensation system automatically commands an angular velocity of the line of sight to maintain the camera pointing at the target being overflown. This angular velocity of the line of sight is computed based upon the aircraft overflight velocity and upon a vector from the aircraft to the target. This automatic compensation for aircraft overflight velocity causes the line of sight to remain fixed upon the target. The compensation system drives a gimbal system upon which the camera is mounted to perform this compensation automatically.

Abstract: Provided is an image processing apparatus comprising: an acquisition unit that acquires location information indicating a photographed point and date/time information indicating a photographed date/time for each of a plurality of images representing image data obtained by photographing; a determination unit that determines whether the photographed point of each image is a main photographed point or a sub-photographed point on the basis of the location information and the date/time information; and a recording unit that, if the photographed point of the image is the main photographed point, records information indicating the location of the main photographed point in association with the image data of the image, and that, if the photographed point of the image is the sub-photographed point, records information indicating the locations of the sub-photographed point and of the main photographed point in association with the image data of the image.

Abstract: A method of creating an obstacle-free diagram using topological sensor data to form a graph corresponding to a driving path, transforming the graph using discrete heuristics, locally smoothing a plurality of edges of the graph after the transforming, and globally smoothing the graph after the locally smoothing. Transforming includes deleting an edge of the graph, merging two intersections of the graph into a single intersection, and collapsing a plurality of edges forming a loop into a single edge. Locally smoothing includes smoothing a lane segment of the graph by minimizing a sum of a function of smoothness and a function of distance. Globally smoothing includes defining an intersection potential and minimizing a sum of the function of smoothness, the function of distance, a function of intersections and a function of direction.

Abstract: A present novel and non-trivial system, apparatus, and method for generating HUD image data from synthetic image data is disclosed. Based on a multi-channel pixel intensity data set generated by a synthetic vision system, a single-channel pixel intensity data set representative of a lighted solid image of terrain comprised of a plurality of intensities of one color may be generated. The single-channel pixel intensity image data set may be determined as a function of multi-channel pixel intensity data set and channel weighting, where channel weighting may be based on sky and/or terrain colors employed by an SVS. Based on the multi-channel pixel intensity data set, a three-dimensional perspective scene outside the aircraft may be presented to the pilot on a HUD combiner. Also, the multi-channel pixel intensity data set may be modified by using at least one chroma key, where such chroma key may be assigned to a specific multi-channel pixel intensity value.

Abstract: A mobile terminal (200) obtains image data related to a product posted on a flier (300) by imaging and sends the image data related to the product to a shopping management server (100). Upon reception of the image data related to the product from the mobile terminal (200), the shopping management server (100) determines the product by analyzing the image data related to the product, obtains at least one of inventory information and sales information of the product, and sends at least one of the inventory information and the sales information of the product to the mobile terminal (200). The mobile terminal (200) combines computer-graphics image data indicating at least one of the inventory information and the sales information of the product sent from the shopping management server (100) with an image of the flier in real space and presents the combined image, thereby solving the problem.

Abstract: A display system of the present invention includes a liquid crystal platform section (200) which outputs display data for displaying, on a liquid crystal display section (100), an image in accordance with information obtained from an automobile. The liquid crystal platform section (200) includes a DIC (201) which generates display data and calculates a display position of the image to be displayed on the liquid crystal display section (100) from the obtained information and which causes the generated display data to be displayed in the calculated image display position. The DIC (201) updates display so that the image moves at frame intervals from a start position of image display to the image display position calculated from the automobile information currently obtained, when an interval at which the information is obtained is longer than each of the frame intervals for displaying the image.

Abstract: A system for providing location information of a vehicle includes a communications interface and a correlation logic that correlates location information of a communications device to location of the vehicle. The communications interface communicates electronic signals including: a first signal including data representing a request for the location of the vehicle, a second signal transmitted to a location information provider corresponding to a party or device other than the communications device including data representing a request for location information of the communications device, a third signal received from the location information provider corresponding to the party or device other than the communications device including data representing the location information of the communications device, and a fourth signal including data representing the location of the vehicle.

Abstract: Systems and methods for detecting a present location of a target from a moving platform are provided. One system includes a movement module for estimating the present location of the target, a prediction module for estimating future locations of the target, and a first processor. The first processor is configured to receive present location estimates, receive future location estimates, store the future location estimates to create a first future location estimate, and determine the present location of the target based on the present location estimate and/or the first future location estimate. One method includes receiving an estimate of the present location of the moving platform, receiving an estimate of a future location of the moving platform, and determining the present location of the target based on the estimate of the present location and/or the estimate of the future location.

Abstract: A camera for identifying soiling on a protective screen, such as a vehicle windscreen, is focused on a scene through the protective screen and can be used to identify soiling and for other applications, e.g. to identify driving lanes and/or objects in the scene. Soiling is identified merely by evaluating successively recorded image frames, and artificial reference frames or reference objects are not required. A prerequisite is that the relative speed vrel between the camera and at least one recorded object in the scene is not equal to zero and its trajectory in the image is predicted. By comparing the relevant image frame sections, possible soiling on subregions of the protective screen is identified.

Abstract: The present invention discloses a dynamic calibration method for a single and multiple video capture devices. The present invention can acquire the variations of the pan angle and tilt angle of a single video capture device according to the displacement of the feature points between successive images. For a plurality of video capture devices, the present invention includes the epipolar-plane constraint between a plurality of video capture devices to achieve the goal of dynamical calibration. The calibration method in the present invention does not require specific calibration patterns or complicated correspondence of feature points, and can be applied to surveillance systems with wide-range coverage.

Abstract: A method is described for generating a navigation chart. The navigation chart includes a plurality of allocated areas corresponding to symbols for a plurality of chart features. The method includes identifying an unallocated area of the navigation chart proximate to a symbol for one chart feature of the plurality of chart features. A first label and a second label are determined for the one chart feature. The first label includes a plurality of feature attribute indicators, and the second label includes a subset of the plurality of feature attribute indicators. A label is selected from among the first label and the second label based on dimensions of the unallocated area. At least a portion of the unallocated area is allocated to the selected label, and the navigation chart is displayed.

Abstract: A method for constructing a georeferencing-enabled camera model and its deployment in georeferencing targets located in video sequences due to a single video camera. A video surveillance camera is modeled by a collection of rays converging at a virtual camera point and the retina resolution cell coordinates associated with those rays wherein the ray equations are first established, in the course of a calibration process, for a given camera view, with the aid of other views of the same video surveillance camera, as necessary, and using such a model for mapping image coordinates to terrain coordinates and vice versa in the intended view or its adaptation for use in other views of the same video surveillance camera.

Abstract: A location and orientation in an environment is determined by first acquiring a real omni-directional image of an unknown skyline in the environment. A set of virtual omni-directional images of known skylines are synthesized from a 3D model of the environment, wherein each virtual omni-directional image is associated with a known location and orientation. The real omni-directional image with each virtual omni-directional images to determine a best matching virtual omni-directional image with the associated known location and orientation.

Abstract: In one aspect, the present disclosure relates to a method of detecting information transmitted by a light source in a complementary metal-oxide-semiconductor (CMOS) image sensor by detecting a frequency of light pulses produced by the light source. In some embodiments, the method includes capturing on the CMOS image sensor with a rolling shutter an image in which different portions of the CMOS image sensor are exposed at different points in time; detecting visible distortions that include alternating stripes in the image; measuring a width of the alternating stripes present in the image; and selecting a symbol based on the width of the alternating stripes present in the image to recover information encoded in the frequency of light pulses produced by the light source captured in the image.

Abstract: An apparatus and method to enhance dead-reckoning navigation using inertial sensor measurements based on images from a camera are disclosed. A camera build into a mobile device is used to calibrate inertial sensors and rotation matrices. Images from a camera may be used (1) to remove a gravitational element from accelerometer measurements; (2) to set a scaling factor and an offset for a gyrometer; and (3) to set initial and updated values for rotation matrices.

Abstract: An on-vehicle camera calibration apparatus includes: an on-vehicle camera; a camera parameter calculation unit configured to calculate camera parameters from a characteristic amount of a road surface sign photographed by the on-vehicle camera and recognized by an image processing and to output the camera parameters, wherein the camera parameters include an installation height and installation angle of the on-vehicle camera in photographing; and a camera parameter calibration unit configured to perform optical axis calibration control of the on-vehicle camera by the camera parameters output from the camera parameter calculation unit.

Abstract: A system and method for rendering unobstructed views in a gaming environment are provided. The system includes a memory for storing a camera navigation/control model, a central processing unit for executing the camera navigation/control model to provide unobstructed and non-disorienting target character views, and a graphics processing unit configured to render the unobstructed views of the target in an image for display. In addition, the camera navigation/control model includes an object detection model, line-of-sight restoration models to restore a line-of-sight view of an obstructed target, and a camera navigation path model. A line-of-sight restoration method is used to move the camera to provide an unobstructed view of the target.

Abstract: A system and method for efficiently locating in 3D an object of interest in a target scene using video information captured by a plurality of cameras. The system and method provide for multi-camera visual odometry wherein pose estimates are generated for each camera by all of the cameras in the multi-camera configuration. Furthermore, the system and method can locate and identify salient landmarks in the target scene using any of the cameras in the multi-camera configuration and compare the identified landmark against a database of previously identified landmarks. In addition, the system and method provide for the integration of video-based pose estimations with position measurement data captured by one or more secondary measurement sensors, such as, for example, Inertial Measurement Units (IMUs) and Global Positioning System (GPS) units.

Abstract: An image processing system and the like capable of accurately recognizing lane edges defined by dotted lane marks are provided. According to an image processing system (100) of the present invention, a first processing unit (110) searches a road surface image captured by a vehicle-mounted camera for a “small area,” which is composed of high- or low-luminance pixels and satisfies “eligibility conditions” on the “size,” “shape,” and “arrangement” in the road surface image. Additionally, a second processing unit (120) recognizes “lane edges” of the lane along which the vehicle travels on the basis of the “small area.” Furthermore, a third processing unit (130) sets a “search range” of the small area searched by the first processing unit (110) on the basis of a result of the foregoing recognition of the lane edges by the second processing unit (120).

Abstract: A data input device which inputs data to a navigation device includes: an image input unit capturing an image displayed on an image display carrier for displaying an image; a code extraction unit extracting a code hidden in the image; and a transmission unit transmitting the code to the navigation device.

Abstract: Vehicles, such as vehicles in an open-pit mine, are visually tracked. The location of a vehicle is determined using radio frequency signals, such as pseudolite transmissions of ranging signals. The camera is steered based on the location. For example, multiple cameras are directed automatically on a vehicle based on the vehicle position. Images from a plurality of perspectives are provided to resolve or prevent a problem. The directing may include zooming for better viewing of vehicles at different distances from the camera. The directing may be incorporated into a vehicle management system, such as a dispatch system. For example, a user selects a vehicle from a list of managed vehicles or a displayed map, and the cameras are steered to view the selected vehicle based on the position of the vehicle.

Abstract: An image receiving unit receives an image captured by a capturing device at a capturing interval of the predetermined distance. A movement direction acquiring unit acquires a movement direction of the vehicle based on calibration information acquired in advance and the image information. A database generating unit determines whether capturing position information of the image information and setting points of spatial codes are matched with each other. When they are matched with each other, the database generating unit associates the image information and the spatial codes with each other. When they are not matched with each other, a capturing position allocating unit executes a process of allocating the image information between the setting points of the spatial codes, and the database generating unit associates the allocated image information with a position between the spatial codes.

Abstract: Camera installation flexibility on a moving object can be increased and accuracy in identifying the moving object improved by identifying a moving object origin trajectory as a potential position at which the moving object origin exists under the following conditions: 1) A distance between the moving object origin position and a reference virtual camera is constant. 2) A direction of virtual camera VCij as viewed from the moving object coordinate system (moving object origin Om) is constant (angle formed by two lines that direct to marker Pj and to the moving object origin position Cij as viewed from the virtual camera VCij is constant.) 3) Virtual camera VCij exists on marker circle (angle between markers Pi and Pj as viewed from virtual camera VCij is constant). It is possible to identify the position of moving object M by calculating the intersecting point of each moving object origin trajectory T upon multiple trajectories of moving object origin existing.

Abstract: Embodiments of the invention are directed to obtaining information based on directional orientation of a mobile imaging device, such as a camera phone. Visual information is gathered by the camera and used to determine a directional orientation of the camera, to search for content based on the direction, to manipulate 3D virtual images of a surrounding area, and to otherwise use the directional information. Direction and motion can be determined by analyzing a sequence of images. Distance from a current location, inputted search parameters, and other criteria can be used to expand or filter content that is tagged with such criteria. Search results with distance indicators can be overlaid on a map or a camera feed. Various content can be displayed for a current direction, or desired content, such as a business location, can be displayed only when the camera is oriented toward the desired content.

Abstract: A method for vehicle detection and tracking includes acquiring video data including a plurality of frames, comparing a first frame of the acquired video data against a set of one or more vehicle detectors to form vehicle hypotheses, pruning and verifying the vehicle hypotheses using a set of course-to-fine constraints to detect a vehicle, and tracking the detected vehicle within one or more subsequent frames of the acquired video data by fusing shape template matching with one or more vehicle detectors.

Abstract: Apparatus for detecting airfield light emitters, the apparatus including a plurality of light detection cameras, each detecting at least one respective waveband of electromagnetic radiation within the electromagnetic spectrum, each of the light detection cameras producing a plurality of respective spectral images, and a processor coupled with the light detection cameras, thereby generating a multispectral image of the airfield light emitters from the spectral images, the multispectral image including a multi-dimensional set of spectral values, wherein the processor further determines which combination the multi-dimensional set of spectral values corresponds with a plurality of distinct light emission characteristics of the airfield light emitters by identifying a particular spectral signature corresponding to the multi-dimensional set of spectral values, wherein the processor produces an enhanced image from those spectral values of the multi-dimensional set of spectral values which correspond to the determine

Abstract: A system and method for labeling feature clusters in frames of image data for optical navigation uses distances between feature clusters in a current frame of image data and feature clusters in a previous frame of image data to label the feature clusters in the current frame of image data using identifiers associated with the feature cluster in the previous frame of image data that have been correlated with the feature clusters in the current frame of image data.

Abstract: A driving support device, a driving support method, and a computer program provide an image of the peripheral environment of a vehicle which is captured by a camera. The traveling state of the vehicle is obtained and, based on same, a blind spot region for a driver created by a right front pillar, as it would appear after a predetermined period of time, is calculated by taking into consideration the time lag between capture of an image by the camera and projection of that image by a projector. An image corresponding to the calculated blind spot region is extracted from the image captured by the camera, and the extracted image is projected onto the inside surface of the right front pillar.

Abstract: A camera control device capable of easily performing control even if more than one camera is provided. A common operation section performs a map operation and a camera operation with the same operation device. An operation management section switches between the map operation and the camera operation depending on the scale (display magnification) of a map and the imaging magnification of a camera to be operated. To perform the map operation, the operation management section sends an operation signal to a map control section, and to perform the camera operation, it sends an operation signal to a camera control section.

Abstract: A system and method for mitigating the effects of Doppler shift, multipath and/or noise for a mobile receiver, such as on a vehicle, that is receiving broadcast television signals. The vehicle may include a map database and a GPS receiver that combine to identify the location of the vehicle on the roadway. The receiver on the vehicle includes a rotatable antenna that can be either mechanically or electronically directed towards a broadcast tower that is broadcasting the signal that the vehicle wishes to receive. Therefore, multipath effects and other noise conditions can be mitigated or eliminated by more precisely directing the antenna towards the source of a signal. Further, the receiver on the vehicle can use the forward velocity of the vehicle and the direction of the broadcasting tower to determine the movement of the vehicle relative to the tower to correct for the Doppler shift.

Abstract: An apparatus that determines the presence of an element such as fog interfering with the visibility of a frontal view of an driver in an vehicle in an environmental atmosphere in ahead of the vehicle equipped with the apparatus in the daytime is provided. In this apparatus, the determination of whether the presence of the element is determined based on an image that captured by a vehicle-mounted camera and in which a picture of an obstacle located on a road over which the vehicle is traveling is masked. In the determination, a reliability of determining the presence of the element is considered by measuring the effect of masking the obstacle.

Abstract: A method that relates to mobile platform positioning through landmark recognition. The method includes receiving a captured image of a landmark, wherein the captured image was captured from an onboard camera system located on the mobile platform. A comparison of the captured image to a plurality of stored images, that are images of landmarks at known locations is made. The method recognizes the captured image based on the comparison and then determines the location of the mobile platform, based on the recognition. The method may be employed with a locomotive. A system and computer program product for mobile device positioning is also disclosed.

Abstract: To accurately extract embedded information from a document image using line spacing watermark, an image processing apparatus for extracting watermark information includes an input unit which inputs a document image as image data, an image reduction unit which generates, from the image data, reduced image data reduced in the first direction, a detection unit which scans the reduced image data in the second direction and detects the length of a blank region as line spacing information, and an extraction unit which extracts watermark information embedded in the document image based on the line spacing information.

Abstract: A computer-implemented method for generating geocoded user information is disclosed. The method comprises searching user data across multiple different data corpuses for entries having location-related information and determining locations for the location-related information. The method further comprises generating a map showing a current location of a mobile device along with representations of the entries having location-related information, at the determined locations, for entries from the multiple different data corpuses.

Abstract: A road shape recognition device checks a position of a currently travelling vehicle detected by a position detection device with map information so that a road shape at each travelling spot of the currently travelling vehicle is recognized. An image division device divides a display screen of surrounding image data of the currently travelling vehicle into a plurality of divided regions depending on the road shape and sets a data compression rate suitable for the road shape in each of the plurality of divided regions. An image compression device compresses the surrounding image data in each of the plurality of divided regions into codes based on the data compression rate set for each of the divided regions.

Abstract: An image processing system inputs a captured image of a scene viewed from a vehicle, extracts image feature points from the captured image, and obtains image-capturing situation information indicating a possibility that a specific subject is included in the captured image. The system determines importance degrees of the extracted image feature points based on the image-capturing situation information and generates image feature point data using the extracted image feature points based on the importance degrees. The system generates reference data by associating the image feature point data with image-capturing attribute information and creates a reference data database. The image-capturing attribute information includes an image-capturing position at which the image is captured to obtain the captured image corresponding to the image feature point data.

Abstract: In an image-capturing apparatus, recorded position information is stored upon receiving instruction of storing the recorded position information, and real-time position information is stored upon a photograph is taken, which is stored together with a captured-image. The image-capturing apparatus executes mode changeover from a recorded position information use mode to a real-time position information use mode when a timing of the mode changeover matches a mode change condition.

Abstract: An automatic control system for directional control of an aircraft moving on the ground utilizing computer vision methods and camera sensing methods (visible, infrared or microwave) to optically recognize and track taxiway navigation features thereby providing pilot television picture steering cues or force inputs to the nosewheel steering system to maintain the aircraft on the centerline.

Abstract: An information reproducing apparatus includes a display unit and processing unit. The information reproducing apparatus has a position determining device configured to determine the position and alignment of the apparatus and to supply a first signal representing the position and a second signal representing the alignment to the processing unit. The processing unit retrieves information on objects from a database and processes the information. The database includes a plurality of information on objects of locations within a predefined spatial environment. The processing unit determines information for the current alignment of the apparatus on objects in the direction of the alignment of the apparatus and the display unit displays the information.

Abstract: A user points a handheld communication device to capture and display a real-time video stream. The handheld communication device detects geographic position, camera direction, and tilt of the image capture device. The user sends a search request to a server for nearby points of interest. The handheld communication device receives search results based on the search request, geographic position, camera direction, and tilt of the handheld communication device. The handheld communication device visually augments the captured video stream with data related to each point of interest. The user then selects a point of interest to visit. The handheld communication device visually augments the captured video stream with a directional map to a selected point of interest in response to the user input.

Abstract: The state of a vehicle rear portion such as the state of a rear seat or the like and the state of a vehicle rear side are allowed to be easily grasped at a driver's seat, and also the state of a vehicle front side is allowed to be easily grasped at a rear seat. An in-vehicle display device 10 is equipped with a camera 13, plural monitors 12, 21, an image pickup direction detector 24 for detecting the image pickup direction of the camera 13 and outputting an image pickup direction signal, and a controller 22 for selecting any one of plural monitors 12, 21 on the basis of the image pickup direction signal, and displaying the pickup image of the camera 13 on the selected monitor.

Abstract: A camera includes a feature that associates meaningful information with a photograph to indicate where the photograph was taken. The camera includes equipment that determines a physical position associated with an image. An application uses geographic data to determine a municipality, or other administrative or governmental area, in which the physical position is located and associates data indicating the municipality, or other administrative or governmental area, with the image.

Abstract: An imaging system (5) for generating landmark correlated images taken from a railroad locomotive includes a camera (142) mounted on the locomotive (22) for imaging an environment in a vicinity of the locomotive and transmitting imaging data indicative of images acquired. The system also includes a location sensor (20) on-board the locomotive generating signals indicative of a geographic location of the locomotive constituting location data. The system also includes a railroad landmark database (68) comprising a plurality of railroad landmarks (76) associated with respective geographic locations constituting landmark tags. The system also includes a processor (e.g., 10) receiving the imaging data and location data and communicating with the railroad landmark database to correlate the landmark tags with the imaging data and the location data for generating landmark correlated image data. The system may also include a computer system (86) for accessing the landmark correlated image data by landmark location.