Abstract: Systems and methods monitor driver behavior for vehicular fleet management in a fleet of vehicles using driver-facing imaging device. The systems and methods herein relate generally to vehicular fleet management for enhancing safety of the fleet and improving the performance of the fleet drivers, and further relate to monitoring the operation of fleet vehicles using one or more driver-facing imaging devices disposed in the fleet vehicles for recording activities of the fleet drivers and their passengers, storing information relating to the monitored activities, selectively generating warnings related to the monitored activities, and reporting the monitored activities to a central fleet management system for use in enhancing the safety of the vehicles of the fleet and for helping to improve the performance of the fleet drivers.

Abstract: A system, comprising a computer that includes a processor and a memory, the memory storing instructions executable by the processor to detect and locate an object by processing video camera data with a capsule network, wherein training the capsule network includes determining routing coefficients with a scale-invariant normalization function. The computer can be further programmed to receive the detected and located object.

Abstract: A vehicle periphery display device includes: an acquisition portion acquiring a captured image obtained by imaging a periphery of a vehicle with an imaging portion; and a display processing portion causing a display image that is a stereoscopic image of the vehicle and the periphery of the vehicle to be displayed on a display portion on the basis of the captured image. The display processing portion causes at least one of a contour guide line representing a contour of the vehicle, and a predicted course guide line that is a trajectory drawn by the contour guide line according to movement of the vehicle to be included in the display image, and changes a position of at least one of the contour guide and predicted course guide lines such that the contour guide and predicted course guide lines are present above a road surface when the vehicle is turned.

Abstract: A system, method and computer program product are provided for classifying at least one speed sign associated with a region. In an example embodiment, the method may include obtaining sensor data comprising speed limit data associated with the at least one speed sign. The method may further include obtaining map data associated with a segment of the region, wherein the map data comprises conditional speed limit data associated with a conditional speed limit sign linked with the segment. The method may further include comparing the speed limit data with the conditional speed limit data and classifying the at least one speed sign as one of a conditional speed sign or a non-conditional speed sign based on the comparison.

Abstract: Among other things, one or more travel signals are identified by analyzing one or more images and data from sensors, classifying candidate travel signals into zero, one or more true and relevant travel signals, and estimating a signal state of the classified travel signals.

Abstract: Localization apparatuses and methods are disclosed where a localization apparatus extracts a feature of an object from an input image, generates an image in which the object is projected with respect to localization information of a device based on map data, and evaluates the localization information based on feature values corresponding to vertices included in a projection image.

Abstract: A vehicle localization method and a vehicle localization apparatus are disclosed. The vehicle localization method includes estimating an initial position of a vehicle based on data sensed by a position sensor, determining a driving lane of the vehicle based on a front-view image captured from the vehicle, correcting the initial position of the vehicle based on the driving lane, and determining a position of the vehicle in the driving lane based on geometry information of a lane boundary in the front-view image.

Abstract: A system is described for automatically calibrating a display device based at least on information relating to a user of the display device. The system obtains visual acuity information or pupillary information of the user. The system then determines a value of a display parameter of the display device based at least on the visual acuity information or the pupillary information of the user. The determined value is then provided for application to the display device. Other information may also be used in determining the value of the display parameter, such as user input, demographic information of the user, display device specific information, user environment information, displayed content information, or application context information. An algorithm may be used that determines the display parameter based on such information. The algorithm may comprise a model obtained through machine learning.

Abstract: A gesture identification method includes: performing gesture information detection on an image by means of a neural network, to obtain a potential hand region, a potential gesture category and a potential gesture category probability in the image, the potential gesture category including a gesture-free category and at least one gesture category; and if the obtained potential gesture category with the maximum probability is the gesture-free category, not outputting position information of the potential hand region of the image; or otherwise, outputting the position information of the potential hand region of the image and the obtained potential gesture category with the maximum probability.

Abstract: An autonomous system for generating and interpreting point clouds of a rail corridor along a survey path while moving on a railroad corridor assessment platform. The system includes two rear-facing LiDAR sensors configured to scan along scan planes that intersect but not at all points. The system also includes a plurality of high-resolution cameras for gathering image data from a rail corridor. The LiDAR sensors and the high-resolution cameras are housed in autonomously controlled and temperature controlled protective enclosures.

Abstract: In various examples, a deep neural network (DNN) is trained—using image data alone—to accurately predict distances to objects, obstacles, and/or a detected free-space boundary. The DNN may be trained with ground truth data that is generated using sensor data representative of motion of an ego-vehicle and/or sensor data from any number of depth predicting sensors—such as, without limitation, RADAR sensors, LIDAR sensors, and/or SONAR sensors. The DNN may be trained using two or more loss functions each corresponding to a particular portion of the environment that depth is predicted for, such that—in deployment—more accurate depth estimates for objects, obstacles, and/or the detected free-space boundary are computed by the DNN. In some embodiments, a sampling algorithm may be used to sample depth values corresponding to an input resolution of the DNN from a predicted depth map of the DNN at an output resolution of the DNN.

Abstract: A lane recognition device includes: a camera configured to capture an image in front of a vehicle; and a controller configured to detect a lane from the image in front of the vehicle; generate a plurality of lane equations based on a curved point of the lane; and recognize the lane based on the plurality of lane equations.

Abstract: A pivotable interior rearview device for a motor vehicle includes a mirror surface provided by at least one of a reflective element and a display element, a first sensor device suitable for a light propagation time measurement for detecting at least one gesture by a driver of the motor vehicle incidence of light on the mirror surface, a switching device for switching the display element on and off, a pivoting device for pivoting the mirror surface from a normal position into at least one dimming position in which dazzling of the driver by light reflected in the mirror surface is reduced, and a control unit for controlling at least one of the switching device and the pivoting device. A method of using the rearview device is also described.

Abstract: A road marking determining apparatus includes an image capturing device configured to obtain image data of a road, a first neural network and a second neural network. The the first neural network is configured to extract features in the obtained image data, wherein the extracted features are associated with the road marking. Further, the first neural network is configured to provide the extracted features to the second neural network. Finally, the second neural network is configured to determine the road marking based on the extracted features provided by the first neural network.

Abstract: According to an embodiment, a captured image check system includes a camera, an image data input unit, a camera view angle judge processor, a road surface state analysis judge processor, and an output unit. The camera photographs a road surface. The image data input unit inputs image data to be used for analyzing a state of the road surface. The camera view angle judge processor performs a judge process of determining whether or not an angle of view of the camera satisfies a first condition for analyzing the state of the road surface on the basis of the image data. The road surface state analysis judge processor performs a judge process of determining whether or not a second condition for analyzing the state of the road surface is satisfied on the basis of image data of the road surface. The output unit outputs results of the judge processes.

Abstract: An automatic parking system includes a sensor system measuring whether there is a parking section line and positions of surrounding vehicles, and a controller configured to analyze data sensed by the sensor system to calculate parking areas around a subject vehicle, calculate a range allowing generation of a moving path based on the parking areas, provide a moving path range for a parking type that is selected among the moving path ranges provided for the at least two parking types, and an optimal parking area for the selected moving path range, and automatically park the subject vehicle in the optimal parking area.

Abstract: A method for detecting an event occurring during operation of a vehicle includes receiving indications of a plurality of variables from an installed device communicatively coupled to the mobile device via an internal communication link. The method further includes analyzing the received indications of the plurality of variables to detect the event occurring during the operation of the vehicle. Still further, the method includes, upon detecting the event, initiating: (i) a first communication session between the mobile device and an entity outside of the vehicle, and (ii) a second communication session between the mobile device and the installed device, wherein the mobile device forwards content communicated via the first communication session to the installed device via the second communication session such that the installed device presents the content to the vehicle operator. In one aspect, air pressure wave sensor and accelerometer data may trigger automatic crash notifications to emergency responders.

Abstract: Methods described herein relate to creating a visual map of an environment free of scene clutter. Methods may include: receiving sensor data from at least one image sensor, where the sensor data is representative of a plurality of images, each image representative of a scene at a scene location; processing each image using semantic scene segmentation to identify segments of the image of the scene; classifying the segments of each of the images of the scene into one of static elements or dynamic elements; generating a decluttered image of the scene, where the decluttered image includes only elements classified as static elements; providing for storage of the decluttered image of the scene in a database; and identifying a location of a device as the scene location in response to sensor data from the device corresponding to the decluttered image of the scene.

Abstract: Systems and techniques for autonomous vehicle decision making may include training an autonomous vehicle decision making database by capturing an image including a first training object and a second training object during a training phase. The first training object may be classified as a first class and the second training object may be classified as a second class based on a driver gaze location associated with a driver of the vehicle. The database may be built based on classification of the first training object and the second training object. The autonomous vehicle decision making database may be utilized to classify a first object as a first class and a second object as a second class during an operation phase. A processor may perform a first computation associated with the first object based on the classification of the first object and the classification of the second object.

Abstract: An adhered-substance detecting apparatus capable of detecting adhered substances such as water droplets, mud, and dust, including those with ambiguous outlines, which adhere to, for example, a lens for an imaging apparatus, and a vehicle system equipped with the adhered-substance detecting apparatus are provided.

Abstract: Methods and systems for providing fast semantic proposals for image and video annotation including: extracting image planes from an input image; linearizing each of the image planes to generate a one-dimensional array to extract an input feature vector per image pixel for the image planes; abstracting features for a region of interest using a modified echo state network model, wherein a reservoir increases feature dimensions per pixel location to multiple dimensions followed by feature reduction to one dimension per pixel location, wherein the echo state network model includes both spatial and temporal state factors for reservoir nodes associated with each pixel vector, and wherein the echo state network model outputs a probability image; post-processing the probability image to form a segmented binary image mask; and applying the segmented binary image mask to the input image to segment the region of interest and form a semantic proposal image.

Abstract: An image display apparatus has: a first imaging device (11B) for imaging an area on the rear of a vehicle (1); a second imaging device (11BL, 11BR) for imaging an area on the rear and side of the vehicle; a synthesizing device (12) for generating a synthesized image in which a first image captured by the first imaging device and a second image captured by the second imaging device are adjacent to each other and a vanishing point of the first image in the synthesized image is different from a vanishing point of the second image in the synthesized image; and a displaying device (13) for displaying the synthesized image.

Abstract: Systems, methods, tangible non-transitory computer-readable media, and devices for associating objects are provided. For example, the disclosed technology can receive sensor data associated with the detection of objects over time. An association dataset can be generated and can include information associated with object detections of the objects at a most recent time interval and object tracks of the objects at time intervals in the past. A subset of the association dataset including the object detections that satisfy some association subset criteria can be determined. Association scores for the object detections in the subset of the association dataset can be determined. Further, the object detections can be associated with the object tracks based on the association scores for each of the object detections in the subset of the association dataset that satisfy some association criteria.

Abstract: A vehicle lamp includes a light source, and an aberration correction lens unit, that corrects chromatic aberration, irradiates in a frontward direction with direct light from the light source. The aberration correction lens unit includes a first lens located in a front side of the light source, and a second lens located in front of the first lens. The aberration correction lens unit performs vibration control for vibrating intersections in a front-back direction. The intersections are intersections of an optical axis, and red, green, and blue components of white light incident in parallel from the front toward the outside in the radial direction from the optical axis side of the aberration correction lens unit.

Abstract: A modular imager assembly includes a housing configured for removable attachment to a vehicle windscreen and for removable attachment with a rearview assembly. An imager is disposed within the housing and is in optical communication with an aperture extending into the housing. A controller is disposed within the housing and is operably coupled with the imager and a vehicle headlamp. The controller is operable to control an operation state of the vehicle headlamp in response to image data received by the imager.

Abstract: A system and method for monitoring driving conditions and reacting to the driving conditions is disclosed. The system includes a risk monitoring system that can detect adverse road conditions. The method includes performing rerouting when hazardous road conditions are detected. The vehicle may be routed along a different route that lacks the hazardous road condition. The method also includes providing feedback to the driver when adverse driver behavior, such as a drowsy driver, is detected.

Abstract: An imager assembly including calibration functionality and a housing. An imager is disposed inside the housing. The imager includes a lens assembly. An electro-optic element is disposed on a wall of the housing and operable between a substantially clear condition and a substantially darkened condition. A light source directs light at the electro-optic element which redirects the light toward the lens assembly.

Abstract: The discloser relates to a method for evaluating an optical appearance in the surroundings of a vehicle and to a vehicle. The method has the steps of providing a captured image of the surroundings of a vehicle and extracting features from the captured image. Furthermore, the method comprises carrying out a first analysis of the captured image, wherein one or more objects are detected as surfaces and the result of the analysis is provided as a first analysis result. A second analysis of the captured image is also carried out, wherein edges of one or more objects are detected and the result of the analysis is provided as a second analysis result, the first analysis and the second analysis being carried out independently of each other. The method further comprises combining the first analysis result and the second analysis result to form an output image.

Abstract: An information processing apparatus according to one embodiment includes a memory having computer executable components stored therein; and processing circuitry communicatively coupled to the memory. The processing circuitry is configured to: acquire, for each of a plurality of sensors installed in a vehicle, positional information of an object present around the vehicle measured by the sensor; calculate a probability that the object is present for each of a plurality of areas obtained by dividing surroundings of the vehicle based on the positional information measured by the sensors; record non-measurement information indicating that the positional information was not obtained for an area corresponding to a direction in which the positional information was not obtained for each of the sensors; and determine a final probability that the object is present based on the probability calculated for each of the sensors and the non-measurement information.

Abstract: Embodiments of this disclosure provide a lane detection apparatus and method and an electronic device. First, preprocessing is performed based on semantic segmentation to remove interference objects in a binary image, which may improve accuracy of a lane line detection and may be applicable to various road scenarios, and the result based on semantic segmentation may automatically extract a lane line region image containing one or more lane lines, thereby automatically performing perspective transformation to perform search and fitting on the one or more lane lines, including achieving multi-lane detection. And furthermore, by synthesizing detection results of a plurality of input images, accuracy and integrity of the lane detection may further be improved.

Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.

Abstract: Systems and methods use cameras to provide autonomous navigation features. In one implementation, a driver-assist system is provided for a vehicle. The system may include one or more image capture devices configured to acquire images of an area forward of the vehicle. The system may also include at least one processing device configured to receive, via one or more data interfaces, the images. The at least one processing device may be further configured to analyze the images acquired by the one or more image capture devices and cause at least one navigational response in the vehicle based on monocular and/or stereo image analysis of the images.

Abstract: A method, apparatus and computer program product are provided to estimate the location of a vehicle based at least in part upon two or more road signs that are depicted by one or more images captured by one or more image capture devices onboard the vehicle. By relying at least in part upon the two or more road signs, the location of the vehicle may be refined or otherwise estimated with enhanced accuracy, such as in instances in which there is an inability to maintain a line-of-sight with the satellites of a satellite positioning system or otherwise in instances in which the location estimated based upon reliance on satellite or radio signals is considered insufficient. As a result, the vehicle may be navigated in a more informed and reliable manner and the relationship of the vehicle to other vehicles may be determined with greater confidence.

Abstract: The present disclosure provides a dense crowd counting method and an apparatus, including: acquiring an image to be detected, where the image to be detected includes images of people; feeding the image to be detected into a convolutional neural network model to obtain a crowd density map of the image to be detected; and determining the number of the images of people in the image to be detected according to the crowd density map. Feature information of an image to be detected may be fully extracted through the above mentioned process, thereby realizing a better performance of crowd counting and density estimation, providing great convenience for subsequent security monitoring, crowd control and other applications.

Abstract: The present invention relates to the field of dynamic content creation and management and more particularly to dynamically create and insert immersive promotional content in a multimedia. The multimedia requested by a user is procured from a media server (105) and the one or more objects present in the multimedia is determined. The content of the multimedia is analyzed, and a decision is taken to immerse the promotional content in the multimedia based on the analysis of the multimedia. Further, a promotional content is created in real time using the components present in the asset database (106) based on the personalized user profile. The created promotional content is overlaid and blended with a at least one object from the one or more objects in the multimedia. The created promotional content and the multimedia is joined to form a composite media and is streamed to the user device.

Abstract: A driver assistance system for a vehicle having a hitch includes a trailer detection system, a steering system, and a controller. The controller determines that a trailer is not coupled with the hitch and outputs a reverse hitching path control signal to the steering system and determines that the trailer is coupled with the hitch and outputs a trailer backing path control signal to the steering system.

Abstract: Embodiments of the present disclosure provide a method and an apparatus for recognizing a traffic light, a device, a storage medium, and a vehicle. The method may include: obtaining semantic information of one or more traffic lights provided at an intersection, and recognizing states of the one or more traffic lights in an image captured by a camera; determining traffic lights representing same semantics from the one or more traffic lights based on the semantic information, and determining a uniform state corresponding to the traffic lights representing the same semantics according to states of the traffic lights representing the same semantics and preset confidences of respective traffic light states; and determining indication information of the traffic lights representing the same semantics according to the uniform state.

Abstract: Personalized video interjections based on a learner model and a learning objective. A method for adding interjections to a video includes analyzing the content of a plurality of videos based on a set of learning objectives, selecting a video based on a learning objective, determining types of video interjections using an analytics engine that compares a learner model and the learning objective, determining a location for the video interjections using the analytics engine, generating a video interjection for each video interjection type and inserting the video interjections into the video at the determined locations.

Abstract: A method for obtaining road marking data and a device thereof are provided. The method includes steps of: obtaining coordinates of calibration references on a to-be-marked road; importing the coordinates of the calibration references into an electronic image of the to-be-marked road; determining, according to a difference between the coordinates of the calibration references and coordinates of to-be-calibrated points corresponding to the calibration references in a road image included in the electronic image, whether to perform a calibration on the coordinates of the to-be-calibrated points; and when the difference is greater than a threshold, performing the calibration on the coordinates of the to-be-calibrated points, and using calibrated coordinates of the to-be-calibrated points as road marking data. By applying the present disclosure, the accuracy of road marking data can be improved.

Abstract: A method of creating a local map includes: receiving, at a mobile electronic data processing apparatus, a request from a server to generate a map of a specified destination; sending to the server a message accepting the request to generate the map responsive to receiving, at a user input of the mobile electronic data processing device, a user command indicating acceptance of the request; generating, using a processor, information related to construction of the map; an transmitting, from the mobile electronic data processing apparatus, the information related to construction of the map.

Abstract: The invention relates to a method for supporting an advanced driver assistance system in a motor vehicle, comprising the following steps: providing a map, wherein categorized objects are stored in associated positions in the map, capturing environment data using at least one environment sensor system of the advanced driver assistance system, analyzing the captured environment data using an analysis apparatus of the advanced driver assistance system, wherein the captured environment data are analyzed for object recognition according to the categorized objects stored in the map. Furthermore, the invention relates to an associated device.

Abstract: A vehicle includes one or more travel portions each configured to travel along a rail track, a travel controller configured to perform an image recognition to determine a shape of a portion of the rail track based on an image captured by an imaging device supported by the vehicle and to control the one or more travel portions based on a result of the image recognition, an information obtaining portion configured to obtain position information of each of a plurality of locations that the vehicle travels past as a result of traveling along the rail track, and to obtain the order in which the vehicle travels past such plurality of locations, and memory configured to store information obtained by the information obtaining portion.

Abstract: A control device includes: a detection unit that detects a reference position indicating a position serving as a reference among passenger's predetermined portions based on a captured image captured by an imaging device that images an interior of a vehicle; and a control unit that is provided in the vehicle and performs control such that, during a closing operation of an openable and closable opening and closing member, the closing operation of the opening and closing member is interrupted, when a coordinate value of the reference position detected by the detection unit exceeds a threshold value.

Abstract: The present disclosure provides a method and an apparatus for determining road information, a vehicle and a computer readable storage medium. The method includes: triggering the camera to capture M images during driving, M being an integer not less than 2; performing three-dimensional reconstruction based on the M images to obtain a three-dimensional model; determining a first vector of the three-dimensional model, the first vector indicating a gravity direction in the three-dimensional model; and determining the road information of a road where the vehicle is located based on M spatial positions and the first vector, the M spatial positions being spatial positions of a center of the camera in the three-dimensional model at M time points and the M images are captured by the camera respectively at the M time points, the road information including a slope type and/or a slope value.

Abstract: A method and a device for improved training of a classifier. For this purpose, the device for detecting an object has a first image recording device, which is situated in a first position for recording the object from a first perspective. The device furthermore has a stored first classifier, which is configured to detect the object based on the recorded first perspective. At least one second image recording device is situated in a second position for recording the object from a second perspective, which differs from the first perspective. Furthermore, a data processing device is configured to detect the object recorded by the first image recording device based on the first classifier and to assign to the second perspective a class predetermined by the first classifier. This makes it possible to expand the existing classifier to include the detection of the object from different additional perspectives.

Abstract: A vehicle may include a primary system and a secondary system to validate operation of the primary system and to control the vehicle to avoid collisions. For example, the secondary system may receive multiple trajectories from the primary system, such as a primary trajectory and a secondary, contingent, trajectory associated with a deceleration or other maneuver. The secondary system may determine if a trajectory is associated with a potential collision, if the trajectory is consistent with a current or previous pose, if the trajectory is compatible with a capability of the vehicle, etc. The secondary system may select the primary trajectory if valid, the secondary trajectory if the primary trajectory is invalid, or another trajectory generated by the secondary system if the primary trajectory and the secondary trajectory are invalid. If no valid trajectory is determined, the vehicle may decelerate at a maximum rate.

Abstract: A vehicle lamp system includes an imaging unit that takes an image ahead of a host vehicle, a luminance analyzer that detects luminance of each of areas ahead of the host vehicle, a target analyzer that detects objects ahead of the host vehicle, a tracking unit that determines a specific object from the detected objects and detects displacement of the specific object based on a detection result of the luminance; a setting unit that sets, based on the detection result of the luminance and a detection result of the displacement, an illuminance value for each area, which includes a specific illuminance for a specific area determined according to a position where the specific target is present, and a controller that controls the light source the illuminance of the light to be radiated from a light source to each area based on the illuminance values set by the setting unit.

Abstract: A video display system for a vehicle includes a video display device disposed in the vehicle so as to be viewable by a driver of the vehicle. A camera is disposed at the vehicle and having an exterior field of view and operable to capture image data. A control includes a data processor. The control, responsive at least in part to processing by the data processor of captured image data, detects an object present exterior of the vehicle that is in the field of view of the camera, and determines if the detected object constitutes a hazardous condition. Responsive to determination of the hazardous condition, the control controls the video display device to automatically display an alert to the driver of the vehicle, with the alert including display of video images of the object that are derived from captured image data or a graphic overlay on displayed video images.

Abstract: A system and method to perform lane position sensing and tracking in a vehicle include using a first camera with a first field of view of a first side of the vehicle and a second camera with a second field of view on a second side of the vehicle to capture images. The method includes determining if a first lane line on a first side of the vehicle and a second lane line on the second side of the vehicle are both visible, and based on the first lane line and the second lane line being visible, determining, a position of the vehicle in a lane between the first lane line and the second lane line and determining a trajectory of the first lane line and the second lane line and of the vehicle.

Abstract: Disclosed herein are an apparatus and method for compensating for a heading angle. The apparatus for compensating for a heading angle includes a compensation condition determination unit configured to determine whether a predetermined compensation condition is satisfied, to compensate for a heading angle of a camera, and a heading angle processing unit configured to compensate for the heading angle of the camera using a lane distance input from the camera, when it is determined by the compensation condition determination unit that the compensation condition is satisfied.