Abstract: According to exemplary methods, automated image processing of images from order locations of a multi-lane drive-thru system is continually performed using an automated ordering system. It is automatically determined if a vehicle is present at any of the order locations based on the automated image processing. It is automatically determined if an order has been initiated into the automated ordering system. When the order has been initiated while the vehicle is present at any of the order locations, an automated sequencing processing is automatically begun. The automated sequencing processing determines an order pick-up sequence for picking up orders at pickup windows of the multi-lane drive-thru system. When the order has been initiated while the vehicle is not present at any of the order locations, a potential out-of-sequence warning is automatically associated with the order and output from the automated ordering system.

Abstract: According to exemplary methods, automated image processing of images from order locations of a multi-lane drive-thru system is continually performed using an automated ordering system. It is automatically determined if a vehicle is present at any of the order locations based on the automated image processing. It is automatically determined if an order has been initiated into the automated ordering system. When the order has been initiated while the vehicle is present at any of the order locations, an automated sequencing processing is automatically begun. The automated sequencing processing determines an order pick-up sequence for picking up orders at pickup windows of the multi-lane drive-thru system. When the order has been initiated while the vehicle is not present at any of the order locations, a potential out-of-sequence warning is automatically associated with the order and output from the automated ordering system.

Abstract: According to exemplary methods of training a convolutional neural network, input images are received into a computerized device having an image processor. The image processor evaluates the input images using first convolutional layers. The number of first convolutional layers is based on a first size for the input images. Each layer of the first convolutional layers receives layer input signals comprising features of the input images and generates layer output signals that include signals from the input images and ones of the layer output signals from previous layers within the first convolutional layers. Responsive to an input image being a second size larger than the first size, additional convolutional layers are added to the convolutional neural network. The number of additional convolutional layers is based on the second size in relation to the first size. The additional convolutional layers are initialized using weights from the first convolutional layers.

Abstract: A smoke detection system for an interior of a vehicle is provided. The smoke detection system includes a detection module and a reporting module. The detection module, while the vehicle is being used as part of a car sharing or ride sharing service: receives a sensor signal from a smoke detector; compares data included in the sensor signal to smoke characteristic or smoke pattern data; based on the comparison, determines whether an occupant of the vehicle is smoking; and generates an alert signal if the occupant is smoking. The reporting module at least one of: based on the alert signal, visually or audibly provides a warning to the occupant to stop smoking; transmits the alert signal to a mobile device of the occupant to indicate that a smoking event has been detected; or transmits the alert signal to a network device of a service provider to report the smoking event.

Abstract: Systems and methods of mapping traffic related objects. In one embodiment, a method includes: receiving image sensor data relating to an environment associated with a vehicle; receiving lidar sensor data relating to the environment associated with the vehicle; selecting, by a processor, at least one image region including a traffic related object from the image sensor data; selectively filtering, by a processor, the at least one image region based on the lidar sensor data; and generating, by a processor, a composite map including a representation of the traffic related object superimposed upon a defined map of the environment based on the selectively filtering.

Abstract: According to exemplary methods of training a convolutional neural network, input images are received into a computerized device having an image processor. The image processor evaluates the input images using first convolutional layers. The number of first convolutional layers is based on a first size for the input images. Each layer of the first convolutional layers receives layer input signals comprising features of the input images and generates layer output signals that include signals from the input images and ones of the layer output signals from previous layers within the first convolutional layers. Responsive to an input image being a second size larger than the first size, additional convolutional layers are added to the convolutional neural network. The number of additional convolutional layers is based on the second size in relation to the first size. The additional convolutional layers are initialized using weights from the first convolutional layers.

Abstract: A method and apparatus for detecting and classifying objects associated with a vehicle are provided. The method includes capturing a first image and a second image of a cabin of a vehicle, dividing the first image and the second image into a plurality of regions, comparing a first region of the first image to a second region of the second image, in response to detecting a difference between the second region and the first region, classifying an object present in the difference between the second region and the first region and labeling the classified object, and providing a notification of the classified object to at least one from among an occupant of the vehicle and an operator of the vehicle.

Abstract: This disclosure provides a method and system for automated sequencing of vehicles in side-by-side drive-thru configurations via appearance-based classification. According to an exemplary embodiment, an automated sequencing method includes computer-implemented method of automated sequencing of vehicles in a side-by-side drive-thru, the method comprising: a) an image capturing device capturing video of a merge-point area associated with multiple lanes of traffic merging; b) detecting in the video a vehicle as it traverses the merge-point area; c) classifying the detected vehicle associated with traversing the merge-point area as coming from one of the merging lanes; and d) aggregating vehicle classifications performed in step c) to generate a merge sequence of detected vehicles.

Abstract: A method and apparatus for detecting and classifying objects associated with a vehicle are provided. The method includes capturing a first image and a second image of a cabin of a vehicle, dividing the first image and the second image into a plurality of regions, comparing a first region of the first image to a second region of the second image, in response to detecting a difference between the second region and the first region, classifying an object present in the difference between the second region and the first region and labeling the classified object, and providing a notification of the classified object to at least one from among an occupant of the vehicle and an operator of the vehicle.

Abstract: A detection-based segmentation-free method and system for license plate recognition. An image of a vehicle is initially captured utilizing an image-capturing unit. A license plate region is located in the image of the vehicle. A set of characters can then be detected in the license plate region and a geometry correction performed based on a location of the set of characters detected in the license plate region. An operation for sweeping an OCR across the license plate region can be performed to infer characters with respect to the set of characters and locations of the characters utilizing a hidden Markov model and leveraging anchored digit/character locations.

Abstract: A method and system for domain adaptation based on multi-layer fusion in a convolutional neural network architecture for feature extraction and a two-step training and fine-tuning scheme. The architecture concatenates features extracted at different depths of the network to form a fully connected layer before the classification step. First, the network is trained with a large set of images from a source domain as a feature extractor. Second, for each new domain (including the source domain), the classification step is fine-tuned with images collected from the corresponding site. The features from different depths are concatenated with and fine-tuned with weights adjusted for a specific task. The architecture is used for classifying high occupancy vehicle images.

Abstract: Multi-stage vehicle detection systems and methods for side-by-side drive-thru configurations. One or more video cameras (or an image-capturing unit) can be employed for capturing video of a drive-thru of interest in a monitored area. A group of modules can be provided, which define multiple virtual detection loops in the video and sequentially perform classification with respect to each virtual detection loops among the multiple virtual detection loops, starting from a virtual detection loop closest to an order point, and when a vehicle having a car ID is sitting in a drive-thru queue, so as to improve vehicle detection performance in automated post-merge sequencing.

Abstract: A method for enforcing traffic signal compliance includes acquiring a series of temporal related image frames including a target area. Each image frame includes pixel data representative of the target area. The method includes generating one or more motion vectors between two or more of the image frames. The motion vectors are the type produced by compressing the pixel data associated with the two or more image frames. The method includes associating a cluster of motion vectors with a vehicle. The method further includes tracking a position of the vehicle across the two or more image frames. Using the tracking results, the method includes determining whether the vehicle stops in the target area. For the vehicle being determined as not stopping, the method includes signaling an occurrence of noncompliance.

Abstract: Methods and systems for localizing numbers and characters in captured images. A side image of a vehicle captured by one or more cameras can be preprocessed to determine a region of interest. A confidence value of series of windows within regions of interest of different sizes and aspect ratios containing a structure of interest can be calculated. Highest confidence candidate regions can then be identified with respect to the regions of interest and at least one region adjacent to the highest confidence candidate regions. An OCR operation can then be performed in the adjacent region. An identifier can then be returned from the adjacent region in order to localize numbers and characters in the side image of the vehicle.

Abstract: Methods, systems, and processor-readable media for detecting the side window of a vehicle. A spatial probability map can be calculated, which includes data indicative of likely side window locations of a vehicle in an image. A side window detector can be run with respect to the image of the vehicle to determine detection scores. The detection scores can be weighted based on the spatial probability map. A detected region of interest can be extracted from the image as extracted image patch. An image classification can then be performed with respect to the extracted patch to provide a classification that indicates whether or not a passenger is in the vehicle or no-passenger is in the vehicle.

Abstract: Methods, systems, and processor-readable media for the detection and classification of license plates. In an example embodiment, an image of a vehicle can be captured with an image-capturing unit. A license plate region can then be located in the captured image of the vehicle by extracting a set of candidate regions from the image utilizing a weak classifier. A set of candidate regions can be ranked utilizing a secondary strong classifier. The captured image can then be classified according to a confidence driven classification based on classification criteria determined by the weak classifier and the secondary strong classifier.

Abstract: A method, non-transitory computer readable medium, and apparatus for directing a vehicle in a side-by-side drive-thru are disclosed. For example, the method receives one or more video images of a side-by-side drive-thru comprising two or more lanes, detects a vehicle approaching an entrance of the side-by-side drive-thru, calculating an estimated order time for the vehicle and directs the vehicle to one of the two or more lanes based on the estimated order time for the vehicle or a previously estimated order time of each one of the a plurality of vehicles already in the first lane and the second lane of the drive-thru.

Abstract: According to exemplary methods of training a convolutional neural network, input images are received into a computerized device having an image processor. The image processor evaluates the input images using first convolutional layers. The number of first convolutional layers is based on a first size for the input images. Each layer of the first convolutional layers receives layer input signals comprising features of the input images and generates layer output signals that include signals from the input images and ones of the layer output signals from previous layers within the first convolutional layers. Responsive to an input image being a second size larger than the first size, additional convolutional layers are added to the convolutional neural network. The number of additional convolutional layers is based on the second size in relation to the first size. The additional convolutional layers are initialized using weights from the first convolutional layers.

Abstract: A system and method for detecting electronic device use by a driver of a vehicle including acquiring an image including a vehicle from an associated image capture device positioned to view oncoming traffic, locating a windshield region of the vehicle in the captured image, processing pixels of the windshield region of the image for computing a feature vector describing the windshield region of the vehicle, applying the feature vector to a classifier for classifying the image into respective classes including at least classes for candidate electronic device use and candidate electronic device non-use, and outputting the classification.

Abstract: According to exemplary methods, automated image processing of images from order locations of a multi-lane drive-thru system is continually performed using an automated ordering system. It is automatically determined if a vehicle is present at any of the order locations based on the automated image processing. It is automatically determined if an order has been initiated into the automated ordering system. When the order has been initiated while the vehicle is present at any of the order locations, an automated sequencing processing is automatically begun. The automated sequencing processing determines an order pick-up sequence for picking up orders at pickup windows of the multi-lane drive-thru system. When the order has been initiated while the vehicle is not present at any of the order locations, a potential out-of-sequence warning is automatically associated with the order and output from the automated ordering system.