Abstract: This disclosure provides a retail environment robotic system including a vertically oriented/scanning LIDAR (Light Detection and Ranging) unit mounted to a mobile base which travels along the aisles of a retail environment such as a store. According to an exemplary embodiment, the LIDAR unit vertically scans product display units along the aisles to generate a depth map associated with detected objects which is further processed to detect missing products, product/shelving tags, shelves, etc.

Abstract: This disclosure provides a retail environment robotic system including a vertically oriented/scanning LIDAR (Light Detection and Ranging) unit mounted to a mobile base which travels along the aisles of a retail environment such as a store. According to an exemplary embodiment, the LIDAR unit vertically scans product display units along the aisles to generate a depth map associated with detected objects which is further processed to detect missing products, product/shelving tags, shelves, etc.

Abstract: A method, system, and apparatus for parking occupancy detection comprises collecting video of a blockface with at least one video recording module, identifying a number of possible parking spaces along the blockface in the collected video, defining, a region of interest for each of the possible parking spaces, detecting a time dependent occupancy of the defined regions of interest for each of the possible parking spaces, and reporting the time dependent occupancy. Drift correction of the recorded video and ground truth comparisons of occupancy determinations may be provided.

Abstract: A method, system, and apparatus for video frame alignment comprises collecting video data comprising at least two video frames; extracting a line profile along at least one line profile in each of the at least two video frames; selecting one of the at least two video frames as a reference video frame; segmenting each of the at least one line profiles into a plurality of segmented line profile group segments; aligning the plurality of segmented line profiles with the segmented line profiles in the reference video frame; translating each of the at least two video frames for each of the plurality of corresponding segmented line profile alignments; and removing a camera shift from the at least two video frames according to the translation and alignment of the plurality of segmented line profiles with the plurality of segmented line profile in the reference video frame.

Abstract: A method, system, and apparatus for parking occupancy detection comprises collecting video of a blockface with at least one video recording module, identifying a number of possible parking spaces along the blockface in the collected video, defining, a region of interest for each of the possible parking spaces, detecting a time dependent occupancy of the defined regions of interest for each of the possible parking spaces, and reporting the time dependent occupancy. Drift correction of the recorded video and ground truth comparisons of occupancy determinations may be provided.

Abstract: A method, system, and apparatus for video frame alignment comprises collecting video data comprising at least two video frames; extracting a line profile along at least one line profile in each of the at least two video frames; selecting one of the at least two video frames as a reference video frame; segmenting each of the at least one line profiles into a plurality of segmented line profile group segments; aligning the plurality of segmented line profiles with the segmented line profiles in the reference video frame; translating each of the at least two video frames for each of the plurality of corresponding segmented line profile alignments; and removing a camera shift from the at least two video frames according to the translation and alignment of the plurality of segmented line profiles with the plurality of segmented line profile in the reference video frame.

Abstract: A method for idling vehicle detection comprises shining a light source on an exterior surface of a vehicle with an illumination module, collecting light reflected from the exterior surface of the vehicle with a capture module, and processing the collected light reflected from the exterior surface of the vehicle surface with a processing module wherein the processing model determines if the vehicle's engine is running or if the vehicle's engine is not running.

Abstract: A system and method of video-based chew counting by receiving image frames from a video camera, determining feature points within the image frames from the video camera, generating a motion signal based on movement of the feature points across the image frames from the video camera, and determining a chew count based on the motion signal.

Abstract: Parking occupancy detection methods, systems and processor-readable media. A laser device unit includes a laser range finder, and a programmable pan-tilt unit is deployable on site to monitor one or more parking spaces. A laser emitting and receiving unit associated with the laser range finder determines the distance of an object by estimating a time difference between an emitted laser and a received laser. The laser range finder is controllable by the programmable pan-tilt unit and scans the parking spaces. A signal-processing unit can convert the measured distance profile to a parking occupancy data to provide continuous parking space estimation data for use in parking occupancy detection.

Abstract: An automated method and system for detecting the presence of a smoking product utilizing a near infrared video-processing unit in real time. One or more near infrared (NIR) video capturing units can be configured to capture a video feed. The video feed can be processed by the video-processing unit in order to detect a smoking product (e.g., a lit cigarette) within a field of view of the video capturing unit. A near infrared video sequence can be read and analyzed for the presence of a “hot spot” of a predetermined size based on pixel color information. In some cases, the motion of the hot spot can be tracked in response to the detection of the hot spot. An alarm signal can also be triggered in some cases, if the pattern of motion is consistent with that of a cigarette being smoked.

Abstract: Hybrid methods, systems and processor-readable media for video and vision based access control for parking occupancy determination. One or more image frames of a parking area of interest can be acquired from among two or more regions of interest defined with respect to the parking area of interest. The regions of interest can be analyzed for motion detection or image content change detection. An image content classification operation can be performed with respect to a first region of interest among the regions of interest based on the result of the image content change detection. An object tracking operation can then be performed with respect to a second region of interest among the regions of interest if the result of the image content classification operation indicates a presence of one or more objects of interest within the parking area of interest.

Abstract: What is disclosed is a system and method for selecting the optimal wavelength ban combination for a multi-band infrared camera system which is optimized for skin detection. An objective function is constructed specifically for this application from classified performance and the algorithm generates wavelengths by maximizing the objective function. A specific wavelength band combination is selected which maximizes the objective function. Also disclosed is a 3-band and 4-band camera system with filters each having a transmittance of one of a combination of wavelength bands optimized to detect skin in the infrared band. The camera systems disclosed herein find their intended uses in a wide array of vehicle occupancy detection systems and applications. Various embodiments are disclosed.

Abstract: An embodiment generally relates to systems and methods for determining cell phone usage automatically by individuals operating vehicles. A processing module can process multi-spectral images or videos of individuals and detect different regions in the image such as face regions, hand regions, and cell phone regions. Further, the processing module can analyze the regions based on locations and numbers of skin pixels and cell phone pixels to determine if the individual is holding his or her cell phone near his or her face. Based on the analysis, it can be determined whether the individual is operating the cell phone. Further, the analysis can yield a confidence level associated with the cell phone usage.

Abstract: A method and structure for estimating parking occupancy within an area of interest can include the use of at least two image capture devices and a processor (e.g., a computer) which form at least part of a network. A method for estimating the parking occupancy within the area of interest can include the use of vehicle entry and exit data from the area of interest, as well as an estimated transit time for vehicles transiting through the area of interest without parking.

Abstract: A video-based vehicle headlight state monitoring method and system. A vehicle image can be captured by an image-capturing unit and converted to a grayscale image. The grayscale image can be processed to locate a front license plate and identify a position of a headlight region in front of the vehicle utilizing an algorithm. An average digital count with respect to brightness of the headlight region can be compared with average digital count with respect to brightness of several parts of the vehicle and a background region to determine the vehicle headlights ON/OFF status. The headlights can be considered ON if the digital count level of the headlight region is higher than the digital count of the several parts of the vehicle and the background region. A warning signal can be initiated to turn the headlights on during a special situation utilizing a signal generator.

Abstract: What is disclosed is a system and method for identifying materials comprising an object captured in a video and for using the identified materials to track that object as it moves across the captured video scene. In one embodiment, a multi-spectral or hyper-spectral sensor is used to capture a spectral image of an object in an area of interest. Pixels in the spectral planes of the spectral images are analyzed to identify a material comprising objects in that area of interest. A location of each of the identified objects is provided to an imaging sensor which then proceeds to track the objects as they move through a scene. Various embodiments are disclosed.

Abstract: Parking occupancy detection methods, systems and processor-readable media. A laser device unit includes a laser range finder, and a programmable pan-tilt unit is deployable on site to monitor one or more parking spaces. A laser emitting and receiving unit associated with the laser range finder determines the distance of an object by estimating a time difference between an emitted laser and a received laser. The laser range finder is controllable by the programmable pan-tilt unit and scans the parking spaces. A signal-processing unit can convert the measured distance profile to a parking occupancy data to provide continuous parking space estimation data for use in parking occupancy detection.

Abstract: Hybrid methods, systems and processor-readable media for video and vision based access control for parking occupancy determination. One or more image frames of a parking area of interest can be acquired from among two or more regions of interest defined with respect to the parking area of interest. The regions of interest can be analyzed for motion detection or image content change detection. An image content classification operation can be performed with respect to a first region of interest among the regions of interest based on the result of the image content change detection. An object tracking operation can then be performed with respect to a second region of interest among the regions of interest if the result of the image content classification operation indicates a presence of one or more objects of interest within the parking area of interest.

Abstract: What is disclosed is a system and method for monitoring respiration of a subject or subject of interest using a thermal imaging system with single or multiple spectral bands set to a temperature range of a facial region of that person. Temperatures of extremities of the head and face are used to locate facial features in the captured thermal images, i.e., nose and mouth, which are associated with respiration. The RGB signals obtained from the camera are plotted to obtain a respiration pattern. From the respiration pattern, a rate of respiration is obtained. The system includes display and communication interfaces wherein alerts can be activated if the respiration rate falls outside a level of acceptability. The teachings hereof find their uses in an array of devices such as, for example, devices which monitor the respiration of an infant to signal the onset of a respiratory problem or failure.

Abstract: A system and method of video-based chew counting by receiving image frames from a video camera, determining feature points within the image frames from the video camera, generating a motion signal based on movement of the feature points across the image frames from the video camera, and determining a chew count based on the motion signal.