Abstract: The disclosure provides an environment perception device and method of a mobile vehicle. The environment perception device includes a camera module, a LiDAR module, a database and a processing circuit. The camera module photographs a field near the mobile vehicle to generate a three-dimensional (3D) image frame. The LiDAR module scans the field to generate a 3D scanned frame. The processing circuit fuses the 3D image frame and the 3D scanned frame to generate 3D object information. The processing circuit compares the 3D object information with a 3D map in the database to determine whether an object is a static object. The processing circuit performs an analysis and calculation on the 3D object information to obtain movement characteristics of the object when the object is not the static object, and skips the analysis and calculation on the 3D object information when the object is the static object.

Abstract: A method for avoiding obstacles surrounding a mobile vehicle is disclosed. The method discloses that it is more accurate to merge images after a depth information is obtained to construct an environment information. The mobile vehicle set an omnidirectional depth sensing module using a lot of depth sensors for capturing a depth information of an environment surrounding the mobile vehicle and identifying the obstacles on the road upon the depth information. Also, scanning the smooth degree of the road for identifying static obstacles and moved obstacles, Thereby, a control circuit controls the mobile vehicle to lower speed or circumvent the danger.

Abstract: The disclosure provides an environment perception device and method of a mobile vehicle. The environment perception device includes a camera module, a LiDAR module, a database and a processing circuit. The camera module photographs a field near the mobile vehicle to generate a three-dimensional (3D) image frame. The LiDAR module scans the field to generate a 3D scanned frame. The processing circuit fuses the 3D image frame and the 3D scanned frame to generate 3D object information. The processing circuit compares the 3D object information with a 3D map in the database to determine whether an object is a static object. The processing circuit performs an analysis and calculation on the 3D object information to obtain movement characteristics of the object when the object is not the static object, and skips the analysis and calculation on the 3D object information when the object is the static object.

Abstract: The present invention provides a smoke detection method with visual depth, which uses an image camera and a depth camera to extract surrounding images and surrounding depth information. A vehicle is used to patrol an area, such as the area of a processing factory, for receiving the surrounding environment information and detecting existence of burning objects or smoke. Then a processor adopting the clustering algorithm is used to estimate the smoke distribution or the location of fire source of burning objects, and uses an alarm to provide alarm information. Thereby, the rescue crew can prepare in advance and respond immediately. By providing the correct information to the firemen in the fire scenes, the time to control the fire can be shortened and the time for evacuation can be increased.

Abstract: A gesture operation method based on depth values and the system thereof are revealed. A stereoscopic-image camera module acquires a first stereoscopic image. Then an algorithm is performed to judge if the first stereoscopic image includes a triggering gesture. Then the stereoscopic-image camera module acquires a second stereoscopic image. Another algorithm is performed to judge if the second stereoscopic image includes a command gesture for performing the corresponding operation of the command gesture.

Abstract: The present invention provides a smoke detection method with visual depth, which uses an image camera and a depth camera to extract surrounding images and surrounding depth information. A vehicle is used to patrol an area, such as the area of a processing factory, for receiving the surrounding environment information and detecting existence of burning objects or smoke. Then a processor adopting the clustering algorithm is used to estimate the smoke distribution or the location of fire source of burning objects, and uses an alarm to provide alarm information. Thereby, the rescue crew can prepare in advance and respond immediately. By providing the correct information to the firemen in the fire scenes, the time to control the fire can be shortened and the time for evacuation can be increased.

Abstract: A method for avoiding obstacles surrounding a mobile vehicle is disclosed. The method discloses that it is more accurate to merge images after a depth information is obtained to construct an environment information. The mobile vehicle set an omnidirectional depth sensing module using a lot of depth sensors for capturing a depth information of an environment surrounding the mobile vehicle and identifying the obstacles on the road upon the depth information. Also, scanning the smooth degree of the road for identifying static obstacles and moved obstacles, Thereby, a control circuit controls the mobile vehicle to lower speed or circumvent the danger.

Abstract: A gesture operation method based on depth values and the system thereof are revealed. A stereoscopic-image camera module acquires a first stereoscopic image. Then an algorithm is performed to judge if the first stereoscopic image includes a triggering gesture. Then the stereoscopic-image camera module acquires a second stereoscopic image. Another algorithm is performed to judge if the second stereoscopic image includes a command gesture for performing the corresponding operation of the command gesture.

Abstract: A gesture operation method based on depth values and the system thereof are revealed. A stereoscopic-image camera module acquires a first stereoscopic image. Then an algorithm is performed to judge if the first stereoscopic image includes a triggering gesture. Then the stereoscopic-image camera module acquires a second stereoscopic image. Another algorithm is performed to judge if the second stereoscopic image includes a command gesture for performing the corresponding operation of the command gesture.

Abstract: A gesture operation method based on depth values and the system thereof are revealed. A stereoscopic-image camera module acquires a first stereoscopic image. Then an algorithm is performed to judge if the first stereoscopic image includes a triggering gesture. Then the stereoscopic-image camera module acquires a second stereoscopic image. Another algorithm is performed to judge if the second stereoscopic image includes a command gesture for performing the corresponding operation of the command gesture.

Abstract: The present disclosure provides an alarm method for reversing a vehicle, in particular for a land vehicle, by sensing obstacles using structured light. When a vehicle reverses, the structured-light projecting module installed on the rear side of the vehicle projects structured light continuously, A plurality of light pattern messages are reflected to the structured-light camera unit. Then the height of and the distance to the obstacle are calculated. According to the height of the obstacle, whether the obstacle may influence the vehicle will be judged. If so, sounds will be emitted for reminding the driver according to the distance to the obstacle and the alarm distance information. Thereby, the reversing safety can be improved.

Abstract: A method for overlapping images is revealed. After overlapping the overlapped regions in two depth images generated by structured-light camera units, a first image, the overlapped image, and a fourth image are display on a display unit. Thereby, the drivers' viewing ranges blocked by the vehicle body while viewing outwards from the interior of a vehicle can be retrieved. Then the drivers' blind spots can be minimized and thus improving driving safety.

Abstract: The present disclosure provides an alarm method for reversing a vehicle, in particular for a land vehicle, by sensing obstacles using structured light. When a vehicle reverses, the structured-light projecting module installed on the rear side of the vehicle projects structured light continuously, A plurality of light pattern messages are reflected to the structured-light camera unit. Then the height of and the distance to the obstacle are calculated. According to the height of the obstacle, whether the obstacle may influence the vehicle will be judged. If so, sounds will be emitted for reminding the driver according to the distance to the obstacle and the alarm distance information. Thereby, the reversing safety can be improved.

Abstract: A real-time warning system for a vehicle windshield and a performing method thereof are disclosed. The real-time warning system includes an image capture unit, an image processing unit, a calculation and control unit, and a robotic optical projection unit. The image capture unit continually captures images appearing in front of a vehicle. The image processing unit determines an obstacle according to the images appearing in front of the vehicle. The calculation and control unit calculates an intersection point between a straight line and the vehicle windshield, wherein the straight line connects the obstacle and a head position of a driver in the vehicle. The robotic optical projection unit which is controlled by the calculation and control unit generates a warning mark onto the vehicle windshield so that the driver can easily see the obstacle ahead.