Abstract: An image sensor includes a substrate including a first region and a second region disposed in a periphery of the first region. The first region includes a plurality of unit pixels and a color filter structure, and the second region includes a dummy structure including a second color filter and a plurality of dummy lenses on the second color filter. The color filter structure includes a first extension portion extending in a first direction and a second extension portion extending in a second direction, and the dummy structure includes a third extension portion extending in the first direction and a fourth extension portion extending in the second direction. A first micro-lens, a second micro-lens, and a third micro-lens are in a first corner portion, and a first dummy lens, a second dummy lens, and a third dummy lens are in the second corner portion.

Abstract: A method of generating a second neural network model according to an example embodiment includes: inputting unlabeled input data to a first neural network model; obtaining prediction results corresponding to the unlabeled input data based on the first neural network model; and generating a second neural network model based on the prediction results of the first neural network model and a degree of distribution of the prediction results.

Abstract: A surface acoustic wave device according to the present disclosure includes a support substrate; an intermediate layer laminated on the support substrate; a piezoelectric layer laminated on the intermediate layer; and an IDT electrode formed on the piezoelectric layer, an Euler angle of the support substrate is (?45°±10°, ?54°±10°, 180°±30°) and an Euler angle of the piezoelectric layer is (0°±5°, 112.5°±22.5°, 0°±5°) or (0°±5°, ?67.5°±22.5°, 0°±5°).

Abstract: Provided is a method and apparatus for determining a path of a vehicle. The method includes receiving a radio frequency (RF) signal among RF signals predefined corresponding to other vehicles in front of the vehicle, and determining a path of the vehicle based on the received RF signal.

Abstract: A road line determination method and apparatus is provided. The method includes: performing detection of two road lines of a lane in which the vehicle is driving from a driving image; determining whether at least one road line of the two road lines is not detected; if it is determined that the at least one road line is not detected, determining at least one road line for the at least one undetected road line based on first information about a drivable road area comprising the road; and controlling driving of the vehicle based on the at least one determined road line.

Abstract: Systems and methods are disclosed for performing manufacturing testing on an autonomous driving vehicle (ADV) sensor board. A sensor unit of the ADV includes a plurality of sensor I/O channels that provide information to the ADV perception and planning module, to navigate the ADV. An array of sensors is emulated on a sensor unit test board. The sensor unit includes a small software that manages the flow of testing the sensor unit. The sensor unit test board provides emulated sensor data for, e.g., GPS, LIDAR, RADAR, inertial measurement, one or more cameras, humidity, temperature, and pressure, and throttle, braking, and steering inputs. Each emulated sensor includes its own data validity checker to ensure that each sensor I/O channel of the sensor unit is tested. The sensor unit test board can include an LED for each I/O channel that indicates a pass/fail status of the test for the I/O channel.

Abstract: The disclosure describes various embodiments of validating data synchronization between an active sensor and a passive sensor. According to an exemplary method of validating sensor synchronization between an active sensor and a passive sensor, a synchronization device receives a first signal from the active sensor, the first signal indicating that the active sensor has transmitted laser points to a measure board. In response to the first signal, the synchronization device transmits a second signal to the passive sensor to trigger the passive sensor to capture an image of the measure board. A synchronization validation application can perform an analysis of the image of the measure board in view of timing of the first signal and second signal to determine whether the passive sensor and the active sensor are synchronized with each other.

Abstract: Diagnosing a sensor processing unit of an autonomous driving vehicle is described. An example computer-implemented method can include transmitting an executable image of a sensor processing application from a host system to the sensor processing unit via at least one of a universal asynchronous receiver-transmitter (UART) or an Ethernet connection. The method also includes causing the sensor processing unit to execute and launch the executable image of the sensor processing application in the DRAM from the eMMC storage device. The method also includes transmitting a sequence of predetermined commands to the executed sensor processing application to perform a plurality of sensor data processing operations on sensor data obtained from a plurality of sensors or sensor simulators associated with an autonomous driving vehicle.

Abstract: A sensor unit includes a sensor interface, host interface, and pre-processing hardware. The sensor interface is coupled to a plurality of cameras configured to capture images around an autonomous driving vehicle (ADV). The host interface is coupled to a perception and planning system. The pre-processing hardware is coupled to the sensor interface to receive images from the plurality of cameras and to perform one or more pre-processing functions on the images and to transmit pre-processed images to the perception and planning system via the host interface. The perception and planning system is configured to perceive a driving environment surrounding the ADV based on the pre-processed images and to plan a path to control the ADV to navigate through the driving environment. The pre-processing functions can adjust for different calibrations and formats across the plurality of cameras.

Abstract: In one embodiment, a sensor unit receives a first GPS message from a GPS sensor, where the sensor unit is coupled between sensors and a perception and planning system of an autonomous driving vehicle (ADV). The sensor unit determines a type of the first GPS message by matching a predetermined field of the first GPS message with a list of predetermined data patterns. Each of the predetermined data patterns corresponds to one of the predetermined types of GPS messages and decodes a payload of the first GPS message using a decoding algorithm associated with the type of the first GPS message.

Abstract: The disclosure describes various embodiments of validating data synchronization between an active sensor and a passive sensor. According to an exemplary method of validating sensor synchronization between an active sensor and a passive sensor, a synchronization device receives a first signal from the active sensor, the first signal indicating that the active sensor has transmitted laser points to a measure board. In response to the first signal, the synchronization device transmits a second signal to the passive sensor to trigger the passive sensor to capture an image of the measure board. A synchronization validation application can perform an analysis of the image of the measure board in view of timing of the first signal and second signal to determine whether the passive sensor and the active sensor are synchronized with each other.

Abstract: Diagnosing a sensor processing unit of an autonomous driving vehicle is described. An example computer-implemented method can include transmitting an executable image of a sensor processing application from a host system to the sensor processing unit via at least one of a universal asynchronous receiver-transmitter (UART) or an Ethernet connection. The method also includes causing the sensor processing unit to execute and launch the executable image of the sensor processing application in the DRAM from the eMMC storage device. The method also includes transmitting a sequence of predetermined commands to the executed sensor processing application to perform a plurality of sensor data processing operations on sensor data obtained from a plurality of sensors or sensor simulators associated with an autonomous driving vehicle.

Abstract: Systems and methods are disclosed for performing manufacturing testing on an autonomous driving vehicle (ADV) sensor board. A sensor unit of the ADV includes a plurality of sensor I/O channels that provide information to the ADV perception and planning module, to navigate the ADV. An array of sensors is emulated on a sensor unit test board. The sensor unit includes a small software that manages the flow of testing the sensor unit. The sensor unit test board provides emulated sensor data for, e.g., GPS, LIDAR, RADAR, inertial measurement, one or more cameras, humidity, temperature, and pressure, and throttle, braking, and steering inputs. Each emulated sensor includes its own data validity checker to ensure that each sensor I/O channel of the sensor unit is tested.

Abstract: Flexible hardware designs for camera calibration and image pre-processing are disclosed for vehicles including autonomous driving (AD) vehicles. For one example, a sensor unit includes a sensor interface, host interface, and pre-processing hardware. The sensor interface is coupled to a plurality of cameras configured to capture images around an autonomous driving vehicle (ADV). The host interface is coupled to a perception and planning system. The pre-processing hardware is coupled to the sensor interface to receive images from the plurality of cameras and to perform one or more pre-processing functions on the images and to transmit pre-processed images to the perception and planning system via the host interface. The perception and planning system is configured to perceive a driving environment surrounding the ADV based on the pre-processed images and to plan a path to control the ADV to navigate through the driving environment.

Abstract: In one embodiment, a sensor unit receives a first GPS message from a GPS sensor, where the sensor unit is coupled between sensors and a perception and planning system of an autonomous driving vehicle (ADV). The sensor unit determines a type of the first GPS message by matching a predetermined field of the first GPS message with a list of predetermined data patterns. Each of the predetermined data patterns corresponds to one of the predetermined types of GPS messages and decodes a payload of the first GPS message using a decoding algorithm associated with the type of the first GPS message.

Abstract: A multispectral optical sensor is disclosed. In one embodiment, the multispectral optical sensor includes a piezoelectric material, a first sensing layer and a second sensing layer spaced apart from each other on the piezoelectric material and configured to change the propagation speed of the acoustic wave propagated through the piezoelectric material by receiving ultraviolet light and visible light, respectively. The multiple optical sensor further includes a first acoustic wave output part and a second acoustic wave output part disposed on the piezoelectric material respectively corresponding to the first and second sensing layers and configured to generate an electrical signal based on the changed acoustic wave. The multiple optical sensor measures the intensity of ultraviolet and visible light using a single sensor by detecting the change in frequency, and measures the frequency change in the acoustic wave using zinc oxide, gallium nitride), or cadmium sulfide nanoparticles.

Abstract: A method of generating a second neural network model according to an example embodiment includes: inputting unlabeled input data to a first neural network model; obtaining prediction results corresponding to the unlabeled input data based on the first neural network model; and generating a second neural network model based on the prediction results of the first neural network model and a degree of distribution of the prediction results.

Abstract: Provided is a method and apparatus for determining a path of a vehicle. The method includes receiving a radio frequency (RF) signal among RF signals predefined corresponding to other vehicles in front of the vehicle, and determining a path of the vehicle based on the received RF signal.

Abstract: A road line determination method and apparatus is provided. The method includes: performing detection of two road lines of a lane in which the vehicle is driving from a driving image; determining whether at least one road line of the two road lines is not detected; if it is determined that the at least one road line is not detected, determining at least one road line for the at least one undetected road line based on first information about a drivable road area comprising the road; and controlling driving of the vehicle based on the at least one determined road line.

Abstract: An X-ray apparatus performs image processing on an image of an object photographed by using a camera, and uses the image-processed image as an image marker in an X-ray image. A display is configured to display the X-ray image and the image marker on the region of the X-ray image.