Abstract: In one embodiment, a microcontroller unit (MCU) receives an expected state of an autonomous driving vehicle (ADV) from a controller of the ADV, where the controller controls motions of the ADV using a control algorithm. The MCU receives sensor data from one or more sensors of the ADV. The MCU determine an actual state of the ADV based on the sensor data. The MCU determines a performance metric of the control algorithm based on the expected state and the actual state. In response to determining the performance metric has satisfied a predetermined condition, the MCU determines a plurality of weight values for the control algorithm. The MCU sends the plurality of weight values to the control system to tune one or more weight parameters of the control algorithm using the plurality of weight values, where the controller controls the ADV using the tuned control algorithm.

Abstract: A computing device may obtain one or more raw images captured from sensors of an autonomous driving vehicle (ADV). The computing device may apply one or more signal processing parameters to one or more raw images, resulting in one or more processed images. The computing device may apply an object detection algorithm of the ADV to the one or more processed images. The computing device may determine a score of the object detection algorithm as applied to the one or more processed images. One or more optimized signal processing parameters may be determined based on the score of the object detection algorithm and the signal processing parameter. The one or more optimized signal processing parameters may be used to configure the ADV for use during autonomous driving.

Abstract: According to some embodiments, systems, methods, and media for operating an autonomous driving vehicle (ADV) encountered with small objects are described. According to a method, the ADV, when detecting an object in a lane in which the ADV is travelling, can determine whether the ADV can safely drive over the object based on attributes of the object and attributes of the ADV, and if so, can generate one or more planned trajectories that each enable the ADV to drive over the object. From the one or more planned trajectories, the ADV can select a planned trajectory that enables the ADV to drive over the object along the centerline of the ADV without causing the ADV to drive out of the lane. If no such planned trajectory exists, the ADV can bypass the object, or stop within a predetermined distance of the object.

Abstract: In one embodiment, a system configures an image signal processor (ISP) of an autonomous driving vehicle (ADV) with a first set of ISP configuration parameters, where the ISP is used to process raw image data of an image sensor of the ADV based on the first set of ISP configuration parameters. The system determines whether one or more criteria is satisfied, where the one or more criteria corresponds to an expected change in a characteristic of ambient light being perceived by the image sensor of the ADV. In response to determining that the one or more criteria is satisfied, the system configures the ISP of the ADV with a second set of ISP configuration parameters, where the ISP is used to apply an image processing algorithm to raw image data based on the second set of ISP configuration parameters to generate an image.

Abstract: The disclosure describes an autotuning framework for tuning an image signal processing (ISP) module of an autonomous driving vehicle (ADV). The autotuning framework can generate different sets of parameter values using a variety of optimization algorithms to configure the ISP module. Each processed image generated by the ISP module configured with the different sets of parameter values is compared by an ISP module testing device with a reference image stored therein to generate an objective core measuring one or more differences between each of the processed images and the reference image. The objective scores and the corresponding sets of parameter values are stored in a database. Different sets of optimal parameter values for different environments can be selected from the database, and uploaded to a cloud database for use by an ADV, which can select a different set of ISP parameter values based on an environment that the ADV is travelling in.

Abstract: In one embodiment, a system generates an image using either a first or a second image signal processing (ISP) algorithm, where the first or second ISP algorithm is applied to raw image data of a camera of an autonomous driving vehicle (ADV) to generate the image. The system applies a machine learning model to the image to identify a representation of an obstacle, where the machine learning model is generated by a few shots learning algorithm that contrasts labeled data of a positive training sample from images corresponding to the first and second ISP algorithms to labeled data of a negative training sample from images corresponding to the first and second ISP algorithm. The system determines a classification and a location of the obstacle based on the representation of the obstacle. The system plans a motion control of the ADV based on the classification and location of the detected object.

Abstract: A multiprocessor unit (MPU) in an autonomous driving vehicle (ADV) can provide hard real-time performance. In an embodiment, the MPU can include a hypervisor used to virtualize multiple cores of the MPU, which can further be partitioned into two sets of cores that are isolated from each other. The first set of cores are designated to run real-time related services as trusted applications directly on the hypervisor, and the real-time related services are given higher priority than kernel-level threads on the first set of cores. The second set of cores are designated to run a kernel of an operating system (e.g., Linux). Further, the kernel is patched using a hard real-time open source package to achieve hard real-time performance. An open source package can be used for interprocess communication (IPC) between different electronic control units (ECU) in the ADV.

Abstract: In one embodiment, a vehicle operating system (VOS) that can be partially ported to different types of microcontroller units (MCUs) includes at least one multiprocessor unit (MPU) with an operating system kernel running thereon, and at least one microcontroller unit (MCU) with multiple cores. Each core includes a set of unified application programming interfaces (APIs) for loading one or more MCU drivers corresponding to a type of the MCU, and one or more I/O drivers corresponding to a type of each of the one or more I/O devices associated with the MCU. The set of unified APIs includes at least one API for each service, and can vertically integrate a device path for the service from a hardware layer of the core to the service layer of the core. The VOS further includes multiple pairs of hardware-protected memories associated with each core to enable interprocess communication between the cores.

Abstract: According to some embodiments, systems, methods and media for operating an autonomous driving vehicles (ADV) in an unforeseen scenario are disclosed. In one embodiment, an exemplary method includes determining that the ADV has entered an unforeseen scenario; and identifying one or more surrounding vehicles that are navigating the unforeseen scenario. The method further includes generating a trajectory by mimicking driving behaviors of one or more of the one or more surrounding vehicles; and operating the ADV to follow the trajectory to navigate the unforeseen scenario.

Abstract: A system perceives an environment of an autonomous driving vehicle (ADV) based on a plurality of sensors and map data. The system determines an obstacle in the perceived environment to be a moving vehicle and the moving vehicle is to a left lane, to a right lane, or in front of the ADV. The system performs an inference on the obstacle using a neural network model to determine whether a behavior of the obstacle is anomalous. The system determines the obstacle is anomalous based on the performed inference.

Abstract: A system according to one embodiment includes a first antenna element configured to communicate a first signal, the first signal polarized in a first orientation; a second antenna element co-located with the first antenna element, the second antenna element configured to communicate a second signal, the second signal polarized in a second orientation, the second orientation orthogonal to the first orientation; and driver circuitry coupled to the first antenna element and the second antenna element, the driver circuitry configured to process the first signal and the second signal to achieve signal diversity in a wireless communication link.

Abstract: The present application discloses embodiments that relate to an electromagnetic apparatus. In one aspect, the present apparatus includes a circuit board configured to propagate an electromagnetic signal, a waveguide configured to propagate an electromagnetic signal, and a coupling port configured to couple the electromagnetic signal between the circuit board and the waveguide. The apparatus further includes a radiating structure disposed on the circuit board. The radiating structure includes an electric field coupling component configured to an electric field between the circuit board and the coupling port and a magnetic field coupling component configured to couple a magnetic field between the circuit board and the coupling port.

Abstract: The present application discloses embodiments that relate to an electromagnetic apparatus. In one aspect, the present apparatus includes a circuit board configured to propagate an electromagnetic signal, a waveguide configured to propagate an electromagnetic signal, and a coupling port configured to couple the electromagnetic signal between the circuit board and the waveguide. The apparatus further includes a radiating structure disposed on the circuit board. The radiating structure includes an electric field coupling component configured to an electric field between the circuit board and the coupling port and a magnetic field coupling component configured to couple a magnetic field between the circuit board and the coupling port.

Abstract: The present application discloses embodiments that relate to an electromagnetic apparatus. In one aspect, the present apparatus includes a circuit board configured to propagate an electromagnetic signal, a waveguide configured to propagate an electromagnetic signal, and a coupling port configured to couple the electromagnetic signal between the circuit board and the waveguide. The apparatus further includes a radiating structure disposed on the circuit board. The radiating structure includes an electric field coupling component configured to an electric field between the circuit board and the coupling port and a magnetic field coupling component configured to couple a magnetic field between the circuit board and the coupling port.

Abstract: A system according to one embodiment includes a first antenna element configured to communicate a first signal, the first signal polarized in a first orientation; a second antenna element co-located with the first antenna element, the second antenna element configured to communicate a second signal, the second signal polarized in a second orientation, the second orientation orthogonal to the first orientation; and driver circuitry coupled to the first antenna element and the second antenna element, the driver circuitry configured to process the first signal and the second signal to achieve signal diversity in a wireless communication link.

Abstract: The present application discloses embodiments that relate to an electromagnetic apparatus. In one aspect, the present apparatus includes a circuit board configured to propagate an electromagnetic signal, a waveguide configured to propagate an electromagnetic signal, and a coupling port configured to couple the electromagnetic signal between the circuit board and the waveguide. The apparatus further includes a radiating structure disposed on the circuit board. The radiating structure includes an electric field coupling component configured to an electric field between the circuit board and the coupling port and a magnetic field coupling component configured to couple a magnetic field between the circuit board and the coupling port.

Abstract: A system according to one embodiment includes a first antenna element configured to communicate a first signal, the first signal polarized in a first orientation; a second antenna element co-located with the first antenna element, the second antenna element configured to communicate a second signal, the second signal polarized in a second orientation, the second orientation orthogonal to the first orientation; and driver circuitry coupled to the first antenna element and the second antenna element, the driver circuitry configured to process the first signal and the second signal to achieve signal diversity in a wireless communication link.

Abstract: A system according to one embodiment includes a phased array antenna comprising a plurality of antenna elements, the plurality of antenna elements configured in a planar array, wherein each of the plurality of antenna elements generates a beam pattern directed at an angle out of the plane of the planar array; and driver circuitry coupled to each of the plurality of antenna elements, wherein the driver circuitry comprises a plurality of transceivers, the plurality of transceivers configured to provide independently adjustable phase delay to each of the plurality of antenna elements.

Abstract: A combined antenna device includes a coupled feed antenna including a first grounded coupling element and a millimeter wave phased array antenna having a ground plane structure including a portion of the first grounded coupling element.

Abstract: A computing device includes a body, the body having a first and second portion. The computing device further includes a directional antenna, the directional antenna transmitting a signal having a preferred direction, the directional antenna located in the first portion of the body. The computing device further includes a reflector for reflecting the signal, the reflector located in the second portion of the body, the body having a first configuration where the first portion is aligned with the second portion such that the preferred direction is not aligned to intersect the reflector, the body having a second configuration where the first portion is aligned with the second portion such that the preferred direction is aligned to intersect the reflector.