Abstract: A vehicle including a vehicle door, a detection unit and a vehicle processor is disclosed. The detection unit may be configured to detect an object presence in proximity to the vehicle and object information associated with an object. The vehicle processor may be configured to obtain the object information from the detection unit when the detection unit detects the object presence, and determine that the object may be approaching towards the vehicle door based on the object information. The vehicle processor may further output the object information to a user device responsive to determining that the object may be approaching towards the vehicle door.

Abstract: A method of performing a finishing operation on a surface of a component includes: acquiring, by a sensing system, an image of the surface of the component; retrieving a CAD model of the surface of the component; comparing the image of the surface of the component with the CAD model of the surface of the component; determining at least one target area on the surface of the component where a difference in a geometry between the image and the CAD model of the surface of the component exceeds a threshold; and displaying at least one visual overlay corresponding to the at least one target area on a real-world content or a virtual content.

Abstract: A vehicle including a head-up display (HUD), a transceiver and a detection unit is disclosed. The transceiver may be configured to receive vehicle information and information associated with a geographical area in which the vehicle may be located. The detection unit may be configured to detect a user eye gaze direction. The vehicle may further include a processor configured to obtain the vehicle information, the information associated with the geographical area and the user eye gaze direction responsive to obtaining a trigger signal. The processor may determine an object in the geographical area that a user may be viewing based on the vehicle information, the information associated with the geographical area and the user eye gaze direction. The processor may further render an object identifier associated with the object on the HUD till the vehicle travels past the object, responsive to determining the object.

Abstract: A vehicle for travelling on a roadway with a driver has a driver monitor, a head lamp system, and a controller. The driver monitor senses a driver gaze angle relative to a vehicle heading along the roadway and senses a driver head angle relative to the vehicle heading. The a headlamp system has a steerable headlamp configured to illuminate the roadway with a light beam along a selectable projection angle. The controller is configured to compare the driver gaze angle to a first threshold angle, determine a difference between the driver gaze angle and the driver head angle, and when the driver gaze angle is greater than the first threshold angle and the difference is less than a second threshold angle, then adjust the projection angle to a target angle based on the driver gaze angle.

Abstract: A set of training images are input into a neural network that outputs a pixel-wise phase matrix identifying pixels in the training images. Based on the pixel-wise phase matrix, a spatial light modulator (SLM) is actuated to output, onto a vehicle windshield, an augmented reality (AR) image including a plurality of sub-images each output in one of a plurality of focal planes. Each training image corresponds to one respective sub-image. A feedback image of the AR image is obtained via an image sensor. An offset is determined based on comparing the training images to the feedback image. Parameters of a loss function are updated based on the offset, and the updated parameters are provided to the neural network to obtain an updated offset.

Abstract: A computer includes a processor and memory, the memory can store instructions executable by the processor to display a first calibration symbol to appear at a first location of a virtual image plane viewable from a measured location of the eyes or head of an operator and display a second calibration symbol to appear at a second location of the virtual image plane according to an offset distance from the first location. The instructions additionally can additionally be to adjust the offset distance in response to adjusting the second location by receiving input from the operator to align the first calibration symbol with the second calibration symbol.

Abstract: In a rail detection system, a traveling mechanism and a horizontal moving mechanism move a detection device accurately to a position directly above a position to be detected by moving parallel to an extension direction of the rail. A vertical lifting mechanism is provided with the detection device, and can drive the detection device to lift up and down. A aligning mechanism is connected with the detection device, and includes a force-bearing mechanism and a follow-up mechanism. The force-bearing mechanism is configured to generate a force along a direction perpendicular to the extension direction of the rail when being in a non-aligned position. Under the condition of being forced, the follow-up mechanism makes an adaptive adjustment movement along the direction perpendicular to the extension direction of the rail so that the detection device is aligned with a center of the rail.

Abstract: A set of training images are input into a neural network that outputs a pixel-wise phase matrix identifying pixels in the training images. Based on the pixel-wise phase matrix, a spatial light modulator (SLM) is actuated to output, onto a vehicle windshield, an augmented reality (AR) image including a plurality of sub-images each output in one of a plurality of focal planes. Each training image corresponds to one respective sub-image. A feedback image of the AR image is obtained via an image sensor. An offset is determined based on comparing the training images to the feedback image. Parameters of a loss function are updated based on the offset, and the updated parameters are provided to the neural network to obtain an updated offset.

Abstract: Systems and methods for virtual vehicle parking assistance are disclosed herein. An example method includes determining a current vehicle position and vehicle dimensions of a vehicle, determining parking space dimensions of a parking space, receiving a desired parking position for the vehicle through an augmented reality interface, the augmented reality interface including a three-dimensional vehicle model based on the vehicle dimensions, the augmented reality interface being configured to allow a user to virtually place the three-dimensional vehicle model in the parking space to determine the desired parking position, determining a virtual parking procedure for the vehicle based on the desired parking position selected by the user and the parking space dimensions of a parking space and causing the vehicle to autonomously park based on the virtual parking procedure.

Abstract: A roadway complexity awareness system for a vehicle, comprising a processor, an augmented reality interface disposed in communication with the processor, and a memory for storing executable instructions. The processor is programmed to execute the instructions to receive roadway status information from an infrastructure processor associated with a roadway, obtain, from a vehicle sensory system, sensory information indicative of roadway route complexity, and determine a likelihood of roadway route complexity based on the roadway status information and the sensory information. The system may select an augmented reality message indicative of the roadway route complexity, and generate the augmented reality message using an augmented reality interface device, wherein the augmented reality message is visible to a vehicle operator.

Abstract: The disclosure generally pertains to systems and methods for providing a delivery assistance service having an augmented-reality digital companion (ARDC). In an example method, a first set of instructions can be received via the ARDC. The first set of instructions can direct a delivery driver to an assigned delivery vehicle within a parking lot. A second set of instructions including a driving destination can be received via the ARDC. When the delivery driver has reached the driving destination, a third set of instructions can be received via the ARDC. The third set of instructions can include a route from the driving destination to a delivery location. When the delivery driver is traveling along the route, first pop-up information can be provided via the ARDC. The delivery request can be completed, and second pop-up information can be provided via the ARDC to assist the delivery driver in reaching an intended destination.

Abstract: Methods and systems are presented for providing automated online chat assistance in multiple languages. A query in a first language is received via a chat robot from a user device. The query is machine-translated into a second language and transmitted to an artificial intelligence system that includes a dialog tree configured in the second language. The artificial intelligence system determines a response in the second language to the query by locating a node corresponding to an intent based on the query in the dialog tree. The node includes a node ID and response text in the second language. The artificial intelligence system transmits the second-language response including the node ID to the chat robot. The second-language response is intercepted, and first-language response text corresponding to the second-language response text is determined based on the node ID. The second-language response text is then provided to the user device by the chat robot.

Abstract: Systems and methods for virtual vehicle parking assistance are disclosed herein. An example method includes determining a current vehicle position and vehicle dimensions of a vehicle, determining parking space dimensions of a parking space, receiving a desired parking position for the vehicle through an augmented reality interface, the augmented reality interface including a three-dimensional vehicle model based on the vehicle dimensions, the augmented reality interface being configured to allow a user to virtually place the three-dimensional vehicle model in the parking space to determine the desired parking position, determining a virtual parking procedure for the vehicle based on the desired parking position selected by the user and the parking space dimensions of a parking space and causing the vehicle to autonomously park based on the virtual parking procedure.

Abstract: A method and system for providing integrated augmented reality (AR) images and content to multiple vehicle occupants having AR devices and methods of generating user-based AR expressions including content control of user generated content.

Abstract: A roadway complexity awareness system for a vehicle, comprising a processor, an augmented reality interface disposed in communication with the processor, and a memory for storing executable instructions. The processor is programmed to execute the instructions to receive roadway status information from an infrastructure processor associated with a roadway, obtain, from a vehicle sensory system, sensory information indicative of roadway route complexity, and determine a likelihood of roadway route complexity based on the roadway status information and the sensory information. The system may select an augmented reality message indicative of the roadway route complexity, and generate the augmented reality message using an augmented reality interface device, wherein the augmented reality message is visible to a vehicle operator.

Abstract: A User-centric Enhanced Pathway (UEP) system may provide vehicle pathway guidance while driving using an augmented reality display system in the event of sun glare. The system uses a route observer module programmed to predict sun glare, by obtaining real-time information about the interior and exterior vehicle environment, heading, speed, and other data. The route observer module may also use an inward-facing camera to determine when the driver is squinting, which may increase the probability function that predicts when the driver is experiencing sun glare. When sun glare is predicted, the route observer sends the weighted prediction function and input signals to a decision module that uses vehicle speed, location, and user activity to determine appropriate guidance output for an enhanced pathway using an Augmented Reality (AR) module. The AR module may adjust brightness, contrast, and color of the AR information based on observed solar glare.

Abstract: Gait, the walking pattern of individuals, is one of the most important biometrics modalities. Most of the existing gait recognition methods take silhouettes or articulated body models as the gait features. These methods suffer from degraded recognition performance when handling confounding variables, such as clothing, carrying and view angle. To remedy this issue, a novel AutoEncoder framework is presented to explicitly disentangle pose and appearance features from RGB imagery and a long short-term memory integration of pose features over time produces the gait feature.

Abstract: A User-centric Enhanced Pathway (UEP) system may provide vehicle pathway guidance while driving using an augmented reality display system in the event of sun glare. The system uses a route observer module programmed to predict sun glare, by obtaining real-time information about the interior and exterior vehicle environment, heading, speed, and other data. The route observer module may also use an inward-facing camera to determine when the driver is squinting, which may increase the probability function that predicts when the driver is experiencing sun glare. When sun glare is predicted, the route observer sends the weighted prediction function and input signals to a decision module that uses vehicle speed, location, and user activity to determine appropriate guidance output for an enhanced pathway using an Augmented Reality (AR) module. The AR module may adjust brightness, contrast, and color of the AR information based on observed solar glare.

Abstract: A method and system for providing integrated augmented reality (AR) images and content to multiple vehicle occupants having AR devices and methods of generating user-based AR expressions including content control of user generated content.

Abstract: Methods and systems are presented for providing automated online chat assistance in multiple languages. A query in a first language is received via a chat robot from a user device. The query is machine-translated into a second language and transmitted to an artificial intelligence system that includes a dialog tree configured in the second language. The artificial intelligence system determines a response in the second language to the query by locating a node corresponding to an intent based on the query in the dialog tree. The node includes a node ID and response text in the second language. The artificial intelligence system transmits the second-language response including the node ID to the chat robot. The second-language response is intercepted, and first-language response text corresponding to the second-language response text is determined based on the node ID. The second-language response text is then provided to the user device by the chat robot.