Abstract: An intelligent three dimensional scanner system mountable on a movable machine, including three dimensional scanner, a camera, and control circuitry. The control circuitry is configured to receive three dimensional point data from the three dimensional scanner, receive two dimensional image data from the camera, input the two dimensional image data to a machine learning model, which identifies objects in the two dimensional image data, fuse the three dimensional point data with the identified objects in the two dimensional image data in order to identify the objects in the three dimensional point data, and control a scan pattern to direct scanning resolution of the three dimensional scanner based on the identified objects.

Abstract: A vision system for assisting an operator of a machine is provided. An image capturing device, mounted on the machine, is configured to capture an image of an environment of the machine. The vision system includes a controller configured to apply an object detection process to detect an object in the image. The controller determines a bounding box comprising one or more pixels associated with the object. The controller determines a height and a range associated with the object based on the bounding box. The controller extracts the one or more pixels within the bounding box. The controller is further configured to generate a three-dimensional (3D) view comprising the object based on the image captured by the image capturing device. The controller reinserts the one or more pixels as a vertical pop-up element with respect to a ground plane in the 3D view. A display is provided to display the 3D view to the operator of the machine.

Abstract: A method for testing a perception system is disclosed. The method includes detecting, by a processor, one or more objects in a composite image, the composite image including a first image and at least a portion of a second image. A first set of objects are detected in the first image. Further, the method includes comparing, by the processor, a second set of objects of the one or more objects detected in the portion of the second image with a set of previously detected objects in the portion of the second image. Furthermore, the method includes validating, the performance of the processor in the detection of the first set of objects in the first image by ensuring the second set of objects detected in the at least a portion of a second image matches the set of previously detected objects in the portion of the second image.

Abstract: A vision system for assisting an operator of a machine is provided. An image capturing device, mounted on the machine, is configured to capture an image of an environment of the machine. The vision system includes a controller configured to apply an object detection process to detect an object in the image. The controller determines a bounding box comprising one or more pixels associated with the object. The controller determines a height and a range associated with the object based on the bounding box. The controller extracts the one or more pixels within the bounding box. The controller is further configured to generate a three-dimensional (3D) view comprising the object based on the image captured by the image capturing device. The controller reinserts the one or more pixels as a vertical pop-up element with respect to a ground plane in the 3D view. A display is provided to display the 3D view to the operator of the machine.

Abstract: A method for detecting an object in an environment of a machine is provided. The method includes determining a first height of the object by applying sliding window detection process on an image. The method determines a score indicating a probability that the object detected in the image matches a predefined set of characteristics. The method further includes determining a minimum and a maximum vertical pixel associated with the object. The method includes determining a second height of the object based on a range of the object, the minimum vertical pixel, the maximum vertical pixel, intrinsic and extrinsic calibration parameters of the image capturing device. The method includes comparing the first height with the second height and accordingly, modifying the score regarding the detection of the object in the image based on whether a difference between the first height and the second height meets a predetermined criterion.

Abstract: A method for testing a perception system is disclosed. The method includes detecting, by a processor, one or more objects in a composite image, the composite image including a first image and at least a portion of a second image. A first set of objects are detected in the first image. Further, the method includes comparing, by the processor, a second set of objects of the one or more objects detected in the portion of the second image with a set of previously detected objects in the portion of the second image. Furthermore, the method includes validating, the performance of the processor in the detection of the first set of objects in the first image by ensuring the second set of objects detected in the at least a portion of a second image matches the set of previously detected objects in the portion of the second image.

Abstract: A method of classifying a work machine within a worksite is provided. The method may include receiving one or more captured images of the work machine from one or more image capture devices, identifying at least two classifiers within the captured images of the work machine, determining spatial relationships between the classifiers within the captured images, determining a classification and a pose of the work machine based on the spatial relationships, and displaying analytics based on the classification and the pose of the work machine.

Abstract: A system for monitoring an implement of a work machine is provided. The system may include one or more image sensors mounted on the work machine configured to capture one or more images of a field of view associated with the implement, and an implement controller in electrical communication with the image sensors. The implement controller may be configured to receive the images from the image sensors, identify one or more interactive targets within the images, select one of the interactive targets based on proximity, and align the implement to the selected interactive target.

Abstract: A system for monitoring an implement of a work machine is provided. The system may include one or more image sensors mounted on the work machine configured to capture one or more images of a field of view associated with the implement, and an implement controller in electrical communication with the image sensors. The implement controller may be configured to receive the images from the image sensors, identify one or more interactive targets within the images, select one of the interactive targets based on proximity, and align the implement to the selected interactive target.

Abstract: A work tool recognition system for a work tool coupled to a machine is provided. The system includes an image capturing assembly configured to capture an image feed of the work tool. A controller is communicably coupled to the image capturing assembly. The controller receives the image feed of the work tool from the image capturing assembly. The controller extracts a plurality of features of the work tool from the image feed. The controller classifies the extracted image and determine a confidence value. The controller estimates a size of the work tool. The controller estimates a position and an orientation of the work tool. The controller determines verification features of the work tool and compares the image feed of the work tool with a predetermined dataset based on the classification. The controller identifies a type of the work tool based on the comparison.

Abstract: A work tool recognition system for a work tool coupled to a machine is provided. The system includes an image capturing assembly configured to capture an image feed of the work tool. A controller is communicably coupled to the image capturing assembly. The controller receives the image feed of the work tool from the image capturing assembly. The controller extracts a plurality of features of the work tool from the image feed. The controller classifies the extracted image and determine a confidence value. The controller estimates a size of the work tool. The controller estimates a position and an orientation of the work tool. The controller determines verification features of the work tool and compares the image feed of the work tool with a predetermined dataset based on the classification. The controller identifies a type of the work tool based on the comparison.

Abstract: A method of classifying a work machine within a worksite is provided. The method may include receiving one or more captured images of the work machine from one or more image capture devices, identifying at least two classifiers within the captured images of the work machine, determining spatial relationships between the classifiers within the captured images, determining a classification and a pose of the work machine based on the spatial relationships, and displaying analytics based on the classification and the pose of the work machine.

Abstract: The electromagnetic valve actuator of the preferred embodiments include a valve head that moves between an open position, a middle position, and a closed position; a plunger coupled to the valve head; and a housing defining a cavity that surrounds the plunger and contains a fluid. The cavity cooperates with the plunger and the fluid to provide increasing resistance as the valve head moves from the middle position to the closed position. Because of the increased resistance, the valve head softly seats against a valve seat, which minimizes noise, vibration, and harshness within the vehicle.

Abstract: A controller for controlling oxides of nitrogen (NOx) emissions from a combustion engine based on estimating a parameter for the engine. The controller capable of adjusting cylinder temperature based on the estimated parameter for controlling NOx emissions.

Abstract: A method for determining valve timing events to optimize operating parameters of an engine having a variable valve timing system over an entire operating range of the engine. The method includes setting combinations of intake valve opening and closing timing events and exhaust valve opening and closing timing events for a given engine speed. For each combination, a fuel conversion efficiency measure and an emissions measure of the engine at the given engine speed is obtained. Combinations which optimize a weighted cost function of the fuel conversion efficiency measure and the emission measure for a range of engine output torque settings at the given engine speed are then selected. This is repeated for each given engine speed across a range of engine speeds. A feed-forward map based on the selected combinations for the entire operating range of the engine is then assembled.

Abstract: A method for determining valve timing events to optimize operating parameters of an engine having a variable valve timing system over an entire operating range of the engine. The method includes setting combinations of intake valve opening and closing timing events and exhaust valve opening and closing timing events for a given engine speed. For each combination, a fuel conversion efficiency measure and an emissions measure of the engine at the given engine speed is obtained. Combinations which optimize a weighted cost function of the fuel conversion efficiency measure and the emission measure for a range of engine output torque settings at the given engine speed are then selected. This is repeated for each given engine speed across a range of engine speeds. A feed-forward map based on the selected combinations for the entire operating range of the engine is then assembled.

Abstract: The electromagnetic valve actuator of the preferred embodiments include a valve head that moves between an open position, a middle position, and a closed position; a plunger coupled to the valve head; and a housing defining a cavity that surrounds the plunger and contains a fluid. The cavity cooperates with the plunger and the fluid to provide increasing resistance as the valve head moves from the middle position to the closed position. Because of the increased resistance, the valve head softly seats against a valve seat, which minimizes noise, vibration, and harshness within the vehicle.