Abstract: In mobile equipment that is configured for remote operation there are the competing interests of minimizing the number and complexity of cameras by using wide-angle cameras, while avoiding the fisheye distortion inherent in wide-angle cameras, which can be disorienting to remote operators. Thus, a method is disclosed that switches between video processing configurations depending on a machine state of the mobile equipment. For example, a first machine state may represent that the mobile equipment is immobile, whereas a second machine state may represent that the mobile equipment is mobile. In the first machine state, the video configuration does not correct for fisheye distortion, so as to maximize the field of view in the video while the mobile equipment is immobile. In the second machine state, the video configuration does correct for fisheye distortion, so as to prevent disorientation of the remote operator while the mobile equipment is mobile.

Abstract: In panoramic video captured by a fisheye camera (e.g., for use in the remote operation of mobile equipment), there is a trade-off between the field of view and the level of distortion correction. In particular, to avoid the video from be disorienting, distortion correction is required. However, distortion correction applied to a very wide field of view results in an unnatural appearance of objects in edge regions, such that the image frames of the video must be cropped. A method is disclosed that varies the level of distortion correction that is applied to pixels in each image frame based on a position of those pixels in the image frame, such that less distortion correction is applied to pixels closer to edges of the image frame. This enables a very wild field of view, while preventing the unnatural appearance of objects near the edges of the image frame.

Abstract: The state and stability of a machine and a threshold value for an acceptable level of the stability of the machine are determined based on different potential machine states or operations. Sensor inputs including machine speed and whether the machine is in a coasting mode, lift height of a payload, an articulation angle of the machine, a pitch angle, and a roll angle of the machine are used to generate a model for estimating a time series of values for the degree of stability of the machine by solving a physics-based equation or retrieving data from a database.

Abstract: In a mobile equipment with an articulated front portion having a worktool, a fisheye camera with a wide field of view, containing the front portion, is often mounted in a fixed direction on a rear portion of the mobile equipment. Thus, when the front portion moves (e.g., rotates) relative to the rear portion, a view around the front portion may be compromised due to inherent cropping in fisheye-distortion correction. Digital panning of panoramic video is disclosed that rotates a projection surface, in accordance with movement of the front portion, and generates a projected video on the projection surface, utilizing information that may have otherwise been cropped, to expand the visible area around the worktool. The digital panning in the projected video may mimic an operator turning their head to look down the longitudinal axis of the front portion while using the worktool.

Abstract: The present disclosure is directed to systems and methods for managing on-site communications of a machine with a latency-dependent application installed. The method includes, for example, (i) receiving geographical information associated with a work site; (ii) receiving historical communications information associated with the work site; (iii) analyzing the historical communications information and the geographical information; (iv) generating an instruction for implementing the latency-dependent application of the machine based on a latency requirement of the latency-dependent application; and (v) implementing the latency-dependent application of the machine based on the instruction. The historical communications information includes a communications event, a duration of the communications event, and a frequency of the communications event.

Abstract: A mechanical machine can include one or more kinematic linkages having kinematic joints that movably couple first and second rigid links and can include an automatic lubrication system to lubricate the kinematic joints. In an aspect, the automatic lubrication system is configured to monitor operational aspects of the machine such as machine operational data and geometric position and to dynamically determine timing and/or quantity of lubricant to direct and introduce to the kinematic joints.

Abstract: A work machine control device including a memory and a processor is disclosed. The processor may be configured to receive work order data associated with a haul machine. The work order data may identify the haul machine, a material requested for the haul machine, an amount of the material requested for the haul machine, and/or a work machine associated with the material. The processor may be configured to set an operating parameter of the work machine to perform an operation according to the work order data, and receive payload data associated with a payload of the work machine. The payload data may relate to a weight of the payload, a volume of the payload, and/or an operating state of the work machine. The processor may be configured to determine productivity data associated with the operation, and cause an action to be performed in connection with the productivity data.

Abstract: The present disclosure is directed to systems and methods for managing on-site communications of a machine with a latency-dependent application installed. The method includes, for example, (i) receiving geographical information associated with a work site; (ii) receiving historical communications information associated with the work site; (iii) analyzing the historical communications information and the geographical information; (iv) generating an instruction for implementing the latency-dependent application of the machine based on a latency requirement of the latency-dependent application; and (v) implementing the latency-dependent application of the machine based on the instruction. The historical communications information includes a communications event, a duration of the communications event, and a frequency of the communications event.

Abstract: A work machine control device including a memory and a processor is disclosed. The processor may be configured to receive work order data associated with a haul machine. The work order data may identify the haul machine, a material requested for the haul machine, an amount of the material requested for the haul machine, and/or a work machine associated with the material. The processor may be configured to set an operating parameter of the work machine to perform an operation according to the work order data, and receive payload data associated with a payload of the work machine. The payload data may relate to a weight of the payload, a volume of the payload, and/or an operating state of the work machine. The processor may be configured to determine productivity data associated with the operation, and cause an action to be performed in connection with the productivity data.

Abstract: A computer implemented system and method for quarry and mining operation is configured to coordinate operation of a plurality of departing and arriving road trucks and loading machines. The road trucks may arrive and depart at a scale housing having a scale for weighing the trucks. The scale housing may be associated with a front end system that can communicate arrival and departure data with a backend system. The backend system can receive customer order data and generate job orders for the loading machines. The backend system can also associate the job orders with the arrival data upon arrival of the road truck.

Abstract: A work machine control device including a memory and a processor is disclosed. The processor may be configured to receive work order data associated with a haul machine. The work order data may identify the haul machine, a material requested for the haul machine, an amount of the material requested for the haul machine, and/or a work machine associated with the material. The processor may be configured to set an operating parameter of the work machine to perform an operation according to the work order data, and receive payload data associated with a payload of the work machine. The payload data may relate to a weight of the payload, a volume of the payload, and/or an operating state of the work machine. The processor may be configured to determine productivity data associated with the operation, and cause an action to be performed in connection with the productivity data.

Abstract: A method for retrofitting a plurality of position sensors on a machine includes installing the plurality of position sensors on the machine, wherein the position sensors include at least two inertial measurement units (IMUs). The method further includes calibrating orientation of the IMUs, obtaining measurements from the IMUs, determining relative differences between the measurements obtained from the IMUs, and processing the relative differences using a Kalman filter procedure to determine positional data of the machine.

Abstract: A system for controlling an earth moving machine may comprise: a speed sensor configured to communicate a speed signal indicative of a speed of the machine; an operator bucket lift command input configured to communicate an operator-input bucket lift command; and a controller configured to: receive the speed signal and the operator-input bucket lift command; determine a torque of the machine; using the speed signal and the determined torque, determine a controller-generated bucket lift command; and provide a bucket lift command which is the larger of the operator-input bucket lift command and the controller-generated bucket lift command.

Abstract: A method for retrofitting a plurality of position sensors on a machine includes installing the plurality of position sensors on the machine, wherein the position sensors include at least two inertial measurement units (IMUs). The method further includes calibrating orientation of the IMUs, obtaining measurements from the IMUs, determining relative differences between the measurements obtained from the IMUs, and processing the relative differences using a Kalman filter procedure to determine positional data of the machine.

Abstract: A system for controlling an earth moving machine may comprise: a speed sensor configured to communicate a speed signal indicative of a speed of the machine; an operator bucket lift command input configured to communicate an operator-input bucket lift command; and a controller configured to: receive the speed signal and the operator-input bucket lift command; determine a torque of the machine; using the speed signal and the determined torque, determine a controller-generated bucket lift command; and provide a bucket lift command which is the larger of the operator-input bucket lift command and the controller-generated bucket lift command.

Abstract: A system for controlling an operation of a machine is disclosed. The system includes an image capturing device and a controller. The image capturing device generates a signal indicative of a surrounding area of the machine. The controller is in communication with the image capturing device. The controller determines a preceding work cycle of the machine comprising a dig segment and determines a preceding segment associated with the preceding work cycle to be a dump segment. The controller further identifies a work aggregate within the surrounding area of the machine, when the preceding segment of the preceding work cycle is the dump segment. Further, the controller determines a distance between an implement of the machine and the work aggregate and issues a shift request to downshift a gear drive of a transmission system of the machine, if the distance is less than a predefined distance.

Abstract: A payload weight of a load of material carried by an implement of a machine may be estimated taking into account angular acceleration of the payload. A lift cylinder pressure differential and a lift arm angular acceleration may be determined as the implement is raised through a weigh range. An angular acceleration compensation factor may be determined from the lift arm angular acceleration, and a compensated differential pressure may be calculated by multiplying the lift cylinder pressure differential by the angular acceleration compensation factor. The estimated payload weight may then be determined based on the compensated pressure differential and a head end cross-sectional area of the lift cylinder.

Abstract: A payload weight of a load of material carried by an implement of a machine may be estimated taking into account angular acceleration of the payload. A lift cylinder pressure differential and a lift arm angular acceleration may be determined as the implement is raised through a weigh range. An angular acceleration compensation factor may be determined from the lift arm angular acceleration, and a compensated differential pressure may be calculated by multiplying the lift cylinder pressure differential by the angular acceleration compensation factor. The estimated payload weight may then be determined based on the compensated pressure differential and a head end cross-sectional area of the lift cylinder.

Abstract: A system for controlling an operation of a machine is disclosed. The system includes an image capturing device and a controller. The image capturing device generates a signal indicative of a surrounding area of the machine. The controller is in communication with the image capturing device. The controller determines a preceding work cycle of the machine comprising a dig segment and determines a preceding segment associated with the preceding work cycle to be a dump segment. The controller further identifies a work aggregate within the surrounding area of the machine, when the preceding segment of the preceding work cycle is the dump segment. Further, the controller determines a distance between an implement of the machine and the work aggregate and issues a shift request to downshift a gear drive of a transmission system of the machine, if the distance is less than a predefined distance.

Abstract: A system for controlling a movement of an implement during a dump operation is provided. The system includes a payload detection module associated with the implement. The payload detection module is configured to generate a signal indicative of a current weight of payload in the implement. The payload detection module determines the current weight of payload during a controlled lifting motion of the implement. The system also includes a control module communicably coupled to the payload detection module.