VEHICLE ADAS NOTIFICATION MUTING
A vehicle system including a vehicle including a chassis, a body assembly coupled to the chassis, a prime mover configured to generate mechanical energy to drive the vehicle, a lift assembly; and a vehicle control system including a sensor integrated into the body assembly. The vehicle control system is configured to receive sensor data from the sensor. The sensor data indicates a potential event. The vehicle control system is further configured to generate a notification associated with the potential event, receive control data indicating a state of the refuse vehicle, filter the sensor data through the control data to determine if the potential event is a false event associated with the state of the refuse vehicle or a true event associated with an external source, and mask the notification in response to a determination that the potential event is a false event.
Latest Oshkosh Corporation Patents:
This application claims the benefit of and priority to U.S. Provisional Application No. 63/325,943, filed on Mar. 31, 2022, the entire disclosure of which is hereby incorporated by reference herein.
BACKGROUNDThe present disclosure relates generally to vehicles. More specifically, the present disclosure relates to advanced driver assistance systems (ADAS) for vehicles.
SUMMARYAn embodiment relates to a system. The system includes a vehicle having a chassis, a body assembly coupled to the chassis, a prime mover configured to generate mechanical energy to drive the vehicle, a lift assembly, and a vehicle control system including a sensor integrated into the body assembly. The vehicle control system is configured to receive sensor data from the sensor. The sensor data can indicate a potential event. The vehicle control system is further configured to generate a notification associated with the potential event, receive control data indicating a state of the refuse vehicle, filter the sensor data through the control data to determine if the potential event is a false event associated with the state of the refuse vehicle or a true event associated with an external source, and silence the notification in response to a determination that the potential event is a false event.
An embodiment relates to a method. The method may be performed by a vehicle control system. The method includes receiving, sensor data indicating a potential event from a sensor, wherein the sensor is integrated into a body assembly coupled to a chassis of an vehicle comprising a prime mover configured to generate mechanical energy to drive the vehicle; and a lift assembly. The method includes generating a notification associated with the potential event. The method includes receiving control data indicating a state of the vehicle. The method includes filtering the sensor data through the control data to determine if the potential event is a false event associated with the state of the vehicle or a true event associated with an external source. The method includes masking the notification in response to a determination that the potential event is the false event.
An embodiment relates to a non-transitory computer-readable media. The computer-readable media includes instructions to receive sensor data indicating a potential event from a sensor; generate a notification associated with the potential event; receive control data indicating a state of a vehicle; filter the sensor data through the control data to determine if the potential event is a false event associated with the state of the vehicle or a true event associated with an external source; initiate a control action in response to the potential event, wherein the control action provides the notification to a user of the vehicle responsive to a determination that the potential event is the true event; and mask the notification in response to a determination that the potential event is the false event.
This summary is illustrative only and is not intended to be in any way limiting. Other aspects, inventive features, and advantages of the devices or processes described herein will become apparent in the detailed description set forth herein, taken in conjunction with the accompanying figures, wherein like reference numerals refer to like elements.
Before turning to the figures, which illustrate certain exemplary embodiments in detail, it should be understood that the present disclosure is not limited to the details or methodology set forth in the description or illustrated in the figures. It should also be understood that the terminology used herein is for the purpose of description only and should not be regarded as limiting.
In some ADAS systems, audio and visual notifications are provided whenever an external object or obstacle is detected near the vehicle. However, in many systems, there are both visual and audio notifications whenever a portion of the vehicle extends outward to perform a function (e.g., arm and/or grabber, extension, tailgate lift, etc.), which are a nuisance to the driver. In many cases, this is because there is no way of distinguishing between a movement and/or presence of a portion of the vehicle and an external object or obstacle. Accordingly, there is a need to mask such notifications when the vehicle performs a function that is known to otherwise provide a notification.
According to an exemplary embodiment, a vehicle (e.g., refuse truck, mixer vehicle, fire fighting vehicle, etc.) includes a vehicle control system configured to operate as an advanced driver-assistance system (ADAS). The ADAS system includes one or more sensors positioned in and around the vocational vehicle. In one embodiment, the sensors include a three hundred sixty degree camera system and a three hundred sixty degree radar system.
Overall VehicleReferring to
As shown in
In some embodiments, the front section 22 and the rear section 26 are configured as separate, discrete subframes (e.g., a front subframe and a rear subframe). In such embodiments, the front rail portion 30, the front rail portion 32, the rear rail portion 34, and the rear rail portion 36 are separate, discrete frame rails that are spaced apart from one another. In some embodiments, the front section 22 and the rear section 26 are each directly coupled to the middle section 24 such that the middle section 24 couples the front section 22 to the rear section 26.
Accordingly, the middle section 24 may include a structural housing or frame. In other embodiments, the front section 22, the middle section 24, and the rear section 26 are coupled to one another by another component, such as a body of the vehicle 10.
In other embodiments, the front section 22, the middle section 24, and the rear section 26 are defined by a pair of frame rails that extend continuously along the entire length of the vehicle 10. In such an embodiment, the front rail portion 30 and the rear rail portion 34 would be front and rear portions of a first frame rail, and the front rail portion 32 and the rear rail portion 36 would be front and rear portions of a second frame rail. In such embodiments, the middle section 24 would include a center portion of each frame rail.
In some embodiments, the middle section 24 acts as a storage portion that includes one or more vehicle components. The middle section 24 may include an enclosure that contains one or more vehicle components and/or a frame that supports one or more vehicle components. By way of example, the middle section 24 may contain or include one or more electrical energy storage devices (e.g., batteries, capacitors, etc.). By way of another example, the middle section 24 may include fuel tanks fuel tanks. By way of yet another example, the middle section 24 may define a void space or storage volume that can be filled by a user.
A cabin, operator compartment, or body component, shown as cab 40, is coupled to a front end portion of the chassis 20 (e.g., the front section 22 of the chassis 20). Together, the chassis 20 and the cab 40 define a front end of the vehicle 10. The cab 40 extends above the chassis 20. The cab 40 includes an enclosure or main body that defines an interior volume, shown as cab interior 42, that is sized to contain one or more operators. The cab 40 also includes one or more doors 44 that facilitate selective access to the cab interior 42 from outside of the vehicle 10. The cab interior 42 contains one or more components that facilitate operation of the vehicle 10 by the operator. By way of example, the cab interior 42 may contain components that facilitate operator comfort (e.g., seats, seatbelts, etc.), user interface components that receive inputs from the operators (e.g., steering wheels, pedals, touch screens, switches, buttons, levers, etc.), and/or user interface components that provide information to the operators (e.g., lights, gauges, speakers, etc.). The user interface components within the cab 40 may facilitate operator control over the drive components of the vehicle 10 and/or over any implements of the vehicle 10.
The vehicle 10 further includes a series of axle assemblies, shown as front axle 50 and rear axles 52. As shown, the vehicle 10 includes one front axle 50 coupled to the front section 22 of the chassis 20 and two rear axles 52 each coupled to the rear section 26 of the chassis 20. In other embodiments, the vehicle 10 includes more or fewer axles. By way of example, the vehicle 10 may include a tag axle that may be raised or lowered to accommodate variations in weight being carried by the vehicle 10. The front axle 50 and the rear axles 52 each include a series of tractive elements (e.g., wheels, treads, etc.), shown as wheel and tire assemblies 54. The wheel and tire assemblies 54 are configured to engage a support surface (e.g., roads, the ground, etc.) to support and propel the vehicle 10. The front axle 50 and the rear axles may include steering components (e.g., steering arms, steering actuators, etc.), suspension components (e.g., gas springs, dampeners, air springs, etc.), power transmission or drive components (e.g., differentials, drive shafts, etc.), braking components (e.g., brake actuators, brake pads, brake discs, brake drums, etc.), and/or other components that facilitate propulsion or support of the vehicle.
In some embodiments, the vehicle 10 is configured as an electric vehicle that is propelled by an electric powertrain system. Referring to
The batteries 60 may include one or more rechargeable batteries (e.g., lithium-ion batteries, nickel-metal hydride batteries, lithium-ion polymer batteries, lead-acid batteries, nickel-cadmium batteries, etc.). The batteries 60 may be charged by one or more sources of electrical energy onboard the vehicle 10 (e.g., solar panels, etc.) or separate from the vehicle 10 (e.g., connections to an electrical power grid, a wireless charging system, etc.). As shown, the drive motors 62 are positioned within the rear axles 52 (e.g., as part of a combined axle and motor assembly). In other embodiments, the drive motors 62 are otherwise positioned within the vehicle 10.
In other embodiments, the vehicle 10 is configured as a hybrid vehicle that is propelled by a hybrid powertrain system (e.g., a diesel/electric hybrid, gasoline/electric hybrid, natural gas/electric hybrid, etc.). According to an exemplary embodiment, the hybrid powertrain system may include a primary driver (e.g., an engine, a motor, etc.), an energy generation device (e.g., a generator, etc.), and/or an energy storage device (e.g., a battery, capacitors, ultra-capacitors, etc.) electrically coupled to the energy generation device. The primary driver may combust fuel (e.g., gasoline, diesel, etc.) to provide mechanical energy, which a transmission may receive and provide to the axle front axle 50 and/or the rear axles 52 to propel the vehicle 10. Additionally or alternatively, the primary driver may provide mechanical energy to the generator, which converts the mechanical energy into electrical energy. The electrical energy may be stored in the energy storage device (e.g., the batteries 60) in order to later be provided to a motive driver.
In yet other embodiments, the chassis 20 may further be configured to support non-hybrid powertrains. For example, the powertrain system may include a primary driver that is a compression-ignition internal combustion engine that utilizes diesel fuel.
Referring to
The application kit 80 may include various actuators to facilitate certain functions of the vehicle 10. By way of example, the application kit 80 may include hydraulic actuators (e.g., hydraulic cylinders, hydraulic motors, etc.), pneumatic actuators (e.g., pneumatic cylinders, pneumatic motors, etc.), and/or electrical actuators (e.g., electric motors, electric linear actuators, etc.). The application kit 80 may include components that facilitate operation of and/or control of these actuators. By way of example, the application kit 80 may include hydraulic or pneumatic components that form a hydraulic or pneumatic circuit (e.g., conduits, valves, pumps, compressors, gauges, reservoirs, accumulators, etc.). By way of another example, the application kit 80 may include electrical components (e.g., batteries, capacitors, voltage regulators, motor controllers, etc.). The actuators may be powered by components of the vehicle 10. By way of example, the actuators may be powered by the batteries 60, the drive motors 62, or the primary driver (e.g., through a power take off).
The vehicle 10 generally extends longitudinally from a front side 86 to a rear side 88. The front side 86 is defined by the cab 40 and/or the chassis. The rear side 88 is defined by the application kit 80 and/or the chassis 20. The primary, forward direction of travel of the vehicle is longitudinal, with the front side 86 being arranged forward of the rear side 88.
A. Front-Loading Refuse VehicleReferring now to
As shown in
As shown in
Referring now to
Referring still to
The grabber assembly 162 is movably coupled to a guide, shown as track 170, that extends vertically along a side of the refuse vehicle 100. Specifically, the main body 164 is slidably coupled to the track 170 such that the main body 164 is repositionable along a length of the track 170. An actuator (e.g., a hydraulic motor, an electric motor, etc.), shown as lift actuator 172, is configured to control movement of the grabber assembly 162 along the length of the track 170. In some embodiments, a bottom end portion of the track 170 is straight and substantially vertical such that the grabber assembly 162 raises or lowers a refuse container when moving along the bottom end portion of the track 170. In some embodiments, a top end portion of the track 170 is curved such that the grabber assembly 162 inverts a refuse container to dump refuse into the hopper volume 132 when moving along the top end portion of the track 170.
The lift assembly 160 further includes an actuator (e.g., a hydraulic cylinder, an electric linear actuator, etc.), shown as track actuator 174, that is configured to control lateral movement of the grabber assembly 162. By way of example, the track actuator 174 may be coupled to the chassis 20 and the track 170 such that the track actuator 174 moves the track 170 and the grabber assembly 162 laterally relative to the chassis 20. The track actuator 174 may facilitate repositioning the grabber assembly 162 to pick up and replace refuse containers that are spaced laterally outward from the refuse vehicle 100.
C. Concrete Mixer TruckReferring now to
As shown in
The mixing drum 232 may be configured to receive a mixture, such as a concrete mixture (e.g., cementitious material, aggregate, sand, etc.), through the hopper 236. In some embodiments, the mixer truck 200 includes an injection system (e.g., a series of nozzles, hoses, and/or valves) including an injection valve that selectively fluidly couples a supply of fluid to the inner volume of the mixing drum 232. By way of example, the injection system may be used to inject water and/or chemicals (e.g., air entrainers, water reducers, set retarders, set accelerators, superplasticizers, corrosion inhibitors, coloring, calcium chloride, minerals, and/or other concrete additives, etc.) into the mixing drum 232. The injection valve may facilitate injecting water and/or chemicals from a fluid reservoir (e.g., a water tank, etc.) into the mixing drum 232, while preventing the mixture in the mixing drum 232 from exiting the mixing drum 232 through the injection system. In some embodiments, one or more mixing elements (e.g., fins, etc.) may be positioned in the interior of the mixing drum 232, and may be configured to agitate the contents of the mixture when the mixing drum 232 is rotated in a first direction (e.g., counterclockwise, clockwise, etc.), and drive the mixture out through the chute 238 when the mixing drum 232 is rotated in a second direction (e.g., clockwise, counterclockwise, etc.). In some embodiments, the chute 238 may also include an actuator positioned such that the chute 238 may be selectively pivotable to position the chute 238 (e.g., vertically, laterally, etc.), for example at an angle at which the mixture is expelled from the mixing drum 232.
D. Fire TruckReferring now to
As shown in
As shown in
Referring now to
The application kit 80 includes a pump system 304 (e.g., an ultra-high-pressure pump system, etc.) positioned within one of the compartments 302 near the center of the ARFF truck 300. The application kit 80 further includes a water tank 310, an agent tank 312, and an implement or water turret, shown as monitor 314. The pump system 304 may include a high pressure pump and/or a low pressure pump, which may be fluidly coupled to the water tank 310 and/or the agent tank 312. The pump system 304 may to pump water and/or fire suppressing agent from the water tank 310 and the agent tank 312, respectively, to the monitor 314. The monitor 314 may be selectively reoriented by an operator to adjust a direction of a stream of water and/or agent. As shown in
Referring now to
As shown in
As shown in
The boom assembly 354 further includes a second actuator, shown as upper lift cylinder 366. The upper boom 362 is pivotally coupled (e.g., pinned) to the upper end of the lower boom 360 at a joint or upper boom pivot point. The upper lift cylinder 366 (e.g., a pneumatic cylinder, an electric linear actuator, a hydraulic cylinder, etc.) is coupled to the upper boom 362. The upper lift cylinder 366 may be configured to extend and retract to actuate (e.g., lift, rotate, elevate, etc.) the upper boom 362, thereby raising and lowering a distal end of the upper boom 362.
Referring still to
The platform assembly 370 provides a platform configured to support one or more operators or users. In some embodiments, the platform assembly 370 may include accessories or tools configured for use by the operators. For example, the platform assembly 370 may include pneumatic tools (e.g., an impact wrench, airbrush, nail gun, ratchet, etc.), plasma cutters, welders, spotlights, etc. In some embodiments, the platform assembly 370 includes a control panel (e.g., a user interface, a removable or detachable control panel, etc.) configured to control operation of the boom lift 350 (e.g., the turntable 352, the boom assembly 354, etc.) from the platform assembly 370 or remotely. In other embodiments, the platform assembly 370 is omitted, and the boom lift 350 includes an accessory and/or tool (e.g., forklift forks, etc.) coupled to the distal end of the boom assembly 354.
G. Scissor LiftReferring now to
As shown in
The cab 404 may include a series of subassemblies, shown as scissor layers 420, each including a pair of inner members and a pair of outer members pivotally coupled to one another. The scissor layers 420 may be stacked atop one another in order to form the cab 404, such that movement of one scissor layer 420 causes a similar movement in all of the other scissor layers 420. The scissor layers 420 extend between and couple the lift base 402 and an operator platform (e.g., the platform assembly 430). In some embodiments, scissor layers 420 may be added to, or removed from, the cab 404 in order to increase, or decrease, the fully extended height of the cab 404.
Referring still to
A distal or upper end of the cab 404 is coupled to an operator platform, shown as platform assembly 430. The platform assembly 430 may perform similar functions to the platform assembly 370, such as supporting one or more operators, accessories, and/or tools. The platform assembly 430 may include a control panel to control operation of the scissor lift 400. The lift actuators 424 may be configured to actuate the cab 404 to selectively reposition the platform assembly 430 between a lowered position (e.g., where the platform assembly 430 is proximate to the lift base 402) and a raised position (e.g., where the platform assembly 430 is at an elevated height relative to the lift base 402). Specifically, in some embodiments, extension of the lift actuators 424 moves the platform assembly 430 upward (e.g., extending the cab 404), and retraction of the lift actuators 424 moves the platform assembly 430 downward (e.g., retracting the cab 404). In other embodiments, extension of the lift actuators 424 retracts the cab 404, and retraction of the lift actuators 424 extends the cab 404.
External Object ADAS NotificationsAccording to an exemplary embodiment shown in
Refuse vehicle 10 is shown on a vehicle axis system with an x-axis 1002 and y-axis 1004 that follow the International Organization for Standardization (ISO) Road Vehicles—Vehicle Dynamics and road-holding ability—Vocabulary (ISO Standard No. 8855:2011) Vehicle Axis System 2.10 convention, published December 2012, the entirety of which is herein incorporated by reference. The x-axis 1002 is a horizontal axis parallel to the vehicle's heading and in the forward direction of the vehicle such that it is also parallel to refuse vehicle 10's longitudinal plane of symmetry. The y-axis 1004 is perpendicular to the x-axis 1002 and the refuse vehicle 10's longitudinal plane of symmetry and is in the left direction of the vehicle of refuse vehicle 10.
In some embodiments, the front camera 512 and the rear camera 514 are approximately positioned on the x-axis 1002 and at approximately the same height from the ground as the other cameras 510 such that the cameras all lie in the approximately same z-plane parallel to and above the xy-plane.
According to an exemplary embodiment shown in
The controller of the ADAS can detect one or more objects engaged with the refuse vehicle, such as via lift forks 146, grabber fingers 166, or the like. For example, the controller can store one or more predefined shapes, symbols, or other indicia of an object engaged with the refuse vehicle 10. The controller can store an outline or dimension of a refuse bin or dumpster, recognize an object engaged with the refuse vehicle, and determine that the detected object is not an obstacle. Thus a detection thereof may be labeled or masked as a false event. In some embodiments, the controller can receive a position of an element of the refuse vehicle 10, such as the position of the lift forks 146 or grabber fingers 166. The controller can infer a location of an object based on the location thereof. For example, upon an actuation of a front lift fork 146, the controller can mask all or a portion of a FOV of a front facing sensor (e.g., a camera FOV 520, radar FOV 620, or the like). A correlation between the objects (e.g., dumpsters) and the lift assembly may include a determination that the detect object is engaged with or otherwise related to the lift assembly.
According to an exemplary embodiment, radar system 600 includes two radar sensors 610 positioned on the front of cab 40 and positioned to be forward facing. In some embodiments, two radar sensors 610 are positioned on the front corners of cab 40 and positioned outward, with a bias towards facing towards the rear of refuse vehicle 10. In some embodiments, two radar sensors 610 are positioned behind the cab 40 in a lower battery box area. Application kit 80 may also include on or more radar sensors 610. In some embodiments, two radar sensors 610 integrated into the rear of application kit 80 and positioned to face outward are configured to detect obstacles behind the refuse vehicle 10. Still in some embodiments, two radar sensors 610 can be integrated into the rear corners of application kit 80 and positioned to face an approximately 45 degree angle to the radar sensors 610 positioned to face behind the refuse vehicle 10. While certain radar sensors 610 are shown in the configuration described above, it should be understand that the number and position of radar sensors 610 in radar system 600 may vary without department from the scope of the invention. For example, radar system 600 may only include front-facing and rear-facing radar sensors 610.
As shown in
Referring now to
In some embodiments, process 1600 includes providing a refuse vehicle including an ADAS system having one or more sensors and one or more controllable elements (step 1602). Controllable elements may be the same or similar to the lift assembly 140. Further, controllable elements may include the lift assembly 160, the chute 238, the outriggers 252, the ladder assembly 254, the monitor 264, the monitor 314, the boom assembly 354, and/or the cab 404. It should be appreciated that the controllable elements may further include a prime mover, steering components, power transmission or driver components, braking components, lift assemblies, electric actuators, hydraulic actuators, electric motors, systems, subsystems, assemblies, and/or any other components of refuse vehicle 10 controllable by an operator. In some embodiments, provided sensor can be the same or similar to sensors 610. In some embodiments, the sensors can include 360° system 500, radar system 600, and collision detection system.
In some embodiments, process 1600 includes obtaining data from the one or more sensors and the one or more controllable elements relating to a detected event (step 1604). In some embodiments, the data obtained includes sensor data and/or control data. The sensor data can include image data, proximity data, and or other types of data such as a direction of travel, speed, or acceleration of detected objects. The control data can include the position, direction of movement, speed, and/or acceleration of lift assembly 140 or other vehicle portions. Elements of the control data referring to a current or previous condition of the vehicle 10 can be referred to herein as a state of the vehicle 10. The control data may include a list of past control signals provided to lift assembly 140. In some embodiments, the data is obtained from the one or more sensors in network communication (e.g., via a wired or wireless network). For example, the network can include an Ethernet connection. The sensors may include cameras 510 and radar sensors 610. The sensors can all be connected to the network for transmitting information to a controller. The network may include Ethernet connections employing copper or coax lines (e.g., differential twisted pairs). In some embodiments, the network employs fiber-optic lines. In some embodiments, the detected event is the presence of an obstacle. For example, the cameras 510 may detect the event or the controller may generate the event responsive to image data received by the cameras and conveyed to the controller. Various sensor data relating to the event may be provided to the controller. The controller may provide an indication of the event or information relevant to the event (e.g., a time, direction, speed, or the like) to a user of the lift device via a notification generated by one or more control signals, as discussed in greater detail below in regard to step 1614. In some instances, the detected event is the operation of the lift assembly 140 detected by the sensors (for example, the cameras 510). It may be advantageous to mask a notification in such instances that would otherwise be provided to the user of the lift device that would otherwise be generated. For example, the user may already be aware of lift assembly movements they are controlling. The detected event may be correlated with the control data. For example, the control data can include the data received from one or more controllable elements at the time the sensor data indicated the presence of the obstacle. In some embodiments, the detected event may be based on a user input. For example, the detected event can be a movement of a joystick of the user interface referenced above with regard to
In some embodiments, the lift assembly 140 or other vehicle portion may obscure a detection zone of a sensor (e.g., a field of view of a camera 510) such that the sensor cannot monitor a portion of the vehicle surrounding the refuse vehicle 10. According to some implementations, another sensor of a same or different type may monitor a relevant detection zone. For example, a front loading refuse vehicle 10 raising a refuse container can obscure a FOV of a front facing camera 512 of the refuse vehicle. Another sensor, such as a front facing emitter or sensor 610 of a radar system 610 may monitor the obscured zone. For example, the radar sensor 610 can be mounted lower on the refuse vehicle 10 such that the radar sensor 610, in combination with the front facing camera 512, can continuously monitor the detection zone or a portion thereof. In some implementations, the combination of vehicle sensors may not monitor the detection zone or a portion thereof. For example, the refuse container of the previous example can obscure one or more sensors such that the ADAS can determine that the sensors are blocked by a portion of the refuse vehicle 10, but may not detect an obstacle beyond the refuse container. The controller can determine whether or how to mask a notification based on a determination that the ADAS may not detect an obstacle. For example, the ADAS can delay or fail to mask the notification, partially mask the notification, provide another indication of a non-operation of the ADAS, etc. In some embodiments the controller can determine that a detection zone is unobscured upon a failure of any sensor to detect their respective portion thereof (e.g., to preserve redundancy). In some embodiments, the controller can determine that a detection zone is unobscured upon a failure of every sensor, or a portion of sensors (e.g., to increase ADAS availability).
The controller can mask a notification based on an operational status of the refuse vehicle. An operational status can include a vehicle speed, gear selection, occupancy, brake status, or throttle of the refuse vehicle 10. For example, the controller can mask a notification when the vehicle is stationary, when the brake is applied, or when the a gear selector is placed in park. Like other portions of the present disclosure, the operational status can be employed in combination with aspects provided herein. For example, the controller can determine whether or how to mask a notification based on the operational status in combination with an obscured sensor (e.g., where at least one sensor is obscured and the refuse vehicle is stationary, the controller may mask a notification).
In some embodiments, process 1600 includes filtering the sensor data through the control data (step 1606) for the purpose of muting notifications. The controller may be configured to filter the sensor data through the vehicle control data to identify, remove, and/or tag false events from the sensor data that would otherwise be provided to a user of the vehicle 10 as a notification. False notifications may be instances of sensor data that appear to indicate one or more objects are present around refuse vehicle 10, but actually are due to refuse vehicle 10 itself and/or one or more of its components, or an element interfacing therewith (e.g., a refuse container engaged with lift forks 146 of the refuse vehicle 10). The filter process can include using the control data to identify the position of one or more components of refuse vehicle 10 and comparing that position to the detected object in the sensor data. Sensor data observations that align with control data can be filtered out as false notifications. For example, the cab 40 may interface with the lift assembly 140 in front of refuse vehicle 10. Forward radar can detect lift assembly 140 as an object and provide sensor data to controller indicating the positon, direction of movement, speed, and/or acceleration of the object. Controller can also receive control data indicating that lift assembly 140 is interfaced with the refuse vehicle and the arms of cab 40 are lowered. If the sensor data is not filtered, controller may analyze the sensor data determine an object is present. If the sensor data is filtered through the control data, controller can compare the filter sensor data and the control data and determine the sensor data is a false event due to the lift assembly 140, and that no external object is present. Accordingly, the controller can mask the notification that would otherwise be provided as a detection of an external object.
In some embodiments, process 1600 includes checking if the event is a false event (step 1608). In some embodiments, if a false event is detected, the sensor data the notification is based on may be masked (e.g., removed, tagged, ignored, and/or adjusted by controller). For example, during the filtering process, controller can tag all sensor data that is determined to be due to one or more components of refuse vehicle 10 based on the control data as false event data, and mask (e.g., suppress or append) one or more control signals based on the false event data, therefore muting the notification that would otherwise occur. In some embodiments, if the event is determined to be a false event, the controller masks the notification and the process 1600 proceeds to step 1616 and ends. In other embodiments, if the event is determined to be a false event, the controller partially masks the notification and the process 1600 proceeds to step 1618 as described in greater detail below. In some embodiments, if the event is determined not to be a false event, process 1600 includes proceeding to step 1610.
In some embodiments, process 1600 includes generating, via a user interface, a notification based on the sensor data (step 1610). The notification may be a visual notification via a display (i.e., instrument display, console display) located within the cab 40, and/or an auditory notification via notification a device in the cab 40. The systems and methods herein can employ speakers, bells, air horns, relays, and other audio output devices used in vehicle systems to generate the audible signals. In some embodiments, the notification includes a recommended control action for a user to perform. For example, ADAS via radar system 600 including radar sensors 610 may detect a vehicle in a blind spot of refuse vehicle 10. Controller can generate a notification to a driver indicating the presence of the vehicle. For another example, the refuse vehicle 10 is stopped, and ADAS senses fast approaching objects from the rear of refuse vehicle 10. Controller can generate visual, audible, and/or haptic notifications that are apparent from outside of refuse vehicle 10 and/or the notifications themselves are external refuse vehicle 10 to notification those around refuse vehicle 10 of the approaching objects. In some embodiments, the notifications are audible natural language based notifications. Audible natural language based notifications can explain with language (according to a user preference for example) the content of the notification. For example, the notification may include an audible natural language based notification saying “Vehicle in blind spot.” Natural language based notifications allow a user to understand what a notification is for without any other supplemental information. In some embodiments, the notifications can indicate information about refuse vehicle 10. For example, notifications may include a tire pressure of refuse vehicle 10 while operating.
In some embodiments, process 1600 includes checking if the notification is cleared (step 1612). For example, a user may clear a notification via a user input in user interface. Notifications may also be cleared automatically by controller. In some embodiments, controller automatically clears notifications if the underlying event that triggered the notification is no longer detected. For example, a notification of a car in a blind spot of refuse vehicle 10 may persist so long as the car is in the blind spot. Once the car leaves the blind spot, controller may automatically clear the notification. In some embodiments, if the notification is cleared, process 1600 proceeds to step 1616 and ends. In some embodiments, if the notification is not cleared, process 1600 proceeds to step 1614.
In some embodiments, process 1600 includes generating one or more control signals based on the sensor data and control data. Controller can be configured to generate control signals based on the sensor data and control data in response to a true event (i.e., not a false event). Control signals may be commands to operate refuse vehicle 10 and/or one or more components of refuse vehicle 10. For example, sensor data indicate a vehicle ahead of refuse vehicle 10, and control data may indicate refuse vehicle 10 is traveling at a sufficient speed that it will collide with the vehicle if the speed is not diminished. Controller can provide a clearable notification a driver of the vehicle. If the clearable notification is not cleared (i.e., before a time threshold, wherein the time threshold is the point in time determined by controller where action must be taken to avoid a collision), controller can generate control signals to activate the brakes of refuse vehicle 10 and prevent the collision. In some embodiments, the control signals may also control components of refuse vehicle 10 including actuators, motors, lift assemblies, etc. In some embodiments, process 1600 skips steps 1610 and 1612, as described above in regards to muting notifications, and proceeds directly to generating one or more control signals via at 1618. For example, the controller may be configured to provide a visual warning instead of both an audio and visual notification on the user interface in the event that the event is determined to be a false event, rather than muting the notification entirely and proceeding directly to step 1616. In this sense, a notification that is determined to be a false event may be partially masked to be less obtrusive to a user of the vehicle 10, while also providing awareness via the visual aspect of the notification. In other embodiments, Controller can be configured to automatically generate one or more control signals in emergencies where there is not enough time to generate a notification and wait for the clearable notification to be cleared. For example, controller may determine that a control action such as emergency braking should be taken immediately in order to avoid an accident. In some embodiments, after generating the control signals process 1600 proceeds to step 1616 and ends.
As utilized herein, the terms “approximately,” “about,” “substantially”, and similar terms are intended to have a broad meaning in harmony with the common and accepted usage by those of ordinary skill in the art to which the subject matter of this disclosure pertains. It should be understood by those of skill in the art who review this disclosure that these terms are intended to allow a description of certain features described and claimed without restricting the scope of these features to the precise numerical ranges provided. Accordingly, these terms should be interpreted as indicating that insubstantial or inconsequential modifications or alterations of the subject matter described and claimed are considered to be within the scope of the disclosure as recited in the appended claims.
It should be noted that the term “exemplary” and variations thereof, as used herein to describe various embodiments, are intended to indicate that such embodiments are possible examples, representations, or illustrations of possible embodiments (and such terms are not intended to connote that such embodiments are necessarily extraordinary or superlative examples).
The term “coupled” and variations thereof, as used herein, means the joining of two members directly or indirectly to one another. Such joining may be stationary (e.g., permanent or fixed) or moveable (e.g., removable or releasable). Such joining may be achieved with the two members coupled directly to each other, with the two members coupled to each other using a separate intervening member and any additional intermediate members coupled with one another, or with the two members coupled to each other using an intervening member that is integrally formed as a single unitary body with one of the two members. If “coupled” or variations thereof are modified by an additional term (e.g., directly coupled), the generic definition of “coupled” provided above is modified by the plain language meaning of the additional term (e.g., “directly coupled” means the joining of two members without any separate intervening member), resulting in a narrower definition than the generic definition of “coupled” provided above. Such coupling may be mechanical, electrical, or fluidic.
References herein to the positions of elements (e.g., “top,” “bottom,” “above,” “below”) are merely used to describe the orientation of various elements in the FIGURES. It should be noted that the orientation of various elements may differ according to other exemplary embodiments, and that such variations are intended to be encompassed by the present disclosure.
The hardware and data processing components used to implement the various processes, operations, illustrative logics, logical blocks, modules and circuits described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose single- or multi-chip processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, or, any conventional processor, controller, microcontroller, or state machine. A processor also may be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. In some embodiments, particular processes and methods may be performed by circuitry that is specific to a given function. The memory (e.g., memory, memory unit, storage device) may include one or more devices (e.g., RAM, ROM, Flash memory, hard disk storage) for storing data and/or computer code for completing or facilitating the various processes, layers and modules described in the present disclosure. The memory may be or include volatile memory or non-volatile memory, and may include database components, object code components, script components, or any other type of information structure for supporting the various activities and information structures described in the present disclosure. According to an exemplary embodiment, the memory is communicably connected to the processor via a processing circuit and includes computer code for executing (e.g., by the processing circuit or the processor) the one or more processes described herein.
The present disclosure contemplates methods, systems and program products on any machine-readable media for accomplishing various operations. The embodiments of the present disclosure may be implemented using existing computer processors, or by a special purpose computer processor for an appropriate system, incorporated for this or another purpose, or by a hardwired system. Embodiments within the scope of the present disclosure include program products comprising machine-readable media for carrying or having machine-executable instructions or data structures stored thereon. Such machine-readable media can be any available media that can be accessed by a general purpose or special purpose computer or other machine with a processor. By way of example, such machine-readable media can comprise RAM, ROM, EPROM, EEPROM, or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor. Combinations of the above are also included within the scope of machine-readable media. Machine-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing machines to perform a certain function or group of functions.
Although the figures and description may illustrate a specific order of method steps, the order of such steps may differ from what is depicted and described, unless specified differently above. Also, two or more steps may be performed concurrently or with partial concurrence, unless specified differently above. Such variation may depend, for example, on the software and hardware systems chosen and on designer choice. All such variations are within the scope of the disclosure. Likewise, software implementations of the described methods could be accomplished with standard programming techniques with rule-based logic and other logic to accomplish the various connection steps, processing steps, comparison steps, and decision steps.
It is important to note that the construction and arrangement of the vehicle 10 and the systems and components thereof as shown in the various exemplary embodiments is illustrative only. Additionally, any element disclosed in one embodiment may be incorporated or utilized with any other embodiment disclosed herein. Although only one example of an element from one embodiment that can be incorporated or utilized in another embodiment has been described above, it should be appreciated that other elements of the various embodiments may be incorporated or utilized with any of the other embodiments disclosed herein.
Claims
1. A system comprising:
- a vehicle comprising: a chassis; a body assembly coupled to the chassis; a prime mover configured to generate mechanical energy to drive the vehicle; and a lift assembly; and
- a vehicle control system comprising a sensor integrated into the body assembly, the vehicle control system is configured to: receive sensor data from the sensor, the sensor data indicating a potential event; generate a notification associated with the potential event; receive control data indicating a state of the vehicle; filter the sensor data through the control data to determine if the potential event is a false event associated with the state of the vehicle or a true event associated with an external source; initiate a control action in response to the potential event, wherein the control action provides the notification to a user of the vehicle responsive to a determination that the potential event is the true event; and mask the notification in response to a determination that the potential event is the false event.
2. The system of claim 1, wherein
- the sensor data comprises an indication of a portion of the vehicle undergoing displacement relative to the chassis and an object external to the vehicle; and
- the vehicle control system is configured to: determine a correlation between the object external to the vehicle with the portion of the vehicle undergoing displacement; and mask the notification responsive to the determination of the correlation.
3. The system of claim 1, wherein the sensor includes:
- a radar system comprising at least one radar sensor; and
- a camera system comprising at least one forward facing camera disposed vertically above the radar sensor.
4. The system of claim 3, wherein each sensor is in network communication with a user interface comprising an audio output device disposed in a cab of the vehicle.
5. The system of claim 1, wherein to mask the notification, the vehicle control system is configured to:
- mask an audible output of the notification; and
- maintain a visual output of the notification.
6. The system of claim 1, wherein the control system is configured to predict the potential event based on a position, direction of travel, and speed of a detected object.
7. The system of claim 1, wherein the control data comprises an indication of a movement or a position of the lift assembly.
8. A method, comprising:
- receiving, by a vehicle control system, sensor data indicating a potential event from a sensor, wherein the sensor is integrated into a body assembly coupled to a chassis of a vehicle comprising: a prime mover configured to generate mechanical energy to drive the vehicle; and a lift assembly;
- generating, by the vehicle control system, a notification associated with the potential event;
- receiving, by the vehicle control system, control data indicating a state of the vehicle; and
- filtering, by the vehicle control system, the sensor data through the control data to determine if the potential event is a false event associated with the state of the vehicle or a true event associated with an external source; and
- masking, by the vehicle control system, the notification in response to a determination that the potential event is the false event.
9. The method of claim 8, further comprising:
- determining a correlation between an object external to the vehicle with a portion of the vehicle undergoing displacement;
- masking the notification responsive to the determination of the correlation, wherein the sensor data comprises an indication of the portion of the vehicle undergoing displacement relative to the chassis; and
- the sensor data comprises an indication of the object external to the vehicle.
10. The method of claim 8, wherein the sensor includes:
- a radar system comprising at least one radar sensor; and
- a camera system comprising at least one forward facing camera disposed vertically above the radar sensor.
11. The method of claim 10, wherein each sensor is in network communication with a user interface comprising an audio output device disposed in a cab of the vehicle.
12. The method of claim 8, further comprising:
- masking an audible output of the notification; and
- maintaining a visual output of the notification.
13. The method of claim 8, wherein the potential event is predicted based on a position, direction of travel, and speed of a detected object.
14. The method of claim 8, wherein the control data comprises an indication of a movement or a position of the lift assembly.
15. A non-transitory computer-readable media, comprising instructions stored thereon that, when executed by one or more processors, cause the one or more processors to:
- receive sensor data indicating a potential event from a sensor;
- generate a notification associated with the potential event;
- receive control data indicating a state of a vehicle;
- filter the sensor data through the control data to determine if the potential event is a false event associated with the state of the vehicle or a true event associated with an external source;
- initiate a control action in response to the potential event, wherein the control action provides the notification to a user of the vehicle responsive to a determination that the potential event is the true event; and
- mask the notification in response to a determination that the potential event is the false event.
16. The computer-readable media of claim 15, wherein the instructions include instructions to:
- determine a correlation between an object external to the vehicle with a portion of the vehicle undergoing displacement; and
- mask the notification responsive to the determination of the correlation, wherein: the sensor data comprises an indication of the portion of the vehicle undergoing displacement relative to a chassis of the vehicle; and the sensor data comprises an indication of the object external to the vehicle.
17. The computer-readable media of claim 15, wherein the sensor includes:
- a radar system comprising at least one radar sensor; and
- a camera system comprising at least one forward facing camera disposed vertically above the radar sensor.
18. The computer-readable media of claim 15, wherein, to mask the notification, the instructions cause the one or more processors to:
- mask an audible output of the notification; and
- maintain a visual output of the notification.
19. The computer-readable media of claim 15, wherein the instructions cause the one or more processors to predict the potential event based on a position, direction of travel, and speed of a detected object.
20. The computer-readable media of claim 15, wherein the control data comprises an indication of a movement or a position of a lift assembly of the vehicle.
Type: Application
Filed: Feb 17, 2023
Publication Date: Oct 5, 2023
Applicant: Oshkosh Corporation (Oshkosh, WI)
Inventors: Brendan Chan (Oshkosh, WI), Amanda Miller (Oshkosh, WI), Jon Zeamer (Oshkosh, WI), Justin Neils (Oshkosh, WI)
Application Number: 18/111,116