Patents by Inventor Joshua Herbach
Joshua Herbach has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240125619Abstract: Aspects of the disclosure relate to generating scouting objectives in order to update map information used to control a fleet of vehicles in an autonomous driving mode. For instance, a notification from a vehicle of the fleet identifying a feature and a location of the feature may be received. A first bound for a scouting area may be identified based on the location of the feature. A second bound for the scouting area may be identified based on a lane closest to the feature. A scouting objective may be generated for the feature based on the first bound and the second bound.Type: ApplicationFiled: December 11, 2023Publication date: April 18, 2024Inventors: Katharine Patterson, Joshua Herbach, David Silver, David Margines
-
Publication number: 20240043038Abstract: Example embodiments relate to using remote assistance to maneuver an autonomous vehicle to a location. A computing device used by a remote operator may receive a request for assistance from a vehicle that indicates the vehicle is stopped at a first location with one or more navigation options for enabling the vehicle to navigate from the first location to a second location. At least one navigation option includes a maneuver technique that requires operator approval prior to execution. The computing device may then display a graphical user interface (GUI) that conveys the one or more navigation options. Based on detecting a selection of a particular navigation option, the computing device may transmit instructions to the vehicle to perform the particular navigation option. The vehicle may configured to navigate from the first location to the second location by performing the particular navigation option while monitoring for changes in the environment.Type: ApplicationFiled: October 5, 2023Publication date: February 8, 2024Inventors: Ioan-Alexandru Sucan, Joshua Herbach, Collin Winter
-
Patent number: 11892842Abstract: Example implementations relate to vehicle occupancy confirmation. An example implementation involves receiving, at a computing system from a camera positioned inside a vehicle, an image representing an occupancy within the vehicle. The implementation further involves, responsive to receiving the image, displaying the image on a display interface, and receiving an operator input confirming the occupancy meets a desired occupancy. The implementation additionally includes transmitting an occupancy confirmation from the computing system to the vehicle. In some instances, in response to receiving the occupancy confirmation, the vehicle executes an autonomous driving operation.Type: GrantFiled: October 27, 2021Date of Patent: February 6, 2024Assignee: Waymo LLCInventor: Joshua Herbach
-
Patent number: 11885639Abstract: Aspects of the disclosure relate to generating scouting objectives in order to update map information used to control a fleet of vehicles in an autonomous driving mode. For instance, a notification from a vehicle of the fleet identifying a feature and a location of the feature may be received. A first bound for a scouting area may be identified based on the location of the feature. A second bound for the scouting area may be identified based on a lane closest to the feature. A scouting objective may be generated for the feature based on the first bound and the second bound.Type: GrantFiled: August 10, 2020Date of Patent: January 30, 2024Assignee: Waymo LLCInventors: Katharine Patterson, Joshua Herbach, David Silver, David Margines
-
Patent number: 11814078Abstract: Example embodiments relate to using remote assistance to maneuver an autonomous vehicle to a location. A computing device used by a remote operator may receive a request for assistance from a vehicle that indicates the vehicle is stopped at a first location with one or more navigation options for enabling the vehicle to navigate from the first location to a second location. At least one navigation option includes a maneuver technique that requires operator approval prior to execution. The computing device may then display a graphical user interface (GUI) that conveys the one or more navigation options. Based on detecting a selection of a particular navigation option, the computing device may transmit instructions to the vehicle to perform the particular navigation option. The vehicle may configured to navigate from the first location to the second location by performing the particular navigation option while monitoring for changes in the environment.Type: GrantFiled: November 30, 2022Date of Patent: November 14, 2023Assignee: Waymo LLCInventors: Ioan-Alexandru Sucan, Joshua Herbach, Collin Winter
-
Patent number: 11755029Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating in a rewind mode. In the rewind mode, the system may be configured to provide information to a remote assistance operated based on a remote-assistance triggering criteria being met, such as a detected object having a low detection confidence. When the triggering criteria is met, the remote assistance system may provide data from the time leading up to when the remote-assistance triggering criteria was met that was capture of the environment of autonomous vehicle to the remote assistance operator. Based on viewing the data, the remote assistance operator may provide and input to the system that causes a command to be issued to the autonomous vehicle.Type: GrantFiled: October 1, 2020Date of Patent: September 12, 2023Assignee: Waymo LLCInventor: Joshua Herbach
-
Patent number: 11725954Abstract: Aspects of the disclosure relate to pre-computing routes for autonomous vehicles using map shards. For example, a shard from a plurality of shards of a map may be selected. Each shard including a plurality of nodes and edges connecting pairs of nodes of the plurality of nodes, and each node of the plurality represents a location. A plurality of port nodes for the shard are identified. Each port node has an edge that enters into the selected shard or exists the selected shard. For each port node of the plurality having an edge that enters into the selected shard, optimal routes to each other port node of the plurality having an edge that exits the selected shard may be determined. The optimal routes for the selected shard may be sent to the autonomous vehicles in order to enable the autonomous vehicles to use the optimal routes to determine routes.Type: GrantFiled: August 7, 2020Date of Patent: August 15, 2023Assignee: Waymo LLCInventors: Andrew Chan, Austin Abrams, Joshua Herbach
-
Patent number: 11698643Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating by default in a first mode and periodically transitioning from operation in the first mode to operation in a second mode. In the first mode, the system may receive environment data provided by the vehicle and representing object(s) having a detection confidence below a threshold, where the detection confidence is indicative of a likelihood of correct identification of the object(s), and responsive to the object(s) having a confidence below the threshold, provide remote assistance data comprising an instruction to control the vehicle and/or a correct identification of the object(s). In the second mode, the system may trigger user interface display of remote assistor alertness data based on pre-stored data related to an environment in which the pre-stored data was acquired, and receive a response relating to the alertness data.Type: GrantFiled: January 7, 2022Date of Patent: July 11, 2023Assignee: Waymo LLCInventors: Nathaniel Fairfield, Joshua Herbach
-
Publication number: 20230100535Abstract: Example embodiments relate to using remote assistance to maneuver an autonomous vehicle to a location. A computing device used by a remote operator may receive a request for assistance from a vehicle that indicates the vehicle is stopped at a first location with one or more navigation options for enabling the vehicle to navigate from the first location to a second location. At least one navigation option includes a maneuver technique that requires operator approval prior to execution. The computing device may then display a graphical user interface (GUI) that conveys the one or more navigation options. Based on detecting a selection of a particular navigation option, the computing device may transmit instructions to the vehicle to perform the particular navigation option. The vehicle may configured to navigate from the first location to the second location by performing the particular navigation option while monitoring for changes in the environment.Type: ApplicationFiled: November 30, 2022Publication date: March 30, 2023Inventors: Ioan-Alexandru Sucan, Joshua Herbach, Collin Winter
-
Patent number: 11535276Abstract: Example embodiments relate to using remote assistance to maneuver an autonomous vehicle to a location. A computing device used by a remote operator may receive a request for assistance from a vehicle that indicates the vehicle is stopped at a first location with one or more navigation options for enabling the vehicle to navigate from the first location to a second location. At least one navigation option includes a maneuver technique that requires operator approval prior to execution. The computing device may then display a graphical user interface (GUI) that conveys the one or more navigation options. Based on detecting a selection of a particular navigation option, the computing device may transmit instructions to the vehicle to perform the particular navigation option. The vehicle may configured to navigate from the first location to the second location by performing the particular navigation option while monitoring for changes in the environment.Type: GrantFiled: September 8, 2020Date of Patent: December 27, 2022Assignee: Waymo LLCInventors: Ioan-Alexandru Sucan, Joshua Herbach, Collin Winter
-
Publication number: 20220129008Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating by default in a first mode and periodically transitioning from operation in the first mode to operation in a second mode. In the first mode, the system may receive environment data provided by the vehicle and representing object(s) having a detection confidence below a threshold, where the detection confidence is indicative of a likelihood of correct identification of the object(s), and responsive to the object(s) having a confidence below the threshold, provide remote assistance data comprising an instruction to control the vehicle and/or a correct identification of the object(s). In the second mode, the system may trigger user interface display of remote assistor alertness data based on pre-stored data related to an environment in which the pre-stored data was acquired, and receive a response relating to the alertness data.Type: ApplicationFiled: January 7, 2022Publication date: April 28, 2022Inventors: Nathaniel Fairfield, Joshua Herbach
-
Publication number: 20220073097Abstract: Example embodiments relate to using remote assistance to maneuver an autonomous vehicle to a location. A computing device used by a remote operator may receive a request for assistance from a vehicle that indicates the vehicle is stopped at a first location with one or more navigation options for enabling the vehicle to navigate from the first location to a second location. At least one navigation option includes a maneuver technique that requires operator approval prior to execution. The computing device may then display a graphical user interface (GUI) that conveys the one or more navigation options. Based on detecting a selection of a particular navigation option, the computing device may transmit instructions to the vehicle to perform the particular navigation option. The vehicle may configured to navigate from the first location to the second location by performing the particular navigation option while monitoring for changes in the environment.Type: ApplicationFiled: September 8, 2020Publication date: March 10, 2022Inventors: Ioan-Alexandru Sucan, Joshua Herbach, Collin Winter
-
Patent number: 11269354Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating by default in a first mode and periodically transitioning from operation in the first mode to operation in a second mode. In the first mode, the system may receive environment data provided by the vehicle and representing object(s) having a detection confidence below a threshold, where the detection confidence is indicative of a likelihood of correct identification of the object(s), and responsive to the object(s) having a confidence below the threshold, provide remote assistance data comprising an instruction to control the vehicle and/or a correct identification of the object(s). In the second mode, the system may trigger user interface display of remote assistor alertness data based on pre-stored data related to an environment in which the pre-stored data was acquired, and receive a response relating to the alertness data.Type: GrantFiled: July 16, 2020Date of Patent: March 8, 2022Assignee: Waymo LLCInventors: Nathaniel Fairfield, Joshua Herbach
-
Publication number: 20220050457Abstract: Example implementations relate to vehicle occupancy confirmation. An example implementation involves receiving, at a computing system from a camera positioned inside a vehicle, an image representing an occupancy within the vehicle. The implementation further involves, responsive to receiving the image, displaying the image on a display interface, and receiving an operator input confirming the occupancy meets a desired occupancy. The implementation additionally includes transmitting an occupancy confirmation from the computing system to the vehicle. In some instances, in response to receiving the occupancy confirmation, the vehicle executes an autonomous driving operation.Type: ApplicationFiled: October 27, 2021Publication date: February 17, 2022Inventor: Joshua Herbach
-
Publication number: 20220042821Abstract: Aspects of the disclosure relate to generating scouting objectives in order to update map information used to control a fleet of vehicles in an autonomous driving mode. For instance, a notification from a vehicle of the fleet identifying a feature and a location of the feature may be received. A first bound for a scouting area may be identified based on the location of the feature. A second bound for the scouting area may be identified based on a lane closest to the feature. A scouting objective may be generated for the feature based on the first bound and the second bound.Type: ApplicationFiled: August 10, 2020Publication date: February 10, 2022Inventors: Katharine Patterson, Joshua Herbach, David Silver, David Margines
-
Publication number: 20220042812Abstract: Aspects of the disclosure relate to pre-computing routes for autonomous vehicles using map shards. For example, a shard from a plurality of shards of a map may be selected. Each shard including a plurality of nodes and edges connecting pairs of nodes of the plurality of nodes, and each node of the plurality represents a location. A plurality of port nodes for the shard are identified. Each port node has an edge that enters into the selected shard or exists the selected shard. For each port node of the plurality having an edge that enters into the selected shard, optimal routes to each other port node of the plurality having an edge that exits the selected shard may be determined. The optimal routes for the selected shard may be sent to the autonomous vehicles in order to enable the autonomous vehicles to use the optimal routes to determine routes.Type: ApplicationFiled: August 7, 2020Publication date: February 10, 2022Inventors: Andrew Chan, Austin Abrams, Joshua Herbach
-
Patent number: 11163307Abstract: Example implementations relate to vehicle occupancy confirmation. An example implementation involves receiving, at a computing system from a camera positioned inside a vehicle, an image representing an occupancy within the vehicle. The implementation further involves, responsive to receiving the image, displaying the image on a display interface, and receiving an operator input confirming the occupancy meets a desired occupancy. The implementation additionally includes transmitting an occupancy confirmation from the computing system to the vehicle. In some instances, in response to receiving the occupancy confirmation, the vehicle executes an autonomous driving operation.Type: GrantFiled: August 7, 2019Date of Patent: November 2, 2021Assignee: Waymo LLCInventor: Joshua Herbach
-
Publication number: 20210125427Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating in a rewind mode. In the rewind mode, the system may be configured to provide information to a remote assistance operated based on a remote-assistance triggering criteria being met, such as determining that the autonomous vehicle has been stopped for a period of time. When the triggering criteria is met, the remote assistance system may provide data from the time leading up to when the remote-assistance triggering criteria was met that was capture of the environment of autonomous vehicle to the remote assistance operator. Based on viewing the data, the remote assistance operator may provide and input to the system that causes a command to be issued to the autonomous vehicle.Type: ApplicationFiled: January 7, 2021Publication date: April 29, 2021Inventors: Dmitri Dolgov, Joshua Herbach
-
Patent number: 10922903Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating in a rewind mode. In the rewind mode, the system may be configured to provide information to a remote assistance operated based on a remote-assistance triggering criteria being met, such as determining that the autonomous vehicle has been stopped for a period of time. When the triggering criteria is met, the remote assistance system may provide data from the time leading up to when the remote-assistance triggering criteria was met that was capture of the environment of autonomous vehicle to the remote assistance operator. Based on viewing the data, the remote assistance operator may provide and input to the system that causes a command to be issued to the autonomous vehicle.Type: GrantFiled: September 14, 2017Date of Patent: February 16, 2021Assignee: Waymo LLCInventors: Dmitri Dolgov, Joshua Herbach
-
Publication number: 20210018930Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating in a rewind mode. In the rewind mode, the system may be configured to provide information to a remote assistance operated based on a remote-assistance triggering criteria being met, such as a detected object having a low detection confidence. When the triggering criteria is met, the remote assistance system may provide data from the time leading up to when the remote-assistance triggering criteria was met that was capture of the environment of autonomous vehicle to the remote assistance operator. Based on viewing the data, the remote assistance operator may provide and input to the system that causes a command to be issued to the autonomous vehicle.Type: ApplicationFiled: October 1, 2020Publication date: January 21, 2021Inventor: Joshua Herbach