Patents by Inventor Vishu Goyal
Vishu Goyal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240126296Abstract: To operate an autonomous vehicle, a rail agent is detected in a vicinity of the autonomous vehicle using a detection system. One or more tracks are determined on which the detected rail agent is possibly traveling, and possible paths for the rail agent are predicted based on the determined one or more tracks. One or more motion paths are determined for one or more probable paths from the possible paths, and a likelihood for each of the one or more probable paths is determined based on each motion plan. A path for the autonomous vehicle is then determined based on a most probable path associated with a highest likelihood for the rail agent, and the autonomous vehicle is operated using the determined path.Type: ApplicationFiled: October 26, 2023Publication date: April 18, 2024Inventors: Vishu Goyal, Stéphane Ross, Kai Ding
-
Publication number: 20240085917Abstract: The technology relates to controlling a vehicle in an autonomous driving mode in accordance with behavior predictions for other road users in the vehicle's vicinity. In particular, the vehicle's onboard computing system may predict whether another road user will perform a “continuing” lane driving operation, such as going straight in a turn-only lane. Sensor data from detected/observed objects in the vehicle's nearby environment may be evaluated in view of one or more possible behaviors for different types of objects. In addition, roadway features, in particular whether lane segments are connected in a roadgraph, are also evaluated to determine probabilities of whether other road users may make an improper continuing lane driving operation. This is used to generate more accurate behavior predictions, which the vehicle can use to take alternative (e.g., corrective) driving actions.Type: ApplicationFiled: November 10, 2023Publication date: March 14, 2024Inventors: Vishu Goyal, Kai Ding
-
Patent number: 11853069Abstract: The technology relates to controlling a vehicle in an autonomous driving mode in accordance with behavior predictions for other road users in the vehicle's vicinity. In particular, the vehicle's onboard computing system may predict whether another road user will perform a “continuing” lane driving operation, such as going straight in a turn-only lane. Sensor data from detected/observed objects in the vehicle's nearby environment may be evaluated in view of one or more possible behaviors for different types of objects. In addition, roadway features, in particular whether lane segments are connected in a roadgraph, are also evaluated to determine probabilities of whether other road users may make an improper continuing lane driving operation. This is used to generate more accurate behavior predictions, which the vehicle can use to take alternative (e.g., corrective) driving actions.Type: GrantFiled: March 12, 2021Date of Patent: December 26, 2023Assignee: Waymo LLCInventors: Vishu Goyal, Kai Ding
-
Publication number: 20230400859Abstract: Jaywalking behaviors of vulnerable road users (VRUs) such as cyclists or pedestrians can be predicted. Location data is obtained that identifies a location of a VRU within a vicinity of a vehicle. Environmental data is obtained that describes an environment of the VRU, where the environmental data identifies a set of environmental features in the environment of the VRU. The system can determine a nominal heading of the VRU, and generate a set of predictive inputs that indicate, for each of at least a subset of the set of environmental features, a physical relationship between the VRU and the environmental feature. The physical relationship can be determined with respect to the nominal heading of the VRU and the location of the VRU. The set of predictive inputs can be processed with a heading estimation model to generate a predicted heading offset (e.g., a target heading offset) for the VRU.Type: ApplicationFiled: May 30, 2023Publication date: December 14, 2023Inventors: Vishu Goyal, Kai Ding
-
Patent number: 11841704Abstract: To operate an autonomous vehicle, a rail agent is detected in a vicinity of the autonomous vehicle using a detection system. One or more tracks are determined on which the detected rail agent is possibly traveling, and possible paths for the rail agent are predicted based on the determined one or more tracks. One or more motion paths are determined for one or more probable paths from the possible paths, and a likelihood for each of the one or more probable paths is determined based on each motion plan. A path for the autonomous vehicle is then determined based on a most probable path associated with a highest likelihood for the rail agent, and the autonomous vehicle is operated using the determined path.Type: GrantFiled: November 4, 2020Date of Patent: December 12, 2023Assignee: Waymo LLCInventors: Vishu Goyal, Stéphane Ross, Kai Ding
-
Patent number: 11774259Abstract: Aspects of the disclosure provide a method of identifying off-road entry lane waypoints. For instance, a polygon representative of a driveway or parking area may be identified from map information. A nearest lane may be identified based on the polygon. A plurality of lane waypoints may be identified. Each of the lane waypoints may correspond to a location within at least one lane. The polygon and the plurality of lane waypoints may be input into a model. A lane waypoint of the plurality of lane waypoints may be selected as an off-road entry lane waypoint. The off-road entry lane waypoint may be associated with the nearest lane. The association may be provided to an autonomous vehicle in order to allow the autonomous vehicle to use the association to control the autonomous vehicle in an autonomous driving mode.Type: GrantFiled: September 8, 2021Date of Patent: October 3, 2023Assignee: Waymo LLCInventors: Vishu Goyal, Shubham Gupta
-
Patent number: 11753043Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium that generates path prediction data for agents in the vicinity of an autonomous vehicle using machine learning models. One method includes identifying an agent in a vicinity of an autonomous vehicle navigating an environment and determining that the agent is within a vicinity of a crossing zone, which can be marked or unmarked. In response to determining that the agent is within a vicinity of a crossing zone: (i) features of the agent and of the crossing zone can be obtained; (ii) a first input that includes the features can be processed using a first machine learning model that is configured to generate a first crossing prediction that characterizes future crossing behavior of the agent, and (iii) a predicted path for the agent for crossing the roadway can be determined from at least the first crossing prediction.Type: GrantFiled: May 20, 2021Date of Patent: September 12, 2023Assignee: Waymo LLCInventors: Vishu Goyal, Shubham Gupta, Kai Ding
-
Patent number: 11698639Abstract: Jaywalking behaviors of vulnerable road users (VRUs) such as cyclists or pedestrians can be predicted. Location data is obtained that identifies a location of a VRU within a vicinity of a vehicle. Environmental data is obtained that describes an environment of the VRU, where the environmental data identifies a set of environmental features in the environment of the VRU. The system can determine a nominal heading of the VRU, and generate a set of predictive inputs that indicate, for each of at least a subset of the set of environmental features, a physical relationship between the VRU and the environmental feature. The physical relationship can be determined with respect to the nominal heading of the VRU and the location of the VRU. The set of predictive inputs can be processed with a heading estimation model to generate a predicted heading offset (e.g., a target heading offset) for the VRU.Type: GrantFiled: June 4, 2020Date of Patent: July 11, 2023Assignee: Waymo LLCInventors: Vishu Goyal, Kai Ding
-
Publication number: 20230074387Abstract: Aspects of the disclosure provide a method of identifying off-road entry lane waypoints. For instance, a polygon representative of a driveway or parking area may be identified from map information. A nearest lane may be identified based on the polygon. A plurality of lane waypoints may be identified. Each of the lane waypoints may correspond to a location within at least one lane. The polygon and the plurality of lane waypoints may be input into a model. A lane waypoint of the plurality of lane waypoints may be selected as an off-road entry lane waypoint. The off-road entry lane waypoint may be associated with the nearest lane. The association may be provided to an autonomous vehicle in order to allow the autonomous vehicle to use the association to control the autonomous vehicle in an autonomous driving mode.Type: ApplicationFiled: September 8, 2021Publication date: March 9, 2023Inventors: Vishu Goyal, Shubham Gupta
-
Publication number: 20220371624Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium that generates path prediction data for agents in the vicinity of an autonomous vehicle using one or more machine learning models. One of the methods includes identifying an agent in a vicinity of an autonomous vehicle navigating through an environment and determining that the agent is within a vicinity of a crossing zone across a roadway. The crossing zone can be a marked crossing zone or an unmarked crossing zone. For example, the crossing zone can be an unmarked crossing zone that has been identified based on previous observations of agents crossing the roadway.Type: ApplicationFiled: May 20, 2021Publication date: November 24, 2022Inventors: Vishu Goyal, Shubham Gupta, Kai Ding
-
Publication number: 20220355824Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting near-curb driving behavior. One of the methods includes obtaining agent trajectory data for an agent in an environment, the agent trajectory data comprising a current location and current values for a predetermined set of motion parameters of the agent; processing a model input generated from the agent trajectory data using a trained machine learning model to generate a model output comprising a prediction of whether the agent will exhibit near-curb driving behavior within a predetermined timeframe, wherein an agent exhibits near-curb driving behavior when the agent operates within a particular distance of an edge of a road in the environment; and using the prediction to generate a planned path for a vehicle in the environment.Type: ApplicationFiled: May 10, 2021Publication date: November 10, 2022Inventors: Vishu Goyal, Kai Ding, Yang Wang
-
Publication number: 20220326714Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating unmapped U-turn predictions using a machine learning model. One of the methods includes obtaining features of an agent travelling on a roadway. One or more unmapped U-turn regions in a vicinity of the agent on the roadway are identified. For each of the unmapped U-turn regions and from at least the features of the agent, a respective likelihood score that represents a likelihood that the agent intends to make an unmapped U-turn at the unmapped U-turn region is generated. Based on the respective likelihood scores, one or more of the unmapped U-turn regions are selected. For each selected unmapped U-turn region, data specifying a candidate future trajectory in which the agent makes the unmapped U-turn at the selected unmapped U-turn region is provided as a possible future trajectory for the agent.Type: ApplicationFiled: April 9, 2021Publication date: October 13, 2022Inventors: Vishu Goyal, Shen Zhang
-
Publication number: 20220291690Abstract: The technology relates to controlling a vehicle in an autonomous driving mode in accordance with behavior predictions for other road users in the vehicle's vicinity. In particular, the vehicle's onboard computing system may predict whether another road user will perform a “continuing” lane driving operation, such as going straight in a turn-only lane. Sensor data from detected/observed objects in the vehicle's nearby environment may be evaluated in view of one or more possible behaviors for different types of objects. In addition, roadway features, in particular whether lane segments are connected in a roadgraph, are also evaluated to determine probabilities of whether other road users may make an improper continuing lane driving operation. This is used to generate more accurate behavior predictions, which the vehicle can use to take alternative (e.g., corrective) driving actions.Type: ApplicationFiled: March 12, 2021Publication date: September 15, 2022Inventors: Vishu Goyal, Kai Ding
-
Publication number: 20220137623Abstract: To operate an autonomous vehicle, a rail agent is detected in a vicinity of the autonomous vehicle using a detection system. One or more tracks are determined on which the detected rail agent is possibly traveling, and possible paths for the rail agent are predicted based on the determined one or more tracks. One or more motion paths are determined for one or more probable paths from the possible paths, and a likelihood for each of the one or more probable paths is determined based on each motion plan. A path for the autonomous vehicle is then determined based on a most probable path associated with a highest likelihood for the rail agent, and the autonomous vehicle is operated using the determined path.Type: ApplicationFiled: November 4, 2020Publication date: May 5, 2022Inventors: Vishu Goyal, Stéphane Ross, Kai Ding
-
Publication number: 20210382489Abstract: Jaywalking behaviors of vulnerable road users (VRUs) such as cyclists or pedestrians can be predicted. Location data is obtained that identifies a location of a VRU within a vicinity of a vehicle. Environmental data is obtained that describes an environment of the VRU, where the environmental data identifies a set of environmental features in the environment of the VRU. The system can determine a nominal heading of the VRU, and generate a set of predictive inputs that indicate, for each of at least a subset of the set of environmental features, a physical relationship between the VRU and the environmental feature. The physical relationship can be determined with respect to the nominal heading of the VRU and the location of the VRU. The set of predictive inputs can be processed with a heading estimation model to generate a predicted heading offset (e.g., a target heading offset) for the VRU.Type: ApplicationFiled: June 4, 2020Publication date: December 9, 2021Inventors: Vishu Goyal, Kai Ding
-
Publication number: 20210004809Abstract: Preventing fraud or misuse associated with payment instruments comprises a processor for training a machine-learning process based on historic data related to interactions of an instrument. The processor trains a machine-learning process based on historic data related to interactions of an instrument and instrument issuer with counter-parties and users. The processor receives a request to evaluate the instrument for a risk of fraud and enters the accessed data into the machine-learning process. The processor determines a first risk score based on the machine-learning process that is based on a likelihood that the instrument issuer will remit invoiced funds and a second risk score based on a likelihood that the instrument issuer will initiate chargebacks. The processor determines that a combination of the first and second risk score is higher than a configured threshold and instructs the requester not to interact with the instrument.Type: ApplicationFiled: July 5, 2019Publication date: January 7, 2021Inventors: Vishu Goyal, Diana Ioana Nistor
-
Publication number: 20210004808Abstract: Adding an instrument to a digital application comprises a processor for training a machine-learning process based on historic data related to interactions of an instrument with counter-parties and users. The processor receives a request to add the instrument to a digital application associated with a user and accesses data associated with the instrument, the user, and the digital application. The processor enters the accessed data into the machine-learning process and determines a risk score of adding the instrument to the digital application based on the machine-learning process. If the processor determines that the risk score is less than or equal to a configured threshold, the processor adds the instrument to the digital application. If the risk score is greater than the threshold, the processor rejects the addition of the instrument.Type: ApplicationFiled: July 5, 2019Publication date: January 7, 2021Inventors: Vishu Goyal, Diana Ioana Nistor
-
Patent number: 10395274Abstract: Techniques for advertisement placement prioritization are described. In one or more implementations, a likely line of sight of a viewer of an event to a focus point of the event is determined. Then, a relative location of one or more display devices is identified in relation to the likely line of sight of the viewer. In addition, a priority level is assigned to respective display devices based on corresponding relative locations in relation to the likely line of sight. Further, various demographics and characteristics of audience members can be obtained to determine context-sensitive media content associated with the audience members to present via relatively higher priority display devices. Also, performances of event participants can be determined based on commentary analysis and used to determine context-sensitive media content associated with the event participants to present via the higher priority ad boards.Type: GrantFiled: December 10, 2014Date of Patent: August 27, 2019Assignee: Adobe Inc.Inventors: Vishu Goyal, Vikram Sethi, Sparsh Kumar Sinha, Sameer Bhatt, Rishub Garg
-
Publication number: 20160171532Abstract: Techniques for advertisement placement prioritization are described. In one or more implementations, a likely line of sight of a viewer of an event to a focus point of the event is determined. Then, a relative location of one or more display devices is identified in relation to the likely line of sight of the viewer. In addition, a priority level is assigned to respective display devices based on corresponding relative locations in relation to the likely line of sight. Further, various demographics and characteristics of audience members can be obtained to determine context-sensitive media content associated with the audience members to present via relatively higher priority display devices. Also, performances of event participants can be determined based on commentary analysis and used to determine context-sensitive media content associated with the event participants to present via the higher priority ad boards.Type: ApplicationFiled: December 10, 2014Publication date: June 16, 2016Inventors: Vishu Goyal, Vikram Sethi, Sparsh Kumar Sinha, Sameer Bhatt, Rishub Garg