Patents by Inventor Hans-Olav CaveLie

Hans-Olav CaveLie has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230202485
    Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver.
    Type: Application
    Filed: March 6, 2023
    Publication date: June 29, 2023
    Inventors: Keith Hutchings, Julien Mercay, Philip Nemec, Hans-olav CaveLie, Saswat Panigrahi, Renaud-Roland Hubert, Johan Engstrom
  • Patent number: 11634145
    Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: April 25, 2023
    Assignee: Waymo LLC
    Inventors: Keith Hutchings, Julien Mercay, Philip Nemec, Hans-olav CaveLie, Saswat Panigrahi, Renaud-Roland Hubert, Johan Engstrom
  • Patent number: 11491994
    Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: November 8, 2022
    Assignee: Waymo LLC
    Inventors: Keith Hutchings, Julien Mercay, Philip Nemec, Hans-olav CaveLie, Saswat Panigrahi, Renaud-Roland Hubert, Johan Engstrom
  • Publication number: 20220120581
    Abstract: Aspects of the disclosure relate to providing an end of trip sequence when a vehicle is nearing its destination. One or more computing devices may generate and display a video indicating a projected trajectory of the vehicle and objects detected by sensors on the vehicle, on a map corresponding to a route the vehicle is currently following, where the video is generated from a perspective of a virtual camera at a default position and default pitch A determination that the vehicle has reached a threshold relative to the route of the vehicle may be made and the position and pitch of the virtual camera may be adjusted to an updated position above the vehicle and a perspective which looks downwards towards a roof of the vehicle. The video may then be generated and displayed from the perspective of the virtual camera at the updated position.
    Type: Application
    Filed: November 1, 2021
    Publication date: April 21, 2022
    Inventors: Nirmal Patel, Maria Moon, Peter Crandall, Ryan Powell, Hans-olav Cavelie, Matthew Hall
  • Patent number: 11193784
    Abstract: Aspects of the disclosure relate to providing an end of trip sequence when a vehicle is nearing its destination. One or more computing devices may generate and display a video indicating a projected trajectory of the vehicle and objects detected by sensors on the vehicle, on a map corresponding to a route the vehicle is currently following, where the video is generated from a perspective of a virtual camera at a default position and default pitch A determination that the vehicle has reached a threshold relative to the route of the vehicle may be made and the position and pitch of the virtual camera may be adjusted to an updated position above the vehicle and a perspective which looks downwards towards a roof of the vehicle. The video may then be generated and displayed from the perspective of the virtual camera at the updated position.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: December 7, 2021
    Assignee: Waymo LLC
    Inventors: Nirmal Patel, Maria Moon, Peter Crandall, Ryan Powell, Hans-olav Cavelie, Matthew Hall
  • Publication number: 20210221393
    Abstract: Aspects of the present disclosure relate to prioritizing notifications for a vehicle operating in an autonomous driving mode. As an example, a set of notifications based on one or more messages received or transmitted by a planning system of the vehicle may be generated. Each notification of the set of notifications is assigned a priority ranking. The set of notifications may be stored in a cache and the one or more processors may determine a first notification for display based on the priority rankings of the set of notifications and the first notification may be displayed on a display of the vehicle to a passenger of the vehicle.
    Type: Application
    Filed: January 22, 2021
    Publication date: July 22, 2021
    Inventors: Maria Moon, Hans-olav Cavelie, Juliet Rothenberg, Julien Mercay, Ryan Powell, Yang Li
  • Patent number: 10933886
    Abstract: Aspects of the present disclosure relate to prioritizing notifications for a vehicle operating in an autonomous driving mode. As an example, a set of notifications based on one or more messages received or transmitted by a planning system of the vehicle may be generated. Each notification of the set of notifications is assigned a priority ranking. The set of notifications may be stored in a cache and the one or more processors may determine a first notification for display based on the priority rankings of the set of notifications and the first notification may be displayed on a display of the vehicle to a passenger of the vehicle.
    Type: Grant
    Filed: October 27, 2017
    Date of Patent: March 2, 2021
    Assignee: Waymo LLC
    Inventors: Maria Moon, Hans-olav Cavelie, Juliet Rothenberg, Julien Mercay, Ryan Powell, Yang Li
  • Publication number: 20210001865
    Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver.
    Type: Application
    Filed: September 18, 2020
    Publication date: January 7, 2021
    Inventors: Keith Hutchings, Julien Mercay, Philip Nemec, Hans-olav CaveLie, Saswat Panigrahi, Renaud-Roland Hubert, Johan Engstrom
  • Publication number: 20210001864
    Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.
    Type: Application
    Filed: September 18, 2020
    Publication date: January 7, 2021
    Inventors: Keith Hutchings, Julien Mercay, Philip Nemec, Hans-olav Cavelie, Saswat Panigrahi, Renaud-Roland Hubert, Johan Engstrom
  • Patent number: 10807605
    Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: October 20, 2020
    Assignee: Waymo LLC
    Inventors: Keith Hutchings, Julien Mercay, Philip Nemec, Hans-olav CaveLie, Saswat Panigrahi, Renaud-Roland Hubert, Johan Engstrom
  • Publication number: 20200198644
    Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.
    Type: Application
    Filed: December 19, 2018
    Publication date: June 25, 2020
    Inventors: Keith Hutchings, Julien Mercay, Philip Nemec, Hans-olav CaveLie, Saswat Panigrahi, Renaud-Roland Hubert, Johan Engstrom
  • Publication number: 20190126937
    Abstract: Aspects of the present disclosure relate to prioritizing notifications for a vehicle operating in an autonomous driving mode. As an example, a set of notifications based on one or more messages received or transmitted by a planning system of the vehicle may be generated. Each notification of the set of notifications is assigned a priority ranking. The set of notifications may be stored in a cache and the one or more processors may determine a first notification for display based on the priority rankings of the set of notifications and the first notification may be displayed on a display of the vehicle to a passenger of the vehicle.
    Type: Application
    Filed: October 27, 2017
    Publication date: May 2, 2019
    Inventors: Maria Moon, Hans-olav Cavelie, Juliet Rothenberg, Julien Mercay, Ryan Powell, Yang Li
  • Publication number: 20190113359
    Abstract: Aspects of the disclosure relate to providing an end of trip sequence when a vehicle is nearing its destination. One or more computing devices may generate and display a video indicating a projected trajectory of the vehicle and objects detected by sensors on the vehicle, on a map corresponding to a route the vehicle is currently following, where the video is generated from a perspective of a virtual camera at a default position and default pitch A determination that the vehicle has reached a threshold relative to the route of the vehicle may be made and the position and pitch of the virtual camera may be adjusted to an updated position above the vehicle and a perspective which looks downwards towards a roof of the vehicle. The video may then be generated and displayed from the perspective of the virtual camera at the updated position.
    Type: Application
    Filed: October 13, 2017
    Publication date: April 18, 2019
    Applicants: Waymo LLC, Waymo LLC
    Inventors: Nirmal Patel, Maria Moon, Peter Crandall, Ryan Powell, Hans-olav Cavelie, Matthew Hall
  • Patent number: 9569463
    Abstract: A pre-fetching map data system and method identifies a subset of map data to corresponding to one or more points of interest to be displayed on the map. The map data is stored on a remote map database and in the form of map data tiles. The system identifies those map data tiles that correspond to the subset of map data corresponding to the one or more points of interest, where the identified pre-fetch map data tiles are sent from the remote database to a client device for cache storage. The pre-fetch map data tiles are identified using a variable map tile radius, which when extended from the points of interest defines the map tiles that qualify as pre-fetch map data tiles. The tile radius can be fixed or dynamically adjusted and changes across different map zoom levels.
    Type: Grant
    Filed: March 17, 2014
    Date of Patent: February 14, 2017
    Assignee: GOOGLE INC.
    Inventors: Thomas Gregory Nourse, Michael Siliski, Hans-Olav CaveLie, Ronghui Zhu
  • Patent number: 9491255
    Abstract: A computer-implemented method and system for pre-fetching remote resource data from a remote mapping system for display on a client computing device is disclosed. Data received at a client device from an online mapping system in response to a query from the client device includes vector and remote resource data. Vector data is rasterized by the client device to depict graphical elements that are easily described by mathematical formulas. Remote resource data includes digital map elements that are not easily described by vectors, but instead, must be relayed to the client device as either bitmaps or references (e.g., URLs) to remote resources that are resolved at the backend or the client device. This remote resource data is prefetched to a client device so that it will be available for subsequent mapping application searches without resolving a corresponding reference to the remote resource data for each search.
    Type: Grant
    Filed: November 23, 2015
    Date of Patent: November 8, 2016
    Assignee: GOOGLE INC.
    Inventors: Thomas Gregory Nourse, Hans-Olav CaveLie, Ronghui Zhu, Andrew Miller
  • Publication number: 20160080518
    Abstract: A computer-implemented method and system for pre-fetching remote resource data from a remote mapping system for display on a client computing device is disclosed. Data received at a client device from an online mapping system in response to a query from the client device includes vector and remote resource data. Vector data is rasterized by the client device to depict graphical elements that are easily described by mathematical formulas. Remote resource data includes digital map elements that are not easily described by vectors, but instead, must be relayed to the client device as either bitmaps or references (e.g., URLs) to remote resources that are resolved at the backend or the client device. This remote resource data is prefetched to a client device so that it will be available for subsequent mapping application searches without resolving a corresponding reference to the remote resource data for each search.
    Type: Application
    Filed: November 23, 2015
    Publication date: March 17, 2016
    Inventors: Thomas Gregory Nourse, Hans-Olav CaveLie, Ronghui Zhu, Andrew Miller
  • Patent number: 9245046
    Abstract: Map tile data for displaying graphic elements of a web-based mapping system in a mobile computing device may be pre-fetched to the device based on an analysis of the historical uses of a mapping module at that device. A user mapping activity module executing on the mobile device may retrieve user mapping activity data. The module may then extract geographic location data from the user mapping activity data and send the extracted data to a mapping system via a network connection. The mapping system may then match map tile data to the geographic location data extracted from the user mapping activity data and send the matched data to the mobile computing device for cache storage at the mobile computing device. The user mapping activity module may also analyze the user mapping activity data to determine whether the extracted geographic location data is relevant enough to warrant pre-fetching the tile data.
    Type: Grant
    Filed: June 24, 2014
    Date of Patent: January 26, 2016
    Assignee: GOOGLE INC.
    Inventors: Thomas Gregory Nourse, Hans-Olav CaveLie
  • Patent number: 9197713
    Abstract: A computer-implemented method and system for pre-fetching remote resource data from a remote mapping system for display on a client computing device is disclosed. Data received at a client device from an online mapping system in response to a query from the client device includes vector and remote resource data. Vector data is rasterized by the client device to depict graphical elements that are easily described by mathematical formulas. Remote resource data includes digital map elements that are not easily described by vectors, but instead, must be relayed to the client device as either bitmaps or references (e.g., URLs) to remote resources that are resolved at the backend or the client device. This remote resource data is prefetched to a client device so that it will be available for subsequent mapping application searches without resolving a corresponding reference to the remote resource data for each search.
    Type: Grant
    Filed: December 9, 2011
    Date of Patent: November 24, 2015
    Assignee: GOOGLE INC.
    Inventors: Thomas Gregory Nourse, Hans-Olav CaveLie, Ronghui Zhu, Andrew Tesch Miller
  • Publication number: 20150189038
    Abstract: A computer-implemented method and system for pre-fetching remote resource data from a remote mapping system for display on a client computing device is disclosed. Data received at a client device from an online mapping system in response to a query from the client device includes vector and remote resource data. Vector data is rasterized by the client device to depict graphical elements that are easily described by mathematical formulas. Remote resource data includes digital map elements that are not easily described by vectors, but instead, must be relayed to the client device as either bitmaps or references (e.g., URLs) to remote resources that are resolved at the backend or the client device. This remote resource data is prefetched to a client device so that it will be available for subsequent mapping application searches without resolving a corresponding reference to the remote resource data for each search.
    Type: Application
    Filed: December 9, 2011
    Publication date: July 2, 2015
    Applicant: GOOGLE INC.
    Inventors: Thomas G. Nourse, Hans-Olav CaveLie, Ronghui Zhu, Andrew T. Miller
  • Patent number: 8972529
    Abstract: Map tile data for displaying graphic elements of a web-based mapping system in a mobile computing device may be pre-fetched to the device based on selection of an option to store the data at the device. A request for mapping system data may be sent from a mobile computing device to a remote mapping system via a network connection. The request may include user-specified location data. The remote mapping system may retrieve the mapping data corresponding to the user-specified location data and send it to the mobile computing device via the network connection. The mobile computing device may receive the retrieved mapping data and display a selectable option to store or not store the mapping data in a cache memory of the mobile computing device. The retrieved mapping data may then be stored at the mobile computing device in response to selection of the option to store the mapping data.
    Type: Grant
    Filed: March 4, 2014
    Date of Patent: March 3, 2015
    Assignee: Google Inc.
    Inventor: Hans-Olav CaveLie