Patents by Inventor Nils Grimsmo

Nils Grimsmo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190138527
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided from a user device, and determining that the query implicitly references some entity, and in response: obtaining an approximate location and an approximate orientation of the user device, obtaining a set of entities including one or more entities, each entity in the set of entities being at least partially within a range that is based on the approximate location and that includes an extended portion based on the approximate orientation, selecting an entity from the set of entities, and providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.
    Type: Application
    Filed: January 7, 2019
    Publication date: May 9, 2019
    Inventors: Nils Grimsmo, Behshad Behzadi, Fredrik Bergenlid
  • Patent number: 10275651
    Abstract: Methods, apparatus, and computer readable media are described related to causing processing of sensor data to be performed in response to determining a request related to an environmental object that is likely captured by the sensor data. Some implementations further relate to determining whether the request is resolvable based on the processing of the sensor data. When it is determined that the request is not resolvable, a prompt is determined and provided as user interface output, where the prompt provides guidance on further input that will enable the request to be resolved. In those implementations, the further input (e.g., additional sensor data and/or the user interface input) received in response to the prompt can then be utilized to resolve the request.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: April 30, 2019
    Assignee: GOOGLE LLC
    Inventors: Ibrahim Badr, Nils Grimsmo, Gökhan Bakir
  • Patent number: 10185746
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided from a user device, and determining that the query implicitly references some entity, and in response: obtaining an approximate location and an approximate orientation of the user device, obtaining a set of entities including one or more entities, each entity in the set of entities being at least partially within a range that is based on the approximate location and that includes an extended portion based on the approximate orientation, selecting an entity from the set of entities, and providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.
    Type: Grant
    Filed: August 20, 2015
    Date of Patent: January 22, 2019
    Assignee: Google LLC
    Inventors: Nils Grimsmo, Behshad Behzadi, Fredrik Bergenlid
  • Publication number: 20180336414
    Abstract: Methods, apparatus, and computer readable media are described related to causing processing of sensor data to be performed in response to determining a request related to an environmental object that is likely captured by the sensor data. Some implementations further relate to determining whether the request is resolvable based on the processing of the sensor data. When it is determined that the request is not resolvable, a prompt is determined and provided as user interface output, where the prompt provides guidance on further input that will enable the request to be resolved. In those implementations, the further input (e.g., additional sensor data and/or the user interface input) received in response to the prompt can then be utilized to resolve the request.
    Type: Application
    Filed: June 23, 2017
    Publication date: November 22, 2018
    Inventors: Ibrahim Badr, Nils Grimsmo, Gökhan Bakir
  • Publication number: 20180324117
    Abstract: A computer-implemented method is described. The method includes a computing system receiving an item of digital content from a user device. The computing system generates one or more labels that indicate attributes of the item of digital content. The computing system also generates one or more conversational replies to the item of digital content based on the one or more labels that indicate attributes of the item of digital content. The method also includes the computing system selecting a conversational reply from among the one or more conversational replies and providing the conversational reply for output to the user device.
    Type: Application
    Filed: May 5, 2017
    Publication date: November 8, 2018
    Inventors: Ibrahim Badr, Aayush Kumar, Goekhan Hasan Bakir, Nils Grimsmo, Bianca Madalina Buisman
  • Publication number: 20180267994
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for contextually disambiguating queries are disclosed. In an aspect, a method includes receiving an image being presented on a display of a computing device and a transcription of an utterance spoken by a user of the computing device, identifying a particular sub-image that is included in the image, and based on performing image recognition on the particular sub-image, determining one or more first labels that indicate a context of the particular sub-image. The method also includes, based on performing text recognition on a portion of the image other than the particular sub-image, determining one or more second labels that indicate the context of the particular sub-image, based on the transcription, the first labels, and the second labels, generating a search query, and providing, for output, the search query.
    Type: Application
    Filed: March 20, 2017
    Publication date: September 20, 2018
    Inventors: Ibrahim Badr, Nils Grimsmo, Gokhan H. Bakir, Kamil Anikiej, Aayush Kumar, Viacheslav Kuznetsov
  • Publication number: 20170277702
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided from a user device, and determining that the query implicitly references some entity, and in response: obtaining an approximate location of the user device, obtaining a set of entities comprising one or more entities, each entity in the set of entities being associated with the approximate location, selecting an entity from the set of entities based on one or more entity query patterns associated with the entity, and providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.
    Type: Application
    Filed: August 17, 2015
    Publication date: September 28, 2017
    Inventors: Nils Grimsmo, Behshad Behzadi
  • Patent number: 9727603
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: August 8, 2017
    Assignee: Google Inc.
    Inventors: Matthias Heiler, Behshad Behzadi, Evgeny A. Cherepanov, Nils Grimsmo, Aurelien Boffy, Alessandro Agostini, Karoly Csalogany, Fredrik Bergenlid, Marcin M. Nowak-Przygodzki
  • Patent number: 9336277
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating query suggestions based on search data. In one aspect, a method includes receiving, by one or more computers, a first query, determining query refinements based on the first query, generating, from the query refinements, refinement clusters, each refinement cluster corresponding to a particular topic and each refinement cluster including query refinements that are determined to belong to the particular topic to which the refinement cluster corresponds, ranking the refinement clusters, and selecting the refinement cluster that is highest in the ranking relative to other refinement clusters in the ranking as a first search refinement cluster for the first query.
    Type: Grant
    Filed: May 31, 2013
    Date of Patent: May 10, 2016
    Assignee: Google Inc.
    Inventors: Behshad Behzadi, Evgeny A. Cherepanov, Nils Grimsmo, Aurelien Boffy, Alessandro Agostini, Karoly Csalogany, Fredrik Bergenlid, Matthias Heiler, Marcin M. Nowak-Przygodzki
  • Publication number: 20160055218
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided from a user device, and determining that the query implicitly references some entity, and in response: obtaining an approximate location and an approximate orientation of the user device, obtaining a set of entities including one or more entities, each entity in the set of entities being at least partially within a range that is based on the approximate location and that includes an extended portion based on the approximate orientation, selecting an entity from the set of entities, and providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.
    Type: Application
    Filed: August 20, 2015
    Publication date: February 25, 2016
    Inventors: Nils Grimsmo, Behshad Behzadi, Fredrik Bergenlid
  • Publication number: 20150324425
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided from a user device, and determining that the query is implicitly about some entity, and in response: obtaining an approximate location of the user device when the user device provided the query, obtaining a set of entities including one or more entities, each entity in the set of entities being associated with the approximate location, and determining that the query is implicitly about an entity in the set of entities, and in response: providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.
    Type: Application
    Filed: May 8, 2015
    Publication date: November 12, 2015
    Inventors: Behshad Behzadi, Nils Grimsmo
  • Patent number: 9116952
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.
    Type: Grant
    Filed: May 31, 2013
    Date of Patent: August 25, 2015
    Assignee: Google Inc.
    Inventors: Matthias Heiler, Behshad Behzadi, Evgeny A. Cherepanov, Nils Grimsmo, Aurelien Boffy, Alessandro Agostini, Karoly Csalogany, Fredrik Bergenlid, Marcin M. Nowak-Przygodzki
  • Publication number: 20140358906
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating query suggestions based on search data. In one aspect, a method includes receiving, by one or more computers, a first query, determining query refinements based on the first query, generating, from the query refinements, refinement clusters, each refinement cluster corresponding to a particular topic and each refinement cluster including query refinements that are determined to belong to the particular topic to which the refinement cluster corresponds, ranking the refinement clusters, and selecting the refinement cluster that is highest in the ranking relative to other refinement clusters in the ranking as a first search refinement cluster for the first query.
    Type: Application
    Filed: May 31, 2013
    Publication date: December 4, 2014
    Inventors: Behshad Behzadi, Evgeny A. Cherepanov, Nils Grimsmo, Aurelien Boffy, Alessandro Agostini, Karoly Csalogany, Fredrik Bergenlid, Matthias Heiler, Marcin M. Nowak-Przygodzki