Patents by Inventor Gokhan H. Bakir
Gokhan H. Bakir has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240168613Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.Type: ApplicationFiled: January 26, 2024Publication date: May 23, 2024Inventors: Ibrahim Badr, Gokhan H. Bakir, Roland Peter Kehl, Nils Grimsmo
-
Patent number: 11921988Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.Type: GrantFiled: July 19, 2021Date of Patent: March 5, 2024Assignee: GOOGLE LLCInventors: Ibrahim Badr, Gokhan H. Bakir, Roland Peter Kehl, Nils Grimsmo
-
Publication number: 20240070217Abstract: A computer-implemented method is described. The method includes a computing system receiving a first voice input from a user for generating a bookmark. Responsive to receiving the voice input, the computing system obtains a resource identifier associated with a resource page. The method includes the computing system storing the resource identifier as a bookmark in a bookmark index that is accessible in response to a request from a user device. The method further includes the computing system using the resource identifier, stored as the bookmark, to access the resource page. The computing system uses the resource identifier to access the resource page based on the request from the user device. The request is generated by the user device in response to the user device receiving a second voice input from the user.Type: ApplicationFiled: November 7, 2023Publication date: February 29, 2024Inventors: Mugurel Ionut Andreica, Gokhan H. Bakir, Tak Keung Cheng, Marcin M. Nowak-Przygodzki
-
Patent number: 11829433Abstract: A computer-implemented method is described. The method includes a computing system receiving a first voice input from a user for generating a bookmark. Responsive to receiving the voice input, the computing system obtains a resource identifier associated with a resource page. The method includes the computing system storing the resource identifier as a bookmark in a bookmark index that is accessible in response to a request from a user device. The method further includes the computing system using the resource identifier, stored as the bookmark, to access the resource page. The computing system uses the resource identifier to access the resource page based on the request from the user device. The request is generated by the user device in response to the user device receiving a second voice input from the user.Type: GrantFiled: August 19, 2022Date of Patent: November 28, 2023Assignee: GOOGLE LLCInventors: Mugurel Ionut Andreica, Gokhan H. Bakir, Tak Keung Cheng, Marcin M. Nowak-Przygodzki
-
Publication number: 20230222792Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.Type: ApplicationFiled: March 22, 2023Publication date: July 13, 2023Inventors: Ibrahim Badr, Roland Peter Kehl, Kaan Yucer, Thomas Jonathan Stone, Gokhan H. Bakir, Adrian Zumbrunnen
-
Patent number: 11688191Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for contextually disambiguating queries are disclosed. In an aspect, a method includes receiving an image being presented on a display of a computing device and a transcription of an utterance spoken by a user of the computing device, identifying a particular sub-image that is included in the image, and based on performing image recognition on the particular sub-image, determining one or more first labels that indicate a context of the particular sub-image. The method also includes, based on performing text recognition on a portion of the image other than the particular sub-image, determining one or more second labels that indicate the context of the particular sub-image, based on the transcription, the first labels, and the second labels, generating a search query, and providing, for output, the search query.Type: GrantFiled: September 9, 2022Date of Patent: June 27, 2023Assignee: GOOGLE LLCInventors: Ibrahim Badr, Nils Grimsmo, Gokhan H. Bakir, Kamil Anikiej, Aayush Kumar, Viacheslav Kuznetsov
-
Publication number: 20230195780Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for analyzing images for generating query responses. One of the methods includes determining, using a textual query, an image category for images responsive to the textual query, and an output type that identifies a type of requested content; selecting, using data that associates a plurality of images with a corresponding category, a subset of the images that each belong to the image category, each image in the plurality of images belonging to one of the two or more categories; analyzing, using the textual query, data for the images in the subset of the images to determine images responsive to the textual query; determining a response to the textual query using the images responsive to the textual query; and providing, using the output type, the response to the textual query for presentation.Type: ApplicationFiled: February 16, 2023Publication date: June 22, 2023Inventors: Gokhan H. Bakir, Marcin Bortnik, Malte Nuhn, Kavin Karthik Ilangovan
-
Patent number: 11651589Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.Type: GrantFiled: May 7, 2018Date of Patent: May 16, 2023Assignee: GOOGLE LLCInventors: Ibrahim Badr, Roland Peter Kehl, Kaan Yucer, Thomas Jonathan Stone, Gokhan H. Bakir, Adrian Zumbrunnen
-
Patent number: 11586678Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for analyzing images for generating query responses. One of the methods includes determining, using a textual query, an image category for images responsive to the textual query, and an output type that identifies a type of requested content; selecting, using data that associates a plurality of images with a corresponding category, a subset of the images that each belong to the image category, each image in the plurality of images belonging to one of the two or more categories; analyzing, using the textual query, data for the images in the subset of the images to determine images responsive to the textual query; determining a response to the textual query using the images responsive to the textual query; and providing, using the output type, the response to the textual query for presentation.Type: GrantFiled: August 10, 2020Date of Patent: February 21, 2023Assignee: GOOGLE LLCInventors: Gokhan H. Bakir, Marcin Bortnik, Malte Nuhn, Kavin Karthik Ilangovan
-
Publication number: 20230047212Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided by a user and comprising one or more terms. Obtaining context data based on at least a portion of a first resource displayed to the user at a time that the query is received. Obtaining a revised query that is based on the query and the context data. Receiving a plurality of search results responsive to the revised query. Automatically, selecting a search result that represents a second resource from the plurality of search results, and providing the second resource for display to the user.Type: ApplicationFiled: October 31, 2022Publication date: February 16, 2023Inventors: Gokhan H. Bakir, Behshad Behzadi, Marcin M. Nowak-Przygodzki
-
Patent number: 11580181Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, modifying queries based on non-textual content. In one aspect, a method includes receiving, from a user device, a query including a plurality of terms; determining active non-textual data displayed in an application environment on the user device; determining, from the non-textual textual data, modification data for the query; generating a set of modified queries based on the query and the modification parameters; scoring the modified queries according to one or more scoring criteria; selecting one of the modified queries based on the scoring; and providing, to the user device, search results responsive to the selected modified query.Type: GrantFiled: February 7, 2020Date of Patent: February 14, 2023Assignee: GOOGLE LLCInventors: Gokhan H. Bakir, Behshad Behzadi
-
Patent number: 11574013Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information to a user. In one aspect, a method includes receiving, from a user device, a query-independent request for contextual information relevant to an active resource displayed in an application environment on the user device, generating multiple queries from displayed content from the resource, determining a quality score for each of the multiple queries, selecting one or more of the multiple queries based on their respective quality scores, and providing, to the user device for each of the selected one or more queries, a respective user interface element for display with the active resource, wherein each user interface element includes contextual information regarding the respective query and includes the respective query.Type: GrantFiled: September 10, 2021Date of Patent: February 7, 2023Assignee: Google LLCInventors: Michal Jastrzebski, Aurelien Boffy, Gokhan H. Bakir, Behshad Behzadi, Marcin M. Nowak-Przygodzki
-
Publication number: 20230004597Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for contextually disambiguating queries are disclosed. In an aspect, a method includes receiving an image being presented on a display of a computing device and a transcription of an utterance spoken by a user of the computing device, identifying a particular sub-image that is included in the image, and based on performing image recognition on the particular sub-image, determining one or more first labels that indicate a context of the particular sub-image. The method also includes, based on performing text recognition on a portion of the image other than the particular sub-image, determining one or more second labels that indicate the context of the particular sub-image, based on the transcription, the first labels, and the second labels, generating a search query, and providing, for output, the search query.Type: ApplicationFiled: September 9, 2022Publication date: January 5, 2023Inventors: Ibrahim Badr, Nils Grimsmo, Gokhan H. Bakir, Kamil Anikiej, Aayush Kumar, Viacheslav Kuznetsov
-
Publication number: 20220391466Abstract: A computer-implemented method is described. The method includes a computing system receiving a first voice input from a user for generating a bookmark. Responsive to receiving the voice input, the computing system obtains a resource identifier associated with a resource page. The method includes the computing system storing the resource identifier as a bookmark in a bookmark index that is accessible in response to a request from a user device. The method further includes the computing system using the resource identifier, stored as the bookmark, to access the resource page. The computing system uses the resource identifier to access the resource page based on the request from the user device. The request is generated by the user device in response to the user device receiving a second voice input from the user.Type: ApplicationFiled: August 19, 2022Publication date: December 8, 2022Inventors: Mugurel Ionut Andreica, Gokhan H. Bakir, Tak Keung Cheng, Marcin M. Nowak-Przygodzki
-
Patent number: 11487757Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided by a user and comprising one or more terms. Obtaining context data based on at least a portion of a first resource displayed to the user at a time that the query is received. Obtaining a revised query that is based on the query and the context data. Receiving a plurality of search results responsive to the revised query. Automatically, selecting a search result that represents a second resource from the plurality of search results, and providing the second resource for display to the user.Type: GrantFiled: October 29, 2019Date of Patent: November 1, 2022Assignee: GOOGLE LLCInventors: Gokhan H. Bakir, Behshad Behzadi, Marcin M. Nowak-Przygodzki
-
Patent number: 11442983Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for contextually disambiguating queries are disclosed. In an aspect, a method includes receiving an image being presented on a display of a computing device and a transcription of an utterance spoken by a user of the computing device, identifying a particular sub-image that is included in the image, and based on performing image recognition on the particular sub-image, determining one or more first labels that indicate a context of the particular sub-image. The method also includes, based on performing text recognition on a portion of the image other than the particular sub-image, determining one or more second labels that indicate the context of the particular sub-image, based on the transcription, the first labels, and the second labels, generating a search query, and providing, for output, the search query.Type: GrantFiled: December 31, 2019Date of Patent: September 13, 2022Assignee: GOOGLE LLCInventors: Ibrahim Badr, Nils Grimsmo, Gokhan H. Bakir, Kamil Anikiej, Aayush Kumar, Viacheslav Kuznetsov
-
Patent number: 11423113Abstract: A computer-implemented method is described. The method includes a computing system receiving a first voice input from a user for generating a bookmark. Responsive to receiving the voice input, the computing system obtains a resource identifier associated with a resource page. The method includes the computing system storing the resource identifier as a bookmark in a bookmark index that is accessible in response to a request from a user device. The method further includes the computing system using the resource identifier, stored as the bookmark, to access the resource page. The computing system uses the resource identifier to access the resource page based on the request from the user device. The request is generated by the user device in response to the user device receiving a second voice input from the user.Type: GrantFiled: October 19, 2020Date of Patent: August 23, 2022Assignee: GOOGLE LLCInventors: Mugurel Ionut Andreica, Gokhan H. Bakir, Tak Keung Cheng, Marcin M. Nowak-Przygodzki
-
Publication number: 20210342047Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.Type: ApplicationFiled: July 19, 2021Publication date: November 4, 2021Inventors: Ibrahim Badr, Gokhan H. Bakir, Roland Peter Kehl, Nils Grimsmo
-
Patent number: 11120083Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information to a user. In one aspect, a method includes receiving, from a user device, a query-independent request for contextual information relevant to an active resource displayed in an application environment on the user device, generating multiple queries from displayed content from the resource, determining a quality score for each of the multiple queries, selecting one or more of the multiple queries based on their respective quality scores, and providing, to the user device for each of the selected one or more queries, a respective user interface element for display with the active resource, wherein each user interface element includes contextual information regarding the respective query and includes the respective query.Type: GrantFiled: November 14, 2019Date of Patent: September 14, 2021Assignee: GOOGLE LLCInventors: Michal Jastrzebski, Aurelien Boffy, Gokhan H. Bakir, Behshad Behzadi, Marcin M. Nowak-Przygodzki
-
Patent number: 11086493Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.Type: GrantFiled: June 18, 2020Date of Patent: August 10, 2021Assignee: Google LLCInventors: Ibrahim Badr, Gokhan H. Bakir, Roland Peter Kehl, Nils Grimsmo