Patents by Inventor Timo Mertens

Timo Mertens has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11947603
    Abstract: The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.
    Type: Grant
    Filed: January 23, 2023
    Date of Patent: April 2, 2024
    Assignee: GOOGLE LLC
    Inventors: Vinh Quoc Ly, Ahmet Onur Tekdas, Timo Mertens, Okan Kolak, Charles Randell Sievert, Christine Nguyen, Jin Lu
  • Patent number: 11941345
    Abstract: A computer-implemented process is programmed to process a source input, determine text enhancements, and present the text enhancements to apply to the sentences dictated from the source input. A text processor may use machine-learning models to process an audio input to generate sentences in a presentable format. An audio input can be processed by an automatic speech recognition model to generate electronic text. The electronic text may be used to generate sentence structures using a normalization model. A comprehension model may be used to identify instructions associated with the sentence structures and generate sentences based on the instructions and the sentence structures. An enhancement model may be used to identify enhancements to apply to the sentences. The enhancements may be presented alongside sentences generated by the comprehension model to provide the user an option to select either the enhancements or the sentences.
    Type: Grant
    Filed: October 26, 2021
    Date of Patent: March 26, 2024
    Assignee: Grammarly, Inc.
    Inventors: Timo Mertens, Vipul Raheja, Chad Mills, Ihor Skliarevskyi, Ignat Blazhko, Robyn Perry, Nicholas Bern, Dhruv Kumar, Melissa Lopez
  • Publication number: 20230237104
    Abstract: The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.
    Type: Application
    Filed: January 23, 2023
    Publication date: July 27, 2023
    Inventors: Vinh Quoc Ly, Ahmet Onur Tekdas, Timo Mertens, Okan Kolak, Charles Randell Sievert, Christine Nguyen, Jin Lu
  • Publication number: 20230125194
    Abstract: A computer-implemented process is programmed to process a source input, determine text enhancements, and present the text enhancements to apply to the sentences dictated from the source input. A text processor may use machine-learning models to process an audio input to generate sentences in a presentable format. An audio input can be processed by an automatic speech recognition model to generate electronic text. The electronic text may be used to generate sentence structures using a normalization model. A comprehension model may be used to identify instructions associated with the sentence structures and generate sentences based on the instructions and the sentence structures. An enhancement model may be used to identify enhancements to apply to the sentences. The enhancements may be presented alongside sentences generated by the comprehension model to provide the user an option to select either the enhancements or the sentences.
    Type: Application
    Filed: October 26, 2021
    Publication date: April 27, 2023
    Inventors: Timo Mertens, Vipul Raheja, Chad Mills, Ihor Skliarevskyi, Ignat Blazhko, Robyn Perry, Nicholas Bern, Dhruv Kumar, Melissa Lopez
  • Publication number: 20230042473
    Abstract: A collaborative content management system allows multiple users to access and modify collaborative documents. When audio data is recorded by or uploaded to the system, the audio data may be transcribed or summarized to improve accessibility and user efficiency. Text transcriptions are associated with portions of the audio data representative of the text, and users can search the text transcription and access the portions of the audio data corresponding to search queries for playback. An outline can be automatically generated based on a text transcription of audio data and embedded as a modifiable object within a collaborative document. The system associates hot words with actions to modify the collaborative document upon identifying the hot words in the audio data. Collaborative content management systems can also generate custom lexicons for users based on documents associated with the user for use in transcribing audio data, ensuring that text transcription is more accurate.
    Type: Application
    Filed: October 7, 2022
    Publication date: February 9, 2023
    Inventors: Timo Mertens, Bradley Neuberg
  • Patent number: 11562036
    Abstract: The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.
    Type: Grant
    Filed: January 10, 2020
    Date of Patent: January 24, 2023
    Assignee: GOOGLE LLC
    Inventors: Vinh Quoc Ly, Ahmet Onur Tekdas, Timo Mertens, Okan Kolak, Charles Randell Sievert, Christine Nguyen, Jin Lu
  • Patent number: 11488602
    Abstract: A collaborative content management system allows multiple users to access and modify collaborative documents. When audio data is recorded by or uploaded to the system, the audio data may be transcribed or summarized to improve accessibility and user efficiency. Text transcriptions are associated with portions of the audio data representative of the text, and users can search the text transcription and access the portions of the audio data corresponding to search queries for playback. An outline can be automatically generated based on a text transcription of audio data and embedded as a modifiable object within a collaborative document. The system associates hot words with actions to modify the collaborative document upon identifying the hot words in the audio data. Collaborative content management systems can also generate custom lexicons for users based on documents associated with the user for use in transcribing audio data, ensuring that text transcription is more accurate.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: November 1, 2022
    Assignee: Dropbox, Inc.
    Inventors: Timo Mertens, Bradley Neuberg
  • Patent number: 11354367
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-storage medium, for using a search engine implemented on a user device to identify topics or tasks associated with native application content. The method may include actions of receiving a set of data that is generated by the native application and that includes (i) native application content, and (ii) context information associated with the native application content, indexing the data on the user device, and then identifying one or more tasks based on the indexed data.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: June 7, 2022
    Assignee: GOOGLE LLC
    Inventors: Timo Mertens, Maxim Gubin
  • Publication number: 20220147948
    Abstract: The present disclosure relates to generating and utilizing digital associations between digital documents and digital calendar events based on determined content connections. For example, one or more embodiments suggest a digital document to a user for association with a digital calendar event based on content connections between the digital document and the digital calendar event. In particular, one or more embodiments determine a content connection based on document characteristics (e.g., document content and access characteristics) and calendar event characteristics (e.g., calendar content and historical meeting information). For example, the system can train a machine learning model to determine content connections based on document characteristics and calendar event characteristics.
    Type: Application
    Filed: January 25, 2022
    Publication date: May 12, 2022
    Inventors: Kavitha Radhakrishnan, Timo Mertens, Neil Sethi, David Stinnette, Justin Hileman, Adam LaFave
  • Patent number: 11275891
    Abstract: A collaborative content management system allows multiple users to access and modify collaborative documents. When audio data is recorded by or uploaded to the system, the audio data may be transcribed or summarized to improve accessibility and user efficiency. Text transcriptions are associated with portions of the audio data representative of the text, and users can search the text transcription and access the portions of the audio data corresponding to search queries for playback. An outline can be automatically generated based on a text transcription of audio data and embedded as a modifiable object within a collaborative document. The system associates hot words with actions to modify the collaborative document upon identifying the hot words in the audio data. Collaborative content management systems can also generate custom lexicons for users based on documents associated with the user for use in transcribing audio data, ensuring that text transcription is more accurate.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: March 15, 2022
    Assignee: DROPBOX, INC.
    Inventors: Timo Mertens, Bradley Neuberg
  • Patent number: 11238414
    Abstract: The present disclosure relates to generating and utilizing digital associations between digital documents and digital calendar events based on determined content connections. For example, one or more embodiments suggest a digital document to a user for association with a digital calendar event based on content connections between the digital document and the digital calendar event. In particular, one or more embodiments determine a content connection based on document characteristics (e.g., document content and access characteristics) and calendar event characteristics (e.g., calendar content and historical meeting information). For example, the system can train a machine learning model to determine content connections based on document characteristics and calendar event characteristics.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: February 1, 2022
    Assignee: Dropbox, Inc.
    Inventors: Kavitha Radhakrishnan, Timo Mertens, Neil Sethi, David Stinnette, Justin Hileman, Adam LaFave
  • Publication number: 20210089709
    Abstract: A collaborative content management system allows multiple users to access and modify collaborative documents. When audio data is recorded by or uploaded to the system, the audio data may be transcribed or summarized to improve accessibility and user efficiency. Text transcriptions are associated with portions of the audio data representative of the text, and users can search the text transcription and access the portions of the audio data corresponding to search queries for playback. An outline can be automatically generated based on a text transcription of audio data and embedded as a modifiable object within a collaborative document. The system associates hot words with actions to modify the collaborative document upon identifying the hot words in the audio data. Collaborative content management systems can also generate custom lexicons for users based on documents associated with the user for use in transcribing audio data, ensuring that text transcription is more accurate.
    Type: Application
    Filed: December 8, 2020
    Publication date: March 25, 2021
    Inventors: Timo Mertens, Bradley Neuberg
  • Patent number: 10943060
    Abstract: A collaborative content management system allows multiple users to access and modify collaborative documents. When audio data is recorded by or uploaded to the system, the audio data may be transcribed or summarized to improve accessibility and user efficiency. Text transcriptions are associated with portions of the audio data representative of the text, and users can search the text transcription and access the portions of the audio data corresponding to search queries for playback. An outline can be automatically generated based on a text transcription of audio data and embedded as a modifiable object within a collaborative document. The system associates hot words with actions to modify the collaborative document upon identifying the hot words in the audio data. Collaborative content management systems can also generate custom lexicons for users based on documents associated with the user for use in transcribing audio data, ensuring that text transcription is more accurate.
    Type: Grant
    Filed: October 18, 2019
    Date of Patent: March 9, 2021
    Assignee: Dropbox, Inc.
    Inventors: Timo Mertens, Bradley Neuberg
  • Publication number: 20210029131
    Abstract: Techniques are described herein for automatically permitting interactive assistant modules to provide access to resources controlled by users. In various implementations, an interactive assistant module may receive a request by a first user for access to a given resource controlled by a second user. The interactive assistant module may lack prior permission to provide the first user access to the given resource. The interactive assistant module may determine attribute(s) of a relationship between the first and second users, as well as attribute(s) of other relationship(s) between the second user and other user(s) for which the interactive assistant module has prior permission to provide access to the given resource. The interactive assistant module may compare the attribute(s) of the relationship with the attribute(s) of the other relationship(s), and may conditionally assume, based on the comparing, permission to provide the first user access to the given resource.
    Type: Application
    Filed: October 14, 2020
    Publication date: January 28, 2021
    Inventors: Timo Mertens, Okan Kolak
  • Patent number: 10866926
    Abstract: The disclosed technology relates to a system configured to receive a first input into a search interface and perform a first search based on the first input, wherein the first search is performed on a first set of content items managed by a content management system. The system further receives a second input into the search interface and performs, in response to receiving the second input, a second search based on the first input, wherein the second search is performed on a second set of content items managed by the content management system.
    Type: Grant
    Filed: December 8, 2017
    Date of Patent: December 15, 2020
    Assignee: Dropbox, Inc.
    Inventors: Timo Mertens, Mariana Stepp, Sam Jau, Michael Wu
  • Patent number: 10867122
    Abstract: From the content of a document, a factual entity that relates to the content of the document is determined. Content for a knowledge panel is requested. A knowledge panel is a user interface element that provides a collection of content related to the factual entity. The contents of the knowledge panel is received for contemporaneous display on the user device with the content of the document.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: December 15, 2020
    Assignee: Google LLC
    Inventors: Timo Mertens, Robin Dua
  • Patent number: 10795947
    Abstract: The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: October 6, 2020
    Assignee: GOOGLE LLC
    Inventors: Vinh Quoc Ly, Ahmet Onur Tekdas, Timo Mertens, Okan Kolak, Charles Randell Sievert, Christine Nguyen, Jin Lu
  • Publication number: 20200233914
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-storage medium, for using a search engine implemented on a user device to identify topics or tasks associated with native application content. The method may include actions of receiving a set of data that is generated by the native application and that includes (i) native application content, and (ii) context information associated with the native application content, indexing the data on the user device, and then identifying one or more tasks based on the indexed data.
    Type: Application
    Filed: April 2, 2020
    Publication date: July 23, 2020
    Inventors: Timo Mertens, Maxim Gubin
  • Patent number: 10657954
    Abstract: A collaborative content management system allows multiple users to access and modify collaborative documents. When audio data is recorded by or uploaded to the system, the audio data may be transcribed or summarized to improve accessibility and user efficiency. Text transcriptions are associated with portions of the audio data representative of the text, and users can search the text transcription and access the portions of the audio data corresponding to search queries for playback. An outline can be automatically generated based on a text transcription of audio data and embedded as a modifiable object within a collaborative document. The system associates hot words with actions to modify the collaborative document upon identifying the hot words in the audio data. Collaborative content management systems can also generate custom lexicons for users based on documents associated with the user for use in transcribing audio data, ensuring that text transcription is more accurate.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: May 19, 2020
    Assignee: Dropbox, Inc.
    Inventors: Timo Mertens, Bradley Neuberg
  • Publication number: 20200151223
    Abstract: The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.
    Type: Application
    Filed: January 10, 2020
    Publication date: May 14, 2020
    Inventors: Vinh Quoc Ly, Ahmet Onur Tekdas, Timo Mertens, Okan Kolak, Charles Randell Sievert, Christine Nguyen, Jin Lu