Patents by Inventor Vitor Rocha de Carvalho

Vitor Rocha de Carvalho has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240037141
    Abstract: Systems, methods, devices, media, and computer readable instructions are described for local image tagging in a resource constrained environment. One embodiment involves processing image data using a deep convolutional neural network (DCNN) comprising at least a first subgraph and a second subgraph, the first subgraph comprising at least a first layer and a second layer, processing, the image data using at least the first layer of the first subgraph to generate first intermediate output data; processing, by the mobile device, the first intermediate output data using at least the second layer of the first subgraph to generate first subgraph output data, and in response to a determination that each layer reliant on the first intermediate data have completed processing, deleting the first intermediate data from the mobile device. Additional embodiments involve convolving entire pixel resolutions of the image data against kernels in different layers if the DCNN.
    Type: Application
    Filed: October 10, 2023
    Publication date: February 1, 2024
    Inventors: Xiaoyu Wang, Ning Xu, Ning Zhang, Vitor Rocha de Carvalho, Jia Li
  • Publication number: 20240022532
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use an attention-based mechanism that emphasis or de-emphasizes each data type (e.g., image, word, character) in the multimodal message based on each datatypes relevance. The output of the attention mechanism can be used to update a recurrent network to identify one or more words in the caption as being a named entity.
    Type: Application
    Filed: July 25, 2023
    Publication date: January 18, 2024
    Inventors: Vitor Rocha de Carvalho, Leonardo Ribas Machado das Neves, Seungwhan Moon
  • Publication number: 20230385551
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.
    Type: Application
    Filed: May 23, 2023
    Publication date: November 30, 2023
    Inventors: Di Lu, Leonardo Ribas Machado das Neves, Vitor Rocha de Carvalho, Ning Zhang
  • Publication number: 20230297775
    Abstract: Systems, devices, media, and methods are presented for generating a language detection model of a language analysis system. The systems and methods access a set of messages including text elements and convert the set of messages into a set of training messages. The set of training messages are configured for training a language detection model. The systems and methods train a classifier based on the set of training messages. The classifier has a set of features representing word frequency, character frequency, and a character ratio. The systems and methods generate a language detection model based on the classifier and the set of features.
    Type: Application
    Filed: May 25, 2023
    Publication date: September 21, 2023
    Inventors: Vitor Rocha de Carvalho, Luis Carlos Dos Santos Marujo, Leonardo Ribas Machado das Neves
  • Patent number: 11750547
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use an attention-based mechanism that emphasis or de-emphasizes each data type (e.g., image, word, character) in the multimodal message based on each datatypes relevance. The output of the attention mechanism can be used to update a recurrent network to identify one or more words in the caption as being a named entity.
    Type: Grant
    Filed: August 27, 2021
    Date of Patent: September 5, 2023
    Assignee: Snap Inc.
    Inventors: Vitor Rocha de Carvalho, Leonardo Ribas Machado das Neves, Seungwhan Moon
  • Patent number: 11704488
    Abstract: Systems, devices, media, and methods are presented for generating a language detection model of a language analysis system. The systems and methods access a set of messages including text elements and convert the set of messages into a set of training messages. The set of training messages are configured for training a language detection model. The systems and methods train a classifier based on the set of training messages. The classifier has a set of features representing word frequency, character frequency, and a character ratio. The systems and methods generate a language detection model based on the classifier and the set of features.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: July 18, 2023
    Assignee: Snap Inc.
    Inventors: Vitor Rocha de Carvalho, Luis Carlos Dos Santos Marujo, Leonardo Ribas Machado das Neves
  • Patent number: 11687720
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.
    Type: Grant
    Filed: May 3, 2021
    Date of Patent: June 27, 2023
    Assignee: Snap Inc.
    Inventors: Di Lu, Leonardo Ribas Machado das Neves, Vitor Rocha de Carvalho, Ning Zhang
  • Publication number: 20230013116
    Abstract: A machine learning based system can identify an entity as the likely subject of a multimodal message (e.g., a social media post having a short text phrase overlaid on an image) by creating embeddings for an image of the multimodal message and one or more string embeddings from text of the multimodal message. The embeddings can be weighted to maximize information gain, then recombined and compared against a result embedding database to identify an entity as the subject of the multimodal message.
    Type: Application
    Filed: September 15, 2022
    Publication date: January 19, 2023
    Inventors: Vitor Rocha de Carvalho, Leonardo Ribas Machado das Neves, Seungwhan Moon
  • Patent number: 11475254
    Abstract: A machine learning based system can identify an entity as the likely subject of a multimodal message (e.g., a social media post having a short text phrase overlaid on an image) by creating embeddings for an image of the multimodal message and one or more string embeddings from text of the multimodal message. The embeddings can be weighted to maximize information gain, then recombined and compared against a result embedding database to identify an entity as the subject of the multimodal message.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: October 18, 2022
    Assignee: Snap Inc.
    Inventors: Vitor Rocha de Carvalho, Leonardo Ribas Machado das Neves, Seungwhan Moon
  • Publication number: 20220092261
    Abstract: Systems, devices, media, and methods are presented for generating a language detection model of a language analysis system. The systems and methods access a set of messages including text elements and convert the set of messages into a set of training messages. The set of training messages are configured for training a language detection model. The systems and methods train a classifier based on the set of training messages. The classifier has a set of features representing word frequency, character frequency, and a character ratio. The systems and methods generate a language detection model based on the classifier and the set of features.
    Type: Application
    Filed: December 7, 2021
    Publication date: March 24, 2022
    Inventors: Vitor Rocha de Carvalho, Luis Carlos Dos Santos Marujo, Leonardo Ribas Machado das Neves
  • Patent number: 11210467
    Abstract: Systems, devices, media, and methods are presented for generating a language detection model of a language analysis system. The systems and methods access a set of messages including text elements and convert the set of messages into a set of training messages. The set of training messages are configured for training a language detection model. The systems and methods train a classifier based on the set of training messages. The classifier has a set of features representing word frequency, character frequency, and a character ratio. The systems and methods generate a language detection model based on the classifier and the set of features.
    Type: Grant
    Filed: April 13, 2018
    Date of Patent: December 28, 2021
    Assignee: Snap Inc.
    Inventors: Vitor Rocha de Carvalho, Luis Carlos Dos Santos Marujo, Leonardo Ribas Machado das Neves
  • Publication number: 20210390411
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use an attention-based mechanism that emphasis or de-emphasizes each data type (e.g., image, word, character) in the multimodal message based on each datatypes relevance. The output of the attention mechanism can be used to update a recurrent network to identify one or more words in the caption as being a named entity.
    Type: Application
    Filed: August 27, 2021
    Publication date: December 16, 2021
    Inventors: Vitor Rocha de Carvalho, Leonardo Ribas Machado das Neves, Seungwhan Moon
  • Patent number: 11120334
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use an attention-based mechanism that emphasis or de-emphasizes each data type (e.g., image, word, character) in the multimodal message based on each datatypes relevance. The output of the attention mechanism can be used to update a recurrent network to identify one or more words in the caption as being a named entity.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: September 14, 2021
    Assignee: Snap Inc.
    Inventors: Vitor Rocha de Carvalho, Leonardo Ribas Machado das Neves, Seungwhan Moon
  • Publication number: 20210256213
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.
    Type: Application
    Filed: May 3, 2021
    Publication date: August 19, 2021
    Inventors: Di Lu, Leonardo Ribas Machado das Neves, Vitor Rocha de Carvalho, Ning Zhang
  • Patent number: 11017173
    Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: May 25, 2021
    Assignee: Snap Inc.
    Inventors: Di Lu, Leonardo Ribas Machado das Neves, Vitor Rocha de Carvalho, Ning Zhang
  • Patent number: 9622177
    Abstract: A context aware system, for use in a mobile device, includes a context change detector (CCD) coupled to a context classifier (CCL). The CCD is configured to receive sensor data and to detect a change in a current context state of the mobile device based on the received sensor data. The CCL is configured to transition from a low power consumption mode to a normal power consumption mode in response to the CCD detecting the change in the current context state. The CCL is further configured to determine a next context state of the mobile device while in the normal power consumption mode.
    Type: Grant
    Filed: August 6, 2015
    Date of Patent: April 11, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Tadeusz Jarosinski, Shankar Sadasivam, Ryan Michael Carey, Jinwon Lee, Bhuwan Dhingra, Abhijeet Bisain, Vitor Rocha de Carvalho, Rajeev Jain, Muralidhar Reddy Akula, Ashwin Swaminathan
  • Publication number: 20170041874
    Abstract: A context aware system, for use in a mobile device, includes a context change detector (CCD) coupled to a context classifier (CCL). The CCD is configured to receive sensor data and to detect a change in a current context state of the mobile device based on the received sensor data. The CCL is configured to transition from a low power consumption mode to a normal power consumption mode in response to the CCD detecting the change in the current context state. The CCL is further configured to determine a next context state of the mobile device while in the normal power consumption mode.
    Type: Application
    Filed: August 6, 2015
    Publication date: February 9, 2017
    Inventors: Tadeusz JAROSINSKI, Shankar SADASIVAM, Ryan Michael CAREY, Jinwon LEE, Bhuwan DHINGRA, Abhijeet BISAIN, Vitor Rocha de CARVALHO, Rajeev JAIN, Muralidhar Reddy AKULA, Ashwin SWAMINATHAN
  • Patent number: 8135728
    Abstract: Extraction analysis techniques biased, in part, by query frequency information from a query log file and/or search engine cache are employed along with machine learning processes to determine candidate keywords and/or phrases of web documents. Web oriented features associated with the candidate keywords and/or phrases are also utilized to analyze the web documents. A keyword and/or phrase extraction mechanism can be utilized to score keywords and/or phrases in a web document and estimate a likelihood that the keywords and/or phrases are relevant, for example, in an advertising system and the like.
    Type: Grant
    Filed: January 3, 2007
    Date of Patent: March 13, 2012
    Assignee: Microsoft Corporation
    Inventors: Wen-tau Yih, Joshua T. Goodman, Vitor Rocha de Carvalho