Patents by Inventor Krish Perumal

Krish Perumal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Apparatus for vision and language-assisted smartphone task automation and method thereof
    Patent number: 11194448
    Abstract: An apparatus for vision and language-assisted smartphone task automation, includes a processor configured to execute instructions to identify whether an utterance of a user refers to one among at least one existing automation script, and based on the utterance being identified to not refer to the one among the at least one existing automation script, capture one or more screenshots and one or more coordinates of a display, the one or more screenshots and the one or more coordinates corresponding to one or more interactions of the user with the display while the user is demonstrating a new automation script, perform object detection and optical character recognition on the captured one or more screenshots and the captured one or more coordinates to obtain user interface (UI) elements corresponding to the one or more interactions, and obtain the new automation script, based on the obtained UI elements.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: December 7, 2021
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Alborz Rezazadeh Sereshkeh, Gary Leung, Krish Perumal, Iqbal Mohomed, Afsaneh Fazly, Caleb Phillips, Minfan Zhang
  • APPARATUS FOR VISION AND LANGUAGE-ASSISTED SMARTPHONE TASK AUTOMATION AND METHOD THEREOF
    Publication number: 20200285353
    Abstract: An apparatus for vision and language-assisted smartphone task automation, includes a processor configured to execute instructions to identify whether an utterance of a user refers to one among at least one existing automation script, and based on the utterance being identified to not refer to the one among the at least one existing automation script, capture one or more screenshots and one or more coordinates of a display, the one or more screenshots and the one or more coordinates corresponding to one or more interactions of the user with the display while the user is demonstrating a new automation script, perform object detection and optical character recognition on the captured one or more screenshots and the captured one or more coordinates to obtain user interface (UI) elements corresponding to the one or more interactions, and obtain the new automation script, based on the obtained UI elements.
    Type: Application
    Filed: December 20, 2019
    Publication date: September 10, 2020
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Alborz Rezazadeh Sereshkeh, Gary Leung, Krish Perumal, Iqbal Mohomed, Afsaneh Fazly, Caleb Phillips, Minfan Zhang