Playback Of Recorded User Events (e.g., Script Or Macro Playback) Patents (Class 715/704)
  • Patent number: 12041309
    Abstract: In some implementations, a first device can record a display screen of a second device remotely. For example, the first device (e.g., a remote computing device) can receive information identifying other computing devices on a network. The first device can receive a selection of one of the other computing devices (e.g., the second device) and send a message to the second device to initiate a recording of the display screen of the second device. In response to receiving the message, the second device can record video frames of images presented on the display of the second device. The second device can send the video frames to the first device for display and/or storage. While recording the images presented on the display screen, the second device can present indicia on the display screen of the second device indicating that a screen recording is in progress.
    Type: Grant
    Filed: September 28, 2022
    Date of Patent: July 16, 2024
    Assignee: Apple Inc.
    Inventors: Vikrant Kasarabada, Gennadiy Shekhtman, Elena Leyfman, Gregory R. Chapman, Chendi Zhang
  • Patent number: 12032639
    Abstract: A media system includes: a media-playback device including: a media-output device that plays media content items; and a tempo control engine to: select media content based upon suitability for a repetitive-motion activity; place each media content item from the media content into two or more pools of media content, with a first pool including media content which the user has previously indicated as being relevant, and a second pool including media content that the user has not previously indicated as being relevant; and sort the media content in each of the first pool and the second pool based upon tempo.
    Type: Grant
    Filed: August 6, 2021
    Date of Patent: July 9, 2024
    Assignee: Spotify AB
    Inventors: Tristan Jehan, Nicola Montecchio
  • Patent number: 11924175
    Abstract: Embodiments described herein are directed to intelligently classifying Web trackers in a privacy preserving manner and mitigating the effects of such Web trackers. As users browse the Web and encounter various Web sites, tracker-related metrics are determined. The metrics are obfuscated to protect the privacy of the user. The obfuscated metrics are provided as inputs to a machine learning model, which is configured to output a classification for the Web trackers associated with the Web sites visited by the user. Depending on the classification, the effects of the Web trackers are mitigated by placing restrictions on the Web trackers. The restrictions for a particular Web tracker may be relaxed based on a level of user engagement a user has with respect to the tracker's associated Web site. By doing so, the compatibility risks associated with tracking prevention are mitigated for Web sites that are relatively important to the user.
    Type: Grant
    Filed: October 26, 2022
    Date of Patent: March 5, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Brandon J. Maslen, Edward Arther Scott Low
  • Patent number: 11886895
    Abstract: A software robot is configured to automatically identify a target element (e.g., a button, a form field, etc.) within a user interface (UI) according to a set of attributes of the target element specified in the source-code of the respective UI. The robot's code specification includes a multiplicity flag which, when set, causes the robot to search for the target element within multiple instances of a UI object matching a subset of the set attributes (for instance, within all windows having a specific name, within all browser tabs, etc.
    Type: Grant
    Filed: April 24, 2023
    Date of Patent: January 30, 2024
    Assignee: UiPath Inc.
    Inventor: Dan V. Munteanu
  • Patent number: 11822873
    Abstract: Disclosed is a system for generating a document having a sequence of steps. A user input selecting an element of an application is received, where the user input indicates the element corresponds to a step in the sequence of steps to be represented in the document. A record is stored, where the record includes at least data representing the selected element and a sequence identifier, indicating a relative position of the step within the sequence of steps. The document is generated by using the data in the record to generate a visual portion for the step, and using the sequence identifier to determine a position of the visual portion in the document relative to another visual portion(s) representing another step(s) in the sequence of steps.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: November 21, 2023
    Inventor: Manbinder Pal Singh
  • Patent number: 11816175
    Abstract: Methods, systems, and computer programs are presented for analyzing multiple states of a webpage. One method includes operations for tracking user activity for a set of users while interacting with a webpage to obtain session replay data. Further, the method includes analyzing the session replay data to obtain states for the webpage and causing presentation of a first user interface (UI) for selecting one state. The method further includes receiving a selection of a first state and causing presentation of a second UI for configuring tracking options to track the first state while users viewing the webpage are in the first state. The method further includes receiving, in the second UI, tracking options values for the first state, analyzing views of the first state of the webpage based on the tracking options values, and causing presentation of performance metrics associated with the first state based on the analyzed views.
    Type: Grant
    Filed: December 19, 2022
    Date of Patent: November 14, 2023
    Assignee: Content Square SAS
    Inventors: Antoine Guo, Sylvain Cousquer
  • Patent number: 11803397
    Abstract: Use of artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: October 31, 2023
    Assignee: UiPath, Inc.
    Inventor: Prabhdeep Singh
  • Patent number: 11785289
    Abstract: A receiving device is provided. The receiving devices includes circuitry that is configured to execute an application related to a program or a channel, The circuitry is configured to set, based on the application, broadcast reception data from a broadcast as a media source object corresponding to a processing object of media reproduction. The circuitry is configured to obtain, based on the application, broadcast content segment information of broadcast content in the broadcast reception data that is stored in a buffer associated with the media source object. The circuitry is configured to perform, based on the application and the broadcast content segment information of a segment of the broadcast content to be replaced being obtained, replacement or appendance of the broadcast content in the broadcast reception data stored in the buffer with network content in application reception data received via a network.
    Type: Grant
    Filed: June 16, 2021
    Date of Patent: October 10, 2023
    Assignee: Saturn Licensing LLC
    Inventors: Tatsuya Igarashi, Norifumi Kikkawa, Yoshiharu Dewa, Yasuaki Yamagishi
  • Patent number: 11776506
    Abstract: Systems and techniques for aggregation, display, and sharing of data. Graphic items representing data objects identified by a data package may be displayed on timelines. Each timeline may be associated with a respective class of data, and each graphic item displayed on a respective timeline may represent one or more of the data objects in the class associated with the respective timeline.
    Type: Grant
    Filed: October 11, 2021
    Date of Patent: October 3, 2023
    Assignee: Synthro Inc.
    Inventors: Michael A. Greco, Michael J. Pulaski, Jr., Patrick J. Bradley, Alexandre Chailleux, Steven D. Phelps, Ronald A. Matsumoto, David J. Pacini, Luc A. Heinrich
  • Patent number: 11727012
    Abstract: A modular and distributed architecture for data stream processing and analysis is described to incorporate data stream analytics capabilities, called Data Stream Analytics Service (DSAS) in the IoT/M2M service layer. Each service layer node hosting DSAS can be split into two independent modules, Stream Forwarder and Stream Analytics Engine. Stream Forwarder is a light weight processing modules that can be responsible for data preprocessing and routing. Stream Analytics Engine is responsible for performing actual analytics on the data stream. Separating the two functionalities enables the service layer nodes to efficiently distribute stream analytics tasks across multiple nodes.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: August 15, 2023
    Assignee: Convida Wireless, LLC
    Inventors: Sneha Aman Singh, Xu Li, Quang Ly, Gregory S. Sternberg, Shamim Akbar Rahman, Chonggang Wang
  • Patent number: 11721081
    Abstract: Systems and methods are provided for a workflow framework that scriptwriters can utilize when developing (live-action/animation/cinematic) virtual reality (VR) experiences or content. A script can be parsed to identify one or more elements in a script, and a VR representation of the one or more elements can be automatically generated. A user may develop or edit the script which can be presented in a visual and temporal manner along with the VR representation. The user may edit the VR representation, and the visual and temporal presentation of the script can be commensurately represented. The script may be analyzed for consistency and/or cohesiveness in the context of the VR representation or experience. A preview of the VR experience or content can be generated from the script and/or the VR representation.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: August 8, 2023
    Assignee: Disney Enterprises, Inc.
    Inventors: Sasha Anna Schriber, Isa Simo, Merada Richter, Mubbasir Kapadia, Markus Gross
  • Patent number: 11635977
    Abstract: A software robot is configured to automatically identify a target element (e.g., a button, a form field, etc.) within a user interface (UI) according to a set of attributes of the target element specified in the source-code of the respective UI. The robot's code specification includes a multiplicity flag which, when set, causes the robot to search for the target element within multiple instances of a UI object matching a subset of the set attributes (for instance, within all windows having a specific name, within all browser tabs, etc.
    Type: Grant
    Filed: July 31, 2022
    Date of Patent: April 25, 2023
    Assignee: UiPath Inc.
    Inventor: Dan V. Munteanu
  • Patent number: 11522837
    Abstract: Embodiments described herein are directed to intelligently classifying Web trackers in a privacy preserving manner and mitigating the effects of such Web trackers. As users browse the Web and encounter various Web sites, tracker-related metrics are determined. The metrics are obfuscated to protect the privacy of the user. The obfuscated metrics are provided as inputs to a machine learning model, which is configured to output a classification for the Web trackers associated with the Web sites visited by the user. Depending on the classification, the effects of the Web trackers are mitigated by placing restrictions on the Web trackers. The restrictions for a particular Web tracker may be relaxed based on a level of user engagement a user has with respect to the tracker's associated Web site. By doing so, the compatibility risks associated with tracking prevention are mitigated for Web sites that are relatively important to the user.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: December 6, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Brandon J. Maslen, Edward Arthur Scott Low
  • Patent number: 11490160
    Abstract: In some implementations, a first device can record a display screen of a second device remotely. For example, the first device (e.g., a remote computing device) can receive information identifying other computing devices on a network. The first device can receive a selection of one of the other computing devices (e.g., the second device) and send a message to the second device to initiate a recording of the display screen of the second device. In response to receiving the message, the second device can record video frames of images presented on the display of the second device. The second device can send the video frames to the first device for display and/or storage. While recording the images presented on the display screen, the second device can present indicia on the display screen of the second device indicating that a screen recording is in progress.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: November 1, 2022
    Assignee: Apple Inc.
    Inventors: Vikrant Kasarabada, Gennadiy Shekhtman, Elena Leyfman, Gregory R. Chapman, Chendi Zhang
  • Patent number: 11467887
    Abstract: The present disclosure relates to systems and techniques for developing APIs that utilize multiple pre-existing APIs. The present disclosure also relates to a user interface that allows for chaining APIs together as a function of multiple pre-existing APIs. The present disclosure also relates to security and authorization of a user to execute one or more APIs as part of an API chain.
    Type: Grant
    Filed: April 24, 2018
    Date of Patent: October 11, 2022
    Assignee: Palantir Technologies Inc.
    Inventors: Elizabeth Caudill, Siyuan Chen, Parker Phillips, Samuel Rogerson
  • Patent number: 11340917
    Abstract: Use of artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: May 24, 2022
    Assignee: UiPath, Inc.
    Inventor: Prabhdeep Singh
  • Patent number: 11334745
    Abstract: An electronic device according to one embodiment of the present invention comprises: at least one communication interface; a display; a memory; and at least one processor electrically connected to the at least one communication interface, the display, and the memory, wherein the memory may store instructions which, when executed, cause the at least one processor to: acquire, in response to receiving a request for service information related to broadcast content sent from a content server, at least one image frame included in the broadcast content; determine whether at least one face region has been detected within the at least one image frame; perform, if the at least one face region is determined to have been detected, image analysis on the basis of the detected at least one face region; and provide, through the display, service information corresponding to a result of the image analysis. In addition, various embodiments are possible.
    Type: Grant
    Filed: November 22, 2018
    Date of Patent: May 17, 2022
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Jongho Kim, Jungkun Lee, Gippeum Choi
  • Patent number: 11301269
    Abstract: Use of artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.
    Type: Grant
    Filed: October 14, 2020
    Date of Patent: April 12, 2022
    Assignee: UiPath, Inc.
    Inventor: Prabhdeep Singh
  • Patent number: 11302047
    Abstract: In various embodiments, a storyboarding application generates a storyboard for a media title. In operation, the storyboarding application determines a categorization for a first portion of the media item. The storyboarding application then determines a first media item based on at least one of the categorization or a caption associated with the first portion of the media title. Subsequently, the storyboarding application modifies the first media item based on at least one of the categorization or a character associated with the caption to generate a second media item. The storyboarding application then generates a sequence of media items for the storyboard that includes the second media item. Advantageously, because the storyboarding application can automatically generate media items for storyboards based on categorizations and/or captions, the storyboarding application can reduce both the manual effort and time required to generate storyboards relative to prior art techniques.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: April 12, 2022
    Assignee: Disney Enterprises, Inc.
    Inventors: Erika Varis Doggett, Mark Arana, Michael Goslin
  • Patent number: 11301477
    Abstract: Systems and processes for operating an intelligent automated assistant are provided. In accordance with one example, a method includes, at an electronic device with one or more processors and memory, obtaining a first set of data corresponding to one or more interactions between a user and the digital assistant on the electronic device; obtaining a second set of data corresponding to one or more interactions between the user and an application on the electronic device; and storing the first set of data and the second set of data. The method further includes receiving a set of executable instructions; processing, based on the received set of executable instructions, the first set of data and the second set of data to obtain a third set of data; and transmitting the third set of data to a remote electronic device.
    Type: Grant
    Filed: August 11, 2017
    Date of Patent: April 12, 2022
    Assignee: Apple Inc.
    Inventors: Gennaro Frazzingaro, Ashish Garg, Blaise Thomson, Anuj Kumar, Rushin N. Shah, Matthew S. Seigel, Lin Li
  • Patent number: 11281362
    Abstract: Graphical element detection using a combined series and delayed parallel execution unified target technique that potentially uses a plurality of graphical element detection techniques, performs default user interface (UI) element detection technique configuration at the application and/or UI type level, or both, is disclosed. The unified target merges multiple techniques of identifying and automating UI elements into a single cohesive approach. A unified target descriptor chains together multiple types of UI descriptors in series, uses them in parallel, or uses at least one technique first for a period of time and then runs at least one other technique in parallel or alternatively if the first technique does not find a match within the time period.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: March 22, 2022
    Assignee: UiPath, Inc.
    Inventor: Daniel Dines
  • Patent number: 11263285
    Abstract: An improved process for recreating a webpage as presented to the visitor is provided. A skeleton of a webpage, including content and images of the webpage, may be captured for each web event. For each web event, the captured skeleton of the webpage, including the content and the image of the captured webpage, may be transmitted to a server, allowing the server to recreate a webpage that was presented to the visitor.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: March 1, 2022
    Assignee: Lead Intelligence, Inc.
    Inventors: Matt Butt, Ian Carpenter, Alexander Martin, Emanuel I. Wald, Jason Watt
  • Patent number: 11232252
    Abstract: Computer-implemented techniques are disclosed for presenting an in-page console on a website for reviewing interaction data captured during user interaction with one or more web pages of the website. The web browser activates the in-page console via an activation procedure. One or more of the web pages of the website are selected after activation of the in-page console. A feedback badge on the website can be replaced with a reporting badge upon activation of the in-page console and with the reporting badge displaying an indicator of interaction data captured for the selected web page. The in-page console is overlaid one or more of the selected web pages. The in-page console displays the interaction data, or recordings of user interaction, captured during user interaction with the selected web page to enable review of the captured interaction data for the selected web page overlaid on the selected web page.
    Type: Grant
    Filed: September 1, 2017
    Date of Patent: January 25, 2022
    Assignee: Verint Americas Inc.
    Inventors: Michael B. Hunigan, Alexei White
  • Patent number: 11170402
    Abstract: The disclosure is directed to approaches for combining server-side decisions based on user attributes and/or demographics with client-side decisions based on expressed or implied user interests determined based on the contents of a web page being visited by the user. A server is responsive to an occurrence of an operation of a client device at the web page. Processing steps determine particular executable web page content to send to the client device (e.g., where the particular executable web page content is determined in response to a particular client-side operation). The web page is rendered with the aforementioned executable web page content. Server-side processing receives messages that are emitted conditionally, based on the occurrence of a user event. An event log message comprises a portion of the web page, such as a string, indicating or implying user interest. A targeted advertisement is presented to the user based on the user interest.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: November 9, 2021
    Assignee: ORACLE INTERNATIONAL CORPORATION
    Inventors: David Abraham Wiener, David Scott Gardner
  • Patent number: 11170316
    Abstract: The system and method for determining fuzzy cause and effect relationships in an intelligent workload management system described herein may combine potential causes and effects captured from various different sources associated with an information technology infrastructure with substantially instantaneous feedback mechanisms and other knowledge sources. As such, fuzzy correlation logic may then be applied to the combined information to determine potential cause and effect relationships and thereby diagnose problems and otherwise manage interactions that occur in the infrastructure. For example, information describing potential causes and potential effects associated with an operational state of the infrastructure may be captured and combined, and any patterns among the information that describes the multiple potential causes and effects may then be identified.
    Type: Grant
    Filed: April 9, 2018
    Date of Patent: November 9, 2021
    Assignee: Micro Focus Software Inc.
    Inventors: Jeremy Ray Brown, Jason Allen Sabin, Nathaniel Brent Kranendonk, Kal A. Larsen, Lloyd Leon Burch, Michael Fairbanks, Michael John Jorgensen, Thomas Larry Biggs
  • Patent number: 11165580
    Abstract: A privacy-enabled system for securely transmitting encrypted data is provided. The system comprises: a memory device with computer-readable program code stored thereon; a communication device connected to a network; and a processing device configured to: receive a request for a resource transfer of a resource from a user resource location associated with a user to a destination device associated with a third party; determine a data requirement for completing the resource transfer, wherein the data requirement is a minimum amount of user resource location data required for directing the resource from the user resource location to the destination device and completing the resource transfer; based on determining the data requirement, generate a transmission package comprising the resource, wherein the transmission package has at least a portion of the user resource location data removed or modified; and deliver the transmission package to the destination device to complete the resource transfer.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: November 2, 2021
    Assignee: BANK OF AMERICA CORPORATION
    Inventors: Elena Kvochko, Lalit Dhawan
  • Patent number: 11157128
    Abstract: A system for remotely controlling multiple application programs executing on multiple respective physical computing devices, the system comprising a first computing device, comprising a first processor, and configured to execute a first application program; a second computing device, comprising a second processor, and configured to execute a second application program; and a controller configured to perform: generating, based on first information obtained from the first computing device and second information obtained from the second computing device, a global object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program and the second application program; controlling the first application program to perform the first sub-task at least in part by using the global object hierarchy; and controlling the second application program to perform the second sub-task at least in part by using the global object hierarchy.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: October 26, 2021
    Assignee: Soroco Private Limited
    Inventors: George Peter Nychis, Rohan Narayan Murty
  • Patent number: 11102396
    Abstract: An electronic device sets, in accordance with a use operation, which one of a plurality of objects is to be used to display a specific setting item on a setting screen. The plurality of objects include a first object and a second object whose display size, information amount to be displayed, and number of types of operable setting values are larger than the first object. In case where the first object is displayed on the setting screen, the electronic device changes a first setting value concerning the specific setting item in accordance with an operation on one of a first or second operation member. In case where the second object is displayed on the setting screen, the electronic device changes the first and second setting values in accordance with the operations on the first and second operation members, respectively.
    Type: Grant
    Filed: August 22, 2019
    Date of Patent: August 24, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Seiji Kobayashi, Yuko Izaki, Makoto Kameyama, Kazutaka Kondo, Tomoaki Takahashi
  • Patent number: 11095670
    Abstract: In one example embodiment, a network management device generates a first script defining a first function for detecting a first customizable network event in a sequence of customizable network events indicative of a security threat to a network. The network management device activates the first script at a first network device in the network so as to cause the first network device to execute the first function for detecting the first customizable network event, and obtains, from the first network device, one or more indications that the first network device has detected the first customizable network event. Based on the one or more indications, the network management device determines whether to activate a second script defining a second function for detecting a second customizable network event in the sequence at a second network device in the network capable of detecting the second customizable network event.
    Type: Grant
    Filed: July 9, 2018
    Date of Patent: August 17, 2021
    Assignee: CISCO TECHNOLOGY, INC.
    Inventors: Subharthi Paul, Saman Taghavi Zargar, Jayaraman Iyer, Hari Shankar
  • Patent number: 11095949
    Abstract: The methods and systems described herein provide timelines of content segments on a user interface. In one example, the methods and systems generate for display a first content item, determine a current portion of the first content item and determine a related content segment that is related to the current portion of the first content item such that the related segment is from a second content item. The methods and systems also generate for simultaneous display a first timeline of the first content item, an indicator that indicates a location of the current portion on the first timeline, a second time of the second content item and a segment indicator that indicates location of the related content segment on the second timeline. The methods and systems further receive a selection of the related content segment.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: August 17, 2021
    Assignee: ROVI GUIDES, INC.
    Inventors: Vikram Makam Gupta, Vishwas Sharadanagar Panchaksharaiah
  • Patent number: 11003563
    Abstract: A compliance user or auditor is enabled to inject failures into a sandbox environment, which may be similar to a production service. The sandbox environment may be monitored by the same automation that watches compliance controls in the production service. As the user injects compliance failures into the sandbox, they may detect the appropriate alerts fire in the monitoring system, thereby gaining trust that the monitoring works as it should. A rich report resulting from the test activities may allow the user or auditor to see how a failure of a compliance control leads to the expected monitoring alert.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: May 11, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: David Nunez Tejerina, Arthur James Schwab, III
  • Patent number: 10990238
    Abstract: A system comprising at least one hardware processor configured to perform: accessing a software robot computer program for controlling at least one application program to perform a task comprising a first sub-task to be performed by a first application program; generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program; and controlling the first application program to perform the first sub-task. The controlling includes identifying, using the software robot computer program, a first action to perform in furtherance of the first sub-task; automatically accessing, in the object hierarchy, a first object corresponding to a first active GUI element of the first application program, the accessing comprising refreshing the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform the first action.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: April 27, 2021
    Assignee: Soroco Private Limited
    Inventors: George Peter Nychis, Rohan Narayan Murty
  • Patent number: 10969883
    Abstract: An optical navigation device including an image sensor, a navigation engine, a smoothing engine and an adjusting interface. The image sensor generates image frames. The navigation engine calculates displacement according to the image frames. The smoothing engine changes a smoothing level for smoothing the calculated displacement according to a trigger signal sent from the adjusting interface.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: April 6, 2021
    Assignee: PIXART IMAGING INC.
    Inventors: Zi-Hao Tan, Kevin Len-Li Lim
  • Patent number: 10963505
    Abstract: Devices, systems, and methods for automatically generating presentations, and for automatically generating a visual presentation that corresponds to a verbal meeting in which one or more topics were discussed. A method includes: obtaining an audio recording of a meeting; generating a transcript of the meeting from the audio recording; and automatically generating a visual presentation that corresponds to particular key elements of the meeting. The generated visual presentation includes automatically-generated slides or portions or chapters, which correspond to the agenda of the meeting, topics discussed and their summary, conclusions, decisions, action items, and other key elements of the meeting.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: March 30, 2021
    Assignee: AUDIOCODES LTD.
    Inventors: Shabtay Adlersberg, Menachem Shmuel Honig, Tatiana Adar
  • Patent number: 10932106
    Abstract: A method enables automated remote control of a remote device from a local device connected to the remote device over a network. The method includes executing a set of one or more commands on the remote device by invoking a macro on the local device. Invoking the macro causes the local device to send said the set of commands over the network to the remote device.
    Type: Grant
    Filed: October 10, 2016
    Date of Patent: February 23, 2021
    Assignee: CommuniTake Technologies Ltd.
    Inventors: Amiram Perlmutter, Eran Karpen, Omri Lavie, Shalev Holy, Ronen Sasson
  • Patent number: 10902339
    Abstract: Systems, methods, and other embodiments are disclosed that are configured to automatically complete the generation of task structures in a project plan. In one embodiment, user data is generated by monitoring interactions of a user with a computer user interface when forming a task structure in a project plan. The user data is compared to learned behavior data. The learned behavior data represents reusable patterns derived from information associated with user creation of previous task structures. If, based on the comparison, the user data matches a reusable pattern of the learned behavior data, a prompt is displayed to the user indicating an option to accept or reject automated completion of the task structure. In response to receiving an acceptance from the user, the forming of the task structure is automatically completed in the project plan based on the matching reusable pattern.
    Type: Grant
    Filed: May 26, 2015
    Date of Patent: January 26, 2021
    Assignee: Oracle International Corporation
    Inventors: Manish Kumar, Raghavan Srinivasan, Vaibhav Katkar, Shankare Gowda
  • Patent number: 10896226
    Abstract: A data analysis system executes data analysis in response to a data analysis request from a plurality of data analysis request sources and includes a filtering unit, a data analysis unit, a data storage unit, and a filter control unit. The filtering unit filters input data by applying a predetermined filter to the input data. The data analysis unit analyzes the filtered input data. The data storage unit stores the input data and result data as data that has been analyzed. The filter control unit records application history of a filter applied in response to the data analysis request, and refers to the filter application history for a new data analysis request to select a filter suitable for data analysis to be executed, and transfers the selected filter to the filtering unit.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: January 19, 2021
    Assignee: HITACHI, LTD.
    Inventor: Taichi Matsuo
  • Patent number: 10878531
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for creating user interface control images for robotic automation. One of the methods includes detecting, during a training process, a control selection event; retrieving a first image and a second image; determining a difference image that represents a difference between the first image and the second image; determining, using the difference image, a plurality of colors for pixels included in the difference image that are likely located outside of a control location for the control; determining one or more shapes depicted in the difference image that each have a color other than all of the colors in the plurality of colors; selecting, from the one or more shapes and using an event location, a particular shape as likely representing the control; and storing a cropped image of the control extracted from one of the two or more images.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: December 29, 2020
    Assignee: Accenture Global Solutions Limited
    Inventors: Cuong Dinh Viet, Jeroen van den Heuvel, Pradyumna Moderahalli Krishna Prasad
  • Patent number: 10831646
    Abstract: Improved utilization of spare resources for fuzz testing is provided. A production environment that includes a plurality of running applications having a plurality of user input fields is monitored over a period of time for consumer use. Actual usage data for the plurality of user input fields are determined during the period of time. Each user input field in the plurality of user input fields is ranked for fuzz testing based on, at least in part, the actual usage data corresponding to each respective user input field during the period of time. The fuzz testing is selectively performed on a portion of the plurality of user input fields based on user input field rankings.
    Type: Grant
    Filed: January 2, 2019
    Date of Patent: November 10, 2020
    Assignee: International Business Machines Corporation
    Inventors: Christopher R. Dotson, Charles S. Lingafelt
  • Patent number: 10802662
    Abstract: A system, comprising at least one computer hardware processor; and at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one computer hardware processor, cause the at least one computer hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program; and controlling the first application program to perform a first sub-task. The controlling includes automatically accessing, in the object hierarchy, a first object corresponding to an active GUI element of the first application program, the accessing comprising searching for the first object in the object hierarchy, the searching comprising modifying the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform a first action in furtherance of the first sub-task.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: October 13, 2020
    Assignee: Soroco Private Limited
    Inventors: George Peter Nychis, Rohan Narayan Murty
  • Patent number: 10769353
    Abstract: A system can stream content items and ad items to a user interface of a client-side application (such as a web browser) without refreshing the user interface and by requesting such items from a local cache and/or a remote cache associated with the client-side application or the user interface. The remote cache can operate much like a local cache for the client-side application or the user interface. Items can be streamed to a user interface without refreshing the user interface and by requesting such items from a remote cache dedicated to caching the items that can be presented by the user interface. Because the tracking of such items and the tracking of the interactions with such items creates such large amounts of data, communicating the tracked data may be impracticable without use of a system that can effectively compress associated instrumentation data.
    Type: Grant
    Filed: April 30, 2018
    Date of Patent: September 8, 2020
    Assignee: Oath Inc.
    Inventor: Timothy Michael Tully
  • Patent number: 10762286
    Abstract: Methods and systems for automated electronic form generation are provided. According to one embodiment, a computing device includes a screen. The computing device is configured to display on the screen a single active text entry field through which all information relating to an electronic form to be generated and that is communicated to a remote server is input by an authoring user. The computing device is further configured to display on the screen a preview of the form generated by the remote server based on the information, which includes a text-based description. The preview of the form allows the authoring user to test the functionality of the form by supporting interaction with functional form elements of the form. The preview is displayed on the screen concurrently with the text entry field and updated in real-time or near real-time responsive to changes to the description by the authoring user.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: September 1, 2020
    Assignee: Payformix LLC
    Inventors: Alex A. Kolesov, Evgeny Taranda
  • Patent number: 10747890
    Abstract: Disclosed are system and methods for controlling access to content from a user application executing in an isolated environment on a user device. An exemplary method includes intercepting, by a security application, data relating to content in a graphical user interface of the user application using an accessibility application programming interface (API) exposed by an operating system of the user device, and generating a first template associated with the content based on the intercepted data. The template specifies a pattern of elements of the graphical user interface. The method further includes determining a category of the content based on a comparison of the first template with a plurality of previously generated templates; and controlling access to the content of the graphical user interface based on the determined category.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: August 18, 2020
    Assignee: AO Kapersky Lab
    Inventors: Victor V. Yablokov, Konstantin M. Filatov
  • Patent number: 10725625
    Abstract: A method and system. In response to receiving a click on a first link included in a parent webpage being displayed on a graphical user interface (GUI) on which a parent tab associated with the parent webpage is displayed: a new tab corresponding to the first link is created, the new tab is displayed on the GUI, the parent webpage is replaced by a new webpage associated with the first link, and a screenshot of the parent webpage is generated and saved to a tooltip attribute of the new tab. A cursor of a pointing device hovering above the new tab is detected. The screenshot is retrieved from the tooltip attribute and persistently displayed on the GUI. During displaying the screenshot and with the hovering above the new tab no longer occurring, a click on the screenshot is received and in response, the parent webpage in the GUI is reopened.
    Type: Grant
    Filed: February 21, 2019
    Date of Patent: July 28, 2020
    Assignee: International Business Machines Corporation
    Inventors: Luke Chen, Paige Chen, Ken Liu, Paul Yuan
  • Patent number: 10645153
    Abstract: Methods, systems, and computer-readable storage media for provisioning resources for microservice-based applications hosted in cloud infrastructures, implementations including actions of receiving event data from each of a plurality of microservices hosted in a cloud infrastructure, for each microservice, determining a load metric based on a probability distribution, comparing each load metric to one or more thresholds to effect respective comparisons, and selectively initiating provisioning of one or more instances of at least one microservice based on a respective comparison.
    Type: Grant
    Filed: August 15, 2017
    Date of Patent: May 5, 2020
    Assignee: SAP SE
    Inventor: Ahmad Hassan
  • Patent number: 10628028
    Abstract: A computing device with a touch screen display displays a first set of a first plurality of icons in a first area of the touch screen display, the first plurality of icons including a plurality of sets of icons that are separately displayed in the first area of the touch screen display, the first plurality of icons including application launch icons; displays a second plurality of icons in a second area on the touch screen display, the second plurality of icons including application launch icons, wherein the second area is different from the first area; detects a finger swipe gesture in the first area; and, in response, replaces display of the first set of the first plurality of icons with display of a second set of the first plurality of icons in the first area on the touch screen display, while maintaining the display of the second plurality of icons in the second area on the touch screen display.
    Type: Grant
    Filed: February 7, 2017
    Date of Patent: April 21, 2020
    Assignee: Apple Inc.
    Inventors: Scott M. Herz, Imran Chaudhri, Gregory N. Christie
  • Patent number: 10558712
    Abstract: Disclosed are systems and methods for enhanced tracking of user interactions with online documents, such as, in accordance with various embodiments, interaction tracking on a sub-document level of granularity and/or interaction tracking that involves storing one or more interaction parameters (e.g., an identifier of the document or of the interacting user) for each interaction.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: February 11, 2020
    Assignee: ResearchGate GmbH
    Inventors: Vyacheslav Zholudev, Peter Magenheimer, Michael Häusler, Darren Alvares, Axel Tölke, Niall Kelly, Mark Howard-Banks
  • Patent number: 10540415
    Abstract: An apparatus and method of managing history information in an electronic device are provided. The method includes: displaying a web browser on a display, based on a first input applied to an input device; receiving data of a web page via a communication circuit; displaying the web page on the display, via the web browser; receiving a second input for creating at least one action related to the web page, via the input device; storing, in a memory, information related to at least one action, as part of a web page browsing history related to the web browser; and providing the display with at least one notification related to at least one action, using the web browser.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: January 21, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yoonjeong Choi, Kyungtae Kim, Hyerim Bae, Sungmin Yoon, Jungjik Lee, Changho Lee, Changhyup Jwa
  • Patent number: 10474313
    Abstract: A system comprising at least one hardware processor configured to perform: accessing a software robot computer program for controlling at least one application program to perform a task comprising a first sub-task to be performed by a first application program; generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program; and controlling the first application program to perform the first sub-task. The controlling includes identifying, using the software robot computer program, a first action to perform in furtherance of the first sub-task; automatically accessing, in the object hierarchy, a first object corresponding to a first active GUI element of the first application program, the accessing comprising refreshing the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform the first action.
    Type: Grant
    Filed: March 3, 2016
    Date of Patent: November 12, 2019
    Assignee: Soroco Private Limited
    Inventors: George Peter Nychis, Rohan Narayan Murty
  • Patent number: 10474257
    Abstract: An optical navigation device including an image sensor, a navigation engine, a smoothing engine and an adjusting interface. The image sensor generates image frames. The navigation engine calculates displacement according to the image frames. The smoothing engine changes a smoothing level for smoothing the calculated displacement according to a trigger signal sent from the adjusting interface.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: November 12, 2019
    Assignee: PIXART IMAGING INC.
    Inventors: Zi-Hao Tan, Kevin Len-Li Lim