Abstract: Embodiments described herein are directed to intelligently classifying Web trackers in a privacy preserving manner and mitigating the effects of such Web trackers. As users browse the Web and encounter various Web sites, tracker-related metrics are determined. The metrics are obfuscated to protect the privacy of the user. The obfuscated metrics are provided as inputs to a machine learning model, which is configured to output a classification for the Web trackers associated with the Web sites visited by the user. Depending on the classification, the effects of the Web trackers are mitigated by placing restrictions on the Web trackers. The restrictions for a particular Web tracker may be relaxed based on a level of user engagement a user has with respect to the tracker's associated Web site. By doing so, the compatibility risks associated with tracking prevention are mitigated for Web sites that are relatively important to the user.

Abstract: A software robot is configured to automatically identify a target element (e.g., a button, a form field, etc.) within a user interface (UI) according to a set of attributes of the target element specified in the source-code of the respective UI. The robot's code specification includes a multiplicity flag which, when set, causes the robot to search for the target element within multiple instances of a UI object matching a subset of the set attributes (for instance, within all windows having a specific name, within all browser tabs, etc.

Abstract: Disclosed is a system for generating a document having a sequence of steps. A user input selecting an element of an application is received, where the user input indicates the element corresponds to a step in the sequence of steps to be represented in the document. A record is stored, where the record includes at least data representing the selected element and a sequence identifier, indicating a relative position of the step within the sequence of steps. The document is generated by using the data in the record to generate a visual portion for the step, and using the sequence identifier to determine a position of the visual portion in the document relative to another visual portion(s) representing another step(s) in the sequence of steps.

Abstract: Methods, systems, and computer programs are presented for analyzing multiple states of a webpage. One method includes operations for tracking user activity for a set of users while interacting with a webpage to obtain session replay data. Further, the method includes analyzing the session replay data to obtain states for the webpage and causing presentation of a first user interface (UI) for selecting one state. The method further includes receiving a selection of a first state and causing presentation of a second UI for configuring tracking options to track the first state while users viewing the webpage are in the first state. The method further includes receiving, in the second UI, tracking options values for the first state, analyzing views of the first state of the webpage based on the tracking options values, and causing presentation of performance metrics associated with the first state based on the analyzed views.

Abstract: Use of artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.

Abstract: A receiving device is provided. The receiving devices includes circuitry that is configured to execute an application related to a program or a channel, The circuitry is configured to set, based on the application, broadcast reception data from a broadcast as a media source object corresponding to a processing object of media reproduction. The circuitry is configured to obtain, based on the application, broadcast content segment information of broadcast content in the broadcast reception data that is stored in a buffer associated with the media source object. The circuitry is configured to perform, based on the application and the broadcast content segment information of a segment of the broadcast content to be replaced being obtained, replacement or appendance of the broadcast content in the broadcast reception data stored in the buffer with network content in application reception data received via a network.

Abstract: Systems and techniques for aggregation, display, and sharing of data. Graphic items representing data objects identified by a data package may be displayed on timelines. Each timeline may be associated with a respective class of data, and each graphic item displayed on a respective timeline may represent one or more of the data objects in the class associated with the respective timeline.

Abstract: A modular and distributed architecture for data stream processing and analysis is described to incorporate data stream analytics capabilities, called Data Stream Analytics Service (DSAS) in the IoT/M2M service layer. Each service layer node hosting DSAS can be split into two independent modules, Stream Forwarder and Stream Analytics Engine. Stream Forwarder is a light weight processing modules that can be responsible for data preprocessing and routing. Stream Analytics Engine is responsible for performing actual analytics on the data stream. Separating the two functionalities enables the service layer nodes to efficiently distribute stream analytics tasks across multiple nodes.

Abstract: Systems and methods are provided for a workflow framework that scriptwriters can utilize when developing (live-action/animation/cinematic) virtual reality (VR) experiences or content. A script can be parsed to identify one or more elements in a script, and a VR representation of the one or more elements can be automatically generated. A user may develop or edit the script which can be presented in a visual and temporal manner along with the VR representation. The user may edit the VR representation, and the visual and temporal presentation of the script can be commensurately represented. The script may be analyzed for consistency and/or cohesiveness in the context of the VR representation or experience. A preview of the VR experience or content can be generated from the script and/or the VR representation.

Abstract: A software robot is configured to automatically identify a target element (e.g., a button, a form field, etc.) within a user interface (UI) according to a set of attributes of the target element specified in the source-code of the respective UI. The robot's code specification includes a multiplicity flag which, when set, causes the robot to search for the target element within multiple instances of a UI object matching a subset of the set attributes (for instance, within all windows having a specific name, within all browser tabs, etc.

Abstract: Embodiments described herein are directed to intelligently classifying Web trackers in a privacy preserving manner and mitigating the effects of such Web trackers. As users browse the Web and encounter various Web sites, tracker-related metrics are determined. The metrics are obfuscated to protect the privacy of the user. The obfuscated metrics are provided as inputs to a machine learning model, which is configured to output a classification for the Web trackers associated with the Web sites visited by the user. Depending on the classification, the effects of the Web trackers are mitigated by placing restrictions on the Web trackers. The restrictions for a particular Web tracker may be relaxed based on a level of user engagement a user has with respect to the tracker's associated Web site. By doing so, the compatibility risks associated with tracking prevention are mitigated for Web sites that are relatively important to the user.

Abstract: In some implementations, a first device can record a display screen of a second device remotely. For example, the first device (e.g., a remote computing device) can receive information identifying other computing devices on a network. The first device can receive a selection of one of the other computing devices (e.g., the second device) and send a message to the second device to initiate a recording of the display screen of the second device. In response to receiving the message, the second device can record video frames of images presented on the display of the second device. The second device can send the video frames to the first device for display and/or storage. While recording the images presented on the display screen, the second device can present indicia on the display screen of the second device indicating that a screen recording is in progress.

Abstract: The present disclosure relates to systems and techniques for developing APIs that utilize multiple pre-existing APIs. The present disclosure also relates to a user interface that allows for chaining APIs together as a function of multiple pre-existing APIs. The present disclosure also relates to security and authorization of a user to execute one or more APIs as part of an API chain.

Abstract: Use of artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.

Abstract: An electronic device according to one embodiment of the present invention comprises: at least one communication interface; a display; a memory; and at least one processor electrically connected to the at least one communication interface, the display, and the memory, wherein the memory may store instructions which, when executed, cause the at least one processor to: acquire, in response to receiving a request for service information related to broadcast content sent from a content server, at least one image frame included in the broadcast content; determine whether at least one face region has been detected within the at least one image frame; perform, if the at least one face region is determined to have been detected, image analysis on the basis of the detected at least one face region; and provide, through the display, service information corresponding to a result of the image analysis. In addition, various embodiments are possible.

Abstract: Use of artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In accordance with one example, a method includes, at an electronic device with one or more processors and memory, obtaining a first set of data corresponding to one or more interactions between a user and the digital assistant on the electronic device; obtaining a second set of data corresponding to one or more interactions between the user and an application on the electronic device; and storing the first set of data and the second set of data. The method further includes receiving a set of executable instructions; processing, based on the received set of executable instructions, the first set of data and the second set of data to obtain a third set of data; and transmitting the third set of data to a remote electronic device.

Abstract: In various embodiments, a storyboarding application generates a storyboard for a media title. In operation, the storyboarding application determines a categorization for a first portion of the media item. The storyboarding application then determines a first media item based on at least one of the categorization or a caption associated with the first portion of the media title. Subsequently, the storyboarding application modifies the first media item based on at least one of the categorization or a character associated with the caption to generate a second media item. The storyboarding application then generates a sequence of media items for the storyboard that includes the second media item. Advantageously, because the storyboarding application can automatically generate media items for storyboards based on categorizations and/or captions, the storyboarding application can reduce both the manual effort and time required to generate storyboards relative to prior art techniques.

Abstract: Graphical element detection using a combined series and delayed parallel execution unified target technique that potentially uses a plurality of graphical element detection techniques, performs default user interface (UI) element detection technique configuration at the application and/or UI type level, or both, is disclosed. The unified target merges multiple techniques of identifying and automating UI elements into a single cohesive approach. A unified target descriptor chains together multiple types of UI descriptors in series, uses them in parallel, or uses at least one technique first for a period of time and then runs at least one other technique in parallel or alternatively if the first technique does not find a match within the time period.

Abstract: An improved process for recreating a webpage as presented to the visitor is provided. A skeleton of a webpage, including content and images of the webpage, may be captured for each web event. For each web event, the captured skeleton of the webpage, including the content and the image of the captured webpage, may be transmitted to a server, allowing the server to recreate a webpage that was presented to the visitor.

Abstract: Computer-implemented techniques are disclosed for presenting an in-page console on a website for reviewing interaction data captured during user interaction with one or more web pages of the website. The web browser activates the in-page console via an activation procedure. One or more of the web pages of the website are selected after activation of the in-page console. A feedback badge on the website can be replaced with a reporting badge upon activation of the in-page console and with the reporting badge displaying an indicator of interaction data captured for the selected web page. The in-page console is overlaid one or more of the selected web pages. The in-page console displays the interaction data, or recordings of user interaction, captured during user interaction with the selected web page to enable review of the captured interaction data for the selected web page overlaid on the selected web page.

Abstract: The system and method for determining fuzzy cause and effect relationships in an intelligent workload management system described herein may combine potential causes and effects captured from various different sources associated with an information technology infrastructure with substantially instantaneous feedback mechanisms and other knowledge sources. As such, fuzzy correlation logic may then be applied to the combined information to determine potential cause and effect relationships and thereby diagnose problems and otherwise manage interactions that occur in the infrastructure. For example, information describing potential causes and potential effects associated with an operational state of the infrastructure may be captured and combined, and any patterns among the information that describes the multiple potential causes and effects may then be identified.

Abstract: The disclosure is directed to approaches for combining server-side decisions based on user attributes and/or demographics with client-side decisions based on expressed or implied user interests determined based on the contents of a web page being visited by the user. A server is responsive to an occurrence of an operation of a client device at the web page. Processing steps determine particular executable web page content to send to the client device (e.g., where the particular executable web page content is determined in response to a particular client-side operation). The web page is rendered with the aforementioned executable web page content. Server-side processing receives messages that are emitted conditionally, based on the occurrence of a user event. An event log message comprises a portion of the web page, such as a string, indicating or implying user interest. A targeted advertisement is presented to the user based on the user interest.

Abstract: A privacy-enabled system for securely transmitting encrypted data is provided. The system comprises: a memory device with computer-readable program code stored thereon; a communication device connected to a network; and a processing device configured to: receive a request for a resource transfer of a resource from a user resource location associated with a user to a destination device associated with a third party; determine a data requirement for completing the resource transfer, wherein the data requirement is a minimum amount of user resource location data required for directing the resource from the user resource location to the destination device and completing the resource transfer; based on determining the data requirement, generate a transmission package comprising the resource, wherein the transmission package has at least a portion of the user resource location data removed or modified; and deliver the transmission package to the destination device to complete the resource transfer.

Abstract: A system for remotely controlling multiple application programs executing on multiple respective physical computing devices, the system comprising a first computing device, comprising a first processor, and configured to execute a first application program; a second computing device, comprising a second processor, and configured to execute a second application program; and a controller configured to perform: generating, based on first information obtained from the first computing device and second information obtained from the second computing device, a global object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program and the second application program; controlling the first application program to perform the first sub-task at least in part by using the global object hierarchy; and controlling the second application program to perform the second sub-task at least in part by using the global object hierarchy.

Abstract: An electronic device sets, in accordance with a use operation, which one of a plurality of objects is to be used to display a specific setting item on a setting screen. The plurality of objects include a first object and a second object whose display size, information amount to be displayed, and number of types of operable setting values are larger than the first object. In case where the first object is displayed on the setting screen, the electronic device changes a first setting value concerning the specific setting item in accordance with an operation on one of a first or second operation member. In case where the second object is displayed on the setting screen, the electronic device changes the first and second setting values in accordance with the operations on the first and second operation members, respectively.

Abstract: In one example embodiment, a network management device generates a first script defining a first function for detecting a first customizable network event in a sequence of customizable network events indicative of a security threat to a network. The network management device activates the first script at a first network device in the network so as to cause the first network device to execute the first function for detecting the first customizable network event, and obtains, from the first network device, one or more indications that the first network device has detected the first customizable network event. Based on the one or more indications, the network management device determines whether to activate a second script defining a second function for detecting a second customizable network event in the sequence at a second network device in the network capable of detecting the second customizable network event.

Abstract: The methods and systems described herein provide timelines of content segments on a user interface. In one example, the methods and systems generate for display a first content item, determine a current portion of the first content item and determine a related content segment that is related to the current portion of the first content item such that the related segment is from a second content item. The methods and systems also generate for simultaneous display a first timeline of the first content item, an indicator that indicates a location of the current portion on the first timeline, a second time of the second content item and a segment indicator that indicates location of the related content segment on the second timeline. The methods and systems further receive a selection of the related content segment.

Abstract: A compliance user or auditor is enabled to inject failures into a sandbox environment, which may be similar to a production service. The sandbox environment may be monitored by the same automation that watches compliance controls in the production service. As the user injects compliance failures into the sandbox, they may detect the appropriate alerts fire in the monitoring system, thereby gaining trust that the monitoring works as it should. A rich report resulting from the test activities may allow the user or auditor to see how a failure of a compliance control leads to the expected monitoring alert.

Abstract: A system comprising at least one hardware processor configured to perform: accessing a software robot computer program for controlling at least one application program to perform a task comprising a first sub-task to be performed by a first application program; generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program; and controlling the first application program to perform the first sub-task. The controlling includes identifying, using the software robot computer program, a first action to perform in furtherance of the first sub-task; automatically accessing, in the object hierarchy, a first object corresponding to a first active GUI element of the first application program, the accessing comprising refreshing the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform the first action.

Abstract: An optical navigation device including an image sensor, a navigation engine, a smoothing engine and an adjusting interface. The image sensor generates image frames. The navigation engine calculates displacement according to the image frames. The smoothing engine changes a smoothing level for smoothing the calculated displacement according to a trigger signal sent from the adjusting interface.

Abstract: Devices, systems, and methods for automatically generating presentations, and for automatically generating a visual presentation that corresponds to a verbal meeting in which one or more topics were discussed. A method includes: obtaining an audio recording of a meeting; generating a transcript of the meeting from the audio recording; and automatically generating a visual presentation that corresponds to particular key elements of the meeting. The generated visual presentation includes automatically-generated slides or portions or chapters, which correspond to the agenda of the meeting, topics discussed and their summary, conclusions, decisions, action items, and other key elements of the meeting.

Abstract: A method enables automated remote control of a remote device from a local device connected to the remote device over a network. The method includes executing a set of one or more commands on the remote device by invoking a macro on the local device. Invoking the macro causes the local device to send said the set of commands over the network to the remote device.

Abstract: Systems, methods, and other embodiments are disclosed that are configured to automatically complete the generation of task structures in a project plan. In one embodiment, user data is generated by monitoring interactions of a user with a computer user interface when forming a task structure in a project plan. The user data is compared to learned behavior data. The learned behavior data represents reusable patterns derived from information associated with user creation of previous task structures. If, based on the comparison, the user data matches a reusable pattern of the learned behavior data, a prompt is displayed to the user indicating an option to accept or reject automated completion of the task structure. In response to receiving an acceptance from the user, the forming of the task structure is automatically completed in the project plan based on the matching reusable pattern.

Abstract: A data analysis system executes data analysis in response to a data analysis request from a plurality of data analysis request sources and includes a filtering unit, a data analysis unit, a data storage unit, and a filter control unit. The filtering unit filters input data by applying a predetermined filter to the input data. The data analysis unit analyzes the filtered input data. The data storage unit stores the input data and result data as data that has been analyzed. The filter control unit records application history of a filter applied in response to the data analysis request, and refers to the filter application history for a new data analysis request to select a filter suitable for data analysis to be executed, and transfers the selected filter to the filtering unit.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for creating user interface control images for robotic automation. One of the methods includes detecting, during a training process, a control selection event; retrieving a first image and a second image; determining a difference image that represents a difference between the first image and the second image; determining, using the difference image, a plurality of colors for pixels included in the difference image that are likely located outside of a control location for the control; determining one or more shapes depicted in the difference image that each have a color other than all of the colors in the plurality of colors; selecting, from the one or more shapes and using an event location, a particular shape as likely representing the control; and storing a cropped image of the control extracted from one of the two or more images.

Abstract: Improved utilization of spare resources for fuzz testing is provided. A production environment that includes a plurality of running applications having a plurality of user input fields is monitored over a period of time for consumer use. Actual usage data for the plurality of user input fields are determined during the period of time. Each user input field in the plurality of user input fields is ranked for fuzz testing based on, at least in part, the actual usage data corresponding to each respective user input field during the period of time. The fuzz testing is selectively performed on a portion of the plurality of user input fields based on user input field rankings.

Abstract: A system, comprising at least one computer hardware processor; and at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one computer hardware processor, cause the at least one computer hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program; and controlling the first application program to perform a first sub-task. The controlling includes automatically accessing, in the object hierarchy, a first object corresponding to an active GUI element of the first application program, the accessing comprising searching for the first object in the object hierarchy, the searching comprising modifying the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform a first action in furtherance of the first sub-task.

Abstract: A system can stream content items and ad items to a user interface of a client-side application (such as a web browser) without refreshing the user interface and by requesting such items from a local cache and/or a remote cache associated with the client-side application or the user interface. The remote cache can operate much like a local cache for the client-side application or the user interface. Items can be streamed to a user interface without refreshing the user interface and by requesting such items from a remote cache dedicated to caching the items that can be presented by the user interface. Because the tracking of such items and the tracking of the interactions with such items creates such large amounts of data, communicating the tracked data may be impracticable without use of a system that can effectively compress associated instrumentation data.

Abstract: Methods and systems for automated electronic form generation are provided. According to one embodiment, a computing device includes a screen. The computing device is configured to display on the screen a single active text entry field through which all information relating to an electronic form to be generated and that is communicated to a remote server is input by an authoring user. The computing device is further configured to display on the screen a preview of the form generated by the remote server based on the information, which includes a text-based description. The preview of the form allows the authoring user to test the functionality of the form by supporting interaction with functional form elements of the form. The preview is displayed on the screen concurrently with the text entry field and updated in real-time or near real-time responsive to changes to the description by the authoring user.

Abstract: Disclosed are system and methods for controlling access to content from a user application executing in an isolated environment on a user device. An exemplary method includes intercepting, by a security application, data relating to content in a graphical user interface of the user application using an accessibility application programming interface (API) exposed by an operating system of the user device, and generating a first template associated with the content based on the intercepted data. The template specifies a pattern of elements of the graphical user interface. The method further includes determining a category of the content based on a comparison of the first template with a plurality of previously generated templates; and controlling access to the content of the graphical user interface based on the determined category.

Abstract: A method and system. In response to receiving a click on a first link included in a parent webpage being displayed on a graphical user interface (GUI) on which a parent tab associated with the parent webpage is displayed: a new tab corresponding to the first link is created, the new tab is displayed on the GUI, the parent webpage is replaced by a new webpage associated with the first link, and a screenshot of the parent webpage is generated and saved to a tooltip attribute of the new tab. A cursor of a pointing device hovering above the new tab is detected. The screenshot is retrieved from the tooltip attribute and persistently displayed on the GUI. During displaying the screenshot and with the hovering above the new tab no longer occurring, a click on the screenshot is received and in response, the parent webpage in the GUI is reopened.

Abstract: Methods, systems, and computer-readable storage media for provisioning resources for microservice-based applications hosted in cloud infrastructures, implementations including actions of receiving event data from each of a plurality of microservices hosted in a cloud infrastructure, for each microservice, determining a load metric based on a probability distribution, comparing each load metric to one or more thresholds to effect respective comparisons, and selectively initiating provisioning of one or more instances of at least one microservice based on a respective comparison.

Abstract: A computing device with a touch screen display displays a first set of a first plurality of icons in a first area of the touch screen display, the first plurality of icons including a plurality of sets of icons that are separately displayed in the first area of the touch screen display, the first plurality of icons including application launch icons; displays a second plurality of icons in a second area on the touch screen display, the second plurality of icons including application launch icons, wherein the second area is different from the first area; detects a finger swipe gesture in the first area; and, in response, replaces display of the first set of the first plurality of icons with display of a second set of the first plurality of icons in the first area on the touch screen display, while maintaining the display of the second plurality of icons in the second area on the touch screen display.

Abstract: Disclosed are systems and methods for enhanced tracking of user interactions with online documents, such as, in accordance with various embodiments, interaction tracking on a sub-document level of granularity and/or interaction tracking that involves storing one or more interaction parameters (e.g., an identifier of the document or of the interacting user) for each interaction.

Abstract: An apparatus and method of managing history information in an electronic device are provided. The method includes: displaying a web browser on a display, based on a first input applied to an input device; receiving data of a web page via a communication circuit; displaying the web page on the display, via the web browser; receiving a second input for creating at least one action related to the web page, via the input device; storing, in a memory, information related to at least one action, as part of a web page browsing history related to the web browser; and providing the display with at least one notification related to at least one action, using the web browser.

Abstract: A system comprising at least one hardware processor configured to perform: accessing a software robot computer program for controlling at least one application program to perform a task comprising a first sub-task to be performed by a first application program; generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program; and controlling the first application program to perform the first sub-task. The controlling includes identifying, using the software robot computer program, a first action to perform in furtherance of the first sub-task; automatically accessing, in the object hierarchy, a first object corresponding to a first active GUI element of the first application program, the accessing comprising refreshing the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform the first action.

Abstract: An optical navigation device including an image sensor, a navigation engine, a smoothing engine and an adjusting interface. The image sensor generates image frames. The navigation engine calculates displacement according to the image frames. The smoothing engine changes a smoothing level for smoothing the calculated displacement according to a trigger signal sent from the adjusting interface.

Abstract: Managing assets during production of multimedia, comprising: creating at least one scouting image; creating a metadata including information needed to import the at least one scouting image as a shot; and generating a script including commands needed to recreate the shot in its current state, and storing camera and character attributes. Keywords include asset management and scouting images.

Abstract: Embodiments of the invention provide a computer-implemented method of collecting computer user behavioral data during an interaction between a computer user and web-based content accessible via a computing device. A behavioral data collection activation script is provided, which may be provided within executable code of a webpage or media player executable on a webpage. The script runs during loading of the webpage or media player or upon execution of a specific operation or action within the webpage or media player. The script triggers activation of a data recording component on the computing device via a browser-based application programming interface (API), and triggers initiation of a behavioral data collection application on the computing device, which receives information from the data recording component as an input.