Abstract: A classification device (10) acquires captured images of an operation screen before and after occurrence of an operation event of a terminal device. Then, the classification device (10) generates, as a difference image, a change occurring on the operation screen before and after the occurrence of the operation event by using the acquired captured image. Subsequently, the classification device (10) classifies the types of operated GUI components by using the generated difference image.

Abstract: An operation log visualization device includes processing circuitry configured to store operation logs each containing a captured image of an operation screen captured during an operation and information identifying a position of an operation location in an operation target window on the operation screen, generate images in each of which a portion corresponding to the position in the captured image is highlighted, and generate a flowchart by arranging the generated images in an order of processing of operation logs corresponding to the images.

Abstract: A classification device (10) acquires an operation log related to operation information, identifies each operation performed by a user using the operation log, and creates a vector of each operation on the basis of a co-occurrence relationship between the identified operations. Then, the classification device (10) calculates a similarity between a predetermined number of operations adjacent to each other in chronological order using the created vector of each operation, determines a division point of the operations using the calculated similarity, and divides a time-series operation into operation sets on the basis of the division point. Then, the classification device (10) classifies the operation sets into classes on the basis of the number of types of operations common to the operation sets.

Abstract: A display control device has display setting information including setting information of a layer structure of display objects on a terminal screen and setting information of a group to which the display objects belong, display state information indicating a display state of the display object, and operation setting information defining which setting content a combination of an operation target and operation content on a screen indicate for a layer structure and a group of display objects for each combination of the operation target and the operation content. The display control device specifies the setting content to the display object based on the combination of the operation target and the operation content, the display state information, and the operation setting information when an operation on the display object occurs.

Abstract: An acquisition unit detects an operation event of a user and acquires an occurrence position of the operation event in a captured image of an operation screen. A specifying unit specifies an image of the occurrence position of the operation event from among images to be candidates for a GUI component extracted from the captured image and records the image and the operation event in association with each other. A classifying unit classifies a set of recorded images into clusters according to the similarity between the images. A generation unit generates an operation log by using an image corresponding to the operation event of each classified cluster.

Abstract: A classification device includes processing circuitry configured to obtain operation logs describing operation content for a window on a terminal screen, classify the operation logs into a plurality of groups, using a document classification method, based on the operation content of the operation logs, and assign words characteristic of respective groups as labels to these groups, and cause an output device to output the operation logs assigned the labels.

Abstract: A display control device sets a node on the basis of history information of an operation performed by a user using a terminal device and generates a graph object in which a transition between nodes is expressed as a link. The display control device detects a main flow in which nodes having predetermined features are connected to each other among a plurality of nodes included in the graph object and calculates importance of the nodes included in the graph object. The display control device displays a flow in which the nodes included in the graph object are summarized on the basis of the importance of the nodes and a distance to a node in the main flow.

Abstract: An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.

Abstract: A business-document presenting device includes processing circuitry configured to store text information displayed on a terminal screen during processing of a task in a past, acquire text information displayed on the terminal screen, and compare the acquired text information and the text information stored in the storage and extract different items of text information among tasks as keywords for searching for business documents.

Abstract: A data processing device includes an acquisition unit, a generation unit, and a recognition unit. The acquisition unit acquires a plurality of images of a window. The generation unit extracts image portions of GUI component possibilities from each one of the plurality of images acquired by the acquisition unit, and generates, for each acquired image, arrangement data regarding arrangement places where the extracted image portions are arranged. The recognition unit compares image portions of predetermined GUI component possibilities in which arrangement places correspond to each other between a plurality of pieces of arrangement data generated by the generation unit, and recognizes the predetermined GUI component possibilities as operable GUI components in a case where the image portions of the predetermined GUI component possibilities are different from each other.

Abstract: A timeline display device includes processing circuitry configured to store event data for displaying a figure that represents an operation along a time axis, the event data including a start time point and an end time point of the operation, acquire a search condition that specifies an appearance pattern of the figure that is displayed, and search for data pieces of the event data that match the acquired search condition.

Abstract: A display control device acquires event data, that is, data expressed as a set of fixed units of data, and uses the acquired event data to display an image of the event data visualized according to a predetermined visualization method. Additionally, in the case of receiving an operation of attaching an electronic label to the displayed image, the display control device stores information about the electronic label, the event data, and setting information related to the image when the electronic label was attached in association with each other in storage. Also, in the case of receiving the specification of an electronic label to be restored from among the electronic labels, the display control device acquires the data of the electronic label as well as the event data and setting information associated with the electronic label from the storage, and restores the image with the electronic label attached.

Abstract: A data processing apparatus (10) includes an acquisition unit (151) that acquires words included in a displayed content of a terminal screen, and a determination unit (153) that determines that the words acquired by the acquisition unit (151) are search candidates in a case where the acquired words are included in an inverted index in which words and identification information of work data including the words are stored in association with each other.

Abstract: An extraction unit (15b) extracts words included in information related to work. A calculation unit (15c) calculates a degree of infrequency of appearance with respect to each of the extracted words. A classification unit (15d) classifies the information related to the work issue by issue, by using the calculated degrees of infrequency of appearance of the words.

Abstract: A display control apparatus includes a log processing unit that reads an operation log related to operation information and generates first and second object groups indicating operation information represented by first and second visualized representations in first and second two-dimensional planes of a three-dimensional, respectively, the second two-dimensional plane being that is different from the first two-dimensional plane, such that a position of a first object of the first object group and a position of a second object of the second object group which indicate same operation information match on a common axis of the first and second two-dimensional planes, a display control unit that sets a coordinate of each of the first and second objects on the common axis, and a visualization unit that draws an object corresponding to an instructed visualized representation in accordance with the coordinates to perform screen display.

Abstract: A display control apparatus (10) generates, based on a hierarchical structure of data items included in an operation log, a graphical object representing a series of operations indicated in the operation log with a node and a link. The display control apparatus (10) generates visualized information in which information indicating a connection relationship between nodes belonging to a lower hierarchical level than that of a node belonging to a first hierarchical level is represented in the node in a nested manner based on the generated graphical object. The information indicating the connection relationship between nodes in the nest is information in which a start node on a first axis in the nest is connected with a link to an end node on a second axis. In addition, the display control apparatus (10) disposes, with respect to a node group of the first hierarchical level in the visualized information, nodes having higher commonality in values of the data items such that they are brought closer to each other.

Abstract: An identification apparatus (10) includes a screen configuration comparison unit (1314) configured to determine equivalence of screen components between sample screen data and processing target screen data based on whether a screen component in a screen structure of the sample screen data and a screen component in a screen structure of the processing target screen data have similar relationships to other screen components in the respective screen structures.

Abstract: An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.

Abstract: A masking apparatus identifies a screen and screen components included in individual screen data of first screen data serving as a reference and one or more pieces of second screen data serving as a processing target. In addition, the masking apparatus specifies third screen data on a basis of the screen and the screen components that are identified, the third screen data being data equivalent to the first screen data in the one or more pieces of second screen data. In addition, the masking apparatus determines necessity of masking of each screen component included in the first screen data on a basis of the third screen data.

Abstract: A display control apparatus (10) according to an embodiment uses an operation log to generate a graph object indicating a plurality of nodes expressed in a predetermined unit and a node-to-node connection relationship and draws, on the basis of the generated graph object, two or more axes arranged in parallel and a line representing the node-to-node connection relationship between two of the axes to perform screen display.