Abstract: A classification device (10) acquires captured images of an operation screen before and after occurrence of an operation event of a terminal device. Then, the classification device (10) generates, as a difference image, a change occurring on the operation screen before and after the occurrence of the operation event by using the acquired captured image. Subsequently, the classification device (10) classifies the types of operated GUI components by using the generated difference image.

Abstract: A classification device (10) acquires an operation log related to operation information, identifies each operation performed by a user using the operation log, and creates a vector of each operation on the basis of a co-occurrence relationship between the identified operations. Then, the classification device (10) calculates a similarity between a predetermined number of operations adjacent to each other in chronological order using the created vector of each operation, determines a division point of the operations using the calculated similarity, and divides a time-series operation into operation sets on the basis of the division point. Then, the classification device (10) classifies the operation sets into classes on the basis of the number of types of operations common to the operation sets.

Abstract: A display control device has display setting information including setting information of a layer structure of display objects on a terminal screen and setting information of a group to which the display objects belong, display state information indicating a display state of the display object, and operation setting information defining which setting content a combination of an operation target and operation content on a screen indicate for a layer structure and a group of display objects for each combination of the operation target and the operation content. The display control device specifies the setting content to the display object based on the combination of the operation target and the operation content, the display state information, and the operation setting information when an operation on the display object occurs.

Abstract: An acquisition unit detects an operation event of a user and acquires an occurrence position of the operation event in a captured image of an operation screen. A specifying unit specifies an image of the occurrence position of the operation event from among images to be candidates for a GUI component extracted from the captured image and records the image and the operation event in association with each other. A classifying unit classifies a set of recorded images into clusters according to the similarity between the images. A generation unit generates an operation log by using an image corresponding to the operation event of each classified cluster.

Abstract: A display control device sets a node on the basis of history information of an operation performed by a user using a terminal device and generates a graph object in which a transition between nodes is expressed as a link. The display control device detects a main flow in which nodes having predetermined features are connected to each other among a plurality of nodes included in the graph object and calculates importance of the nodes included in the graph object. The display control device displays a flow in which the nodes included in the graph object are summarized on the basis of the importance of the nodes and a distance to a node in the main flow.

Abstract: An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.

Abstract: A data processing device includes an acquisition unit, a generation unit, and a recognition unit. The acquisition unit acquires a plurality of images of a window. The generation unit extracts image portions of GUI component possibilities from each one of the plurality of images acquired by the acquisition unit, and generates, for each acquired image, arrangement data regarding arrangement places where the extracted image portions are arranged. The recognition unit compares image portions of predetermined GUI component possibilities in which arrangement places correspond to each other between a plurality of pieces of arrangement data generated by the generation unit, and recognizes the predetermined GUI component possibilities as operable GUI components in a case where the image portions of the predetermined GUI component possibilities are different from each other.

Abstract: A timeline display device includes processing circuitry configured to store event data for displaying a figure that represents an operation along a time axis, the event data including a start time point and an end time point of the operation, acquire a search condition that specifies an appearance pattern of the figure that is displayed, and search for data pieces of the event data that match the acquired search condition.

Abstract: A display control device acquires event data, that is, data expressed as a set of fixed units of data, and uses the acquired event data to display an image of the event data visualized according to a predetermined visualization method. Additionally, in the case of receiving an operation of attaching an electronic label to the displayed image, the display control device stores information about the electronic label, the event data, and setting information related to the image when the electronic label was attached in association with each other in storage. Also, in the case of receiving the specification of an electronic label to be restored from among the electronic labels, the display control device acquires the data of the electronic label as well as the event data and setting information associated with the electronic label from the storage, and restores the image with the electronic label attached.

Abstract: A display control apparatus includes a log processing unit that reads an operation log related to operation information and generates first and second object groups indicating operation information represented by first and second visualized representations in first and second two-dimensional planes of a three-dimensional, respectively, the second two-dimensional plane being that is different from the first two-dimensional plane, such that a position of a first object of the first object group and a position of a second object of the second object group which indicate same operation information match on a common axis of the first and second two-dimensional planes, a display control unit that sets a coordinate of each of the first and second objects on the common axis, and a visualization unit that draws an object corresponding to an instructed visualized representation in accordance with the coordinates to perform screen display.

Abstract: A display control apparatus (10) generates, based on a hierarchical structure of data items included in an operation log, a graphical object representing a series of operations indicated in the operation log with a node and a link. The display control apparatus (10) generates visualized information in which information indicating a connection relationship between nodes belonging to a lower hierarchical level than that of a node belonging to a first hierarchical level is represented in the node in a nested manner based on the generated graphical object. The information indicating the connection relationship between nodes in the nest is information in which a start node on a first axis in the nest is connected with a link to an end node on a second axis. In addition, the display control apparatus (10) disposes, with respect to a node group of the first hierarchical level in the visualized information, nodes having higher commonality in values of the data items such that they are brought closer to each other.

Abstract: An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.

Abstract: A display control apparatus (10) according to an embodiment uses an operation log to generate a graph object indicating a plurality of nodes expressed in a predetermined unit and a node-to-node connection relationship and draws, on the basis of the generated graph object, two or more axes arranged in parallel and a line representing the node-to-node connection relationship between two of the axes to perform screen display.

Abstract: An acquisition unit (15a) detects an operation event of a user to acquire an occurrence position of the operation event in an operation screen and a captured image of the operation screen. An extraction unit (15b) extracts images that are able to become candidates for a GUI part from the acquired captured image, identifies which image the operation event has occurred on from the occurrence position of the operation event, and records an occurrence clock time of the operation event and the identified image in an associated manner. A classification unit (15c) classifies a group of recorded images into clusters in accordance with similarities of the images.

Abstract: A display control device (10) acquires event data, that is, data expressed as a set of fixed units of data, and uses the acquired event data to display an image of the event data visualized according to a predetermined visualization method. Additionally, in the case of receiving an operation of attaching an electronic label to the displayed image, the display control device (10) stores information about the electronic label, the event data, and setting information related to the image when the electronic label was attached in association with each other in storage (15). Also, in the case of receiving the specification of an electronic label to be restored from among the electronic labels, the display control device (10) acquires the data of the electronic label as well as the event data and setting information associated with the electronic label from the storage (15), and restores the image with the electronic label attached.

Abstract: For each of operations each included in at least one of a plurality of flow instances generated based on an operation log of a terminal, a counting unit (104) counts the number of flow instances each including the same operation. Also, the extraction unit (105) extracts operations included commonly in the flow instances the number of which is larger than a predetermined criterion as counted by the counting unit (104), in order of occurrence time.

Abstract: A display control device (10) includes a display processing unit (12) configured to read an operational log file and generate a first object indicating operation information visualized by a predetermined visual representation of a first operation entity, and second objects each indicating operation information of a second operation entity that is different in granularity from the first operation entity, a visualization unit (13) configured to perform drawing based on the first object and perform display on a screen, and a summary information generation unit (14) configured to generate summary information in which second objects corresponding to a selected part are grouped, when any part of the first object displayed on the screen is selected. The visualization unit (13) displays the summary information while superimposing or associating the summary information on or with a designated area.

Abstract: An operation log acquisition device (10), upon detecting an occurrence of an event, acquires an occurrence time of the event, an occurrence position of the event, and a captured image of an operation screen. Next, the operation log acquisition device (10) determines whether or not a matching area that the determination image matches is included in the acquired captured image, acquires the event occurrence area of the image if the captured image includes the matching area, acquires an operation image that is a captured image of the acquisition image area if the occurrence position of the event is included in the event occurrence area, and records operation type specifying information that corresponds to the determination image, the occurrence time of the event, and the operation image, in the storage unit (14) in association with each other as an operation log.

Abstract: A display control device includes processing circuitry configured to store index setting information indicating combinations of a plurality of indexes and importance of each of the indexes, and visual variable setting information indicating a visual variable used when a value of the index of the importance is displayed for each importance on a heatmap, calculate values of the indexes collectively on a display basis on the heatmap, specify the combinations of the plurality of indexes and the importance of each of the indexes with reference to the index setting information, and determine a visual variable which is allocated to each of the indexes based on the visual variable setting information and the importance of each of the indexes specified.

Abstract: A display control device 10 has display setting information including setting information of a layer structure of display objects on a terminal screen and setting information of a group to which the display objects belong, display state information indicating a display state of the display object, and operation setting information defining which setting content a combination of an operation target and operation content on a screen indicate for a layer structure and a group of display objects for each combination of the operation target and the operation content. The display control device 10 specifies the setting content to the display object based on the combination of the operation target and the operation content, the display state information, and the operation setting information when an operation on the display object occurs.