Patents by Inventor Fumihiro YOKOSE
Fumihiro YOKOSE has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240378851Abstract: A screen data processing device according to one embodiment includes: a detection degree calculation unit that calculates a character string detection degree indicating, based on screen component information in which information of a character string serving as a component of screen data is managed and an area of part of an image displayed on a display screen, how many character strings managed by the screen component information are drawn in the area; and a determination unit that determines whether or not the character string managed by the screen component information is drawn in the area on the basis of a magnitude of the character string detection degree calculated by the detection degree calculation unit.Type: ApplicationFiled: September 8, 2021Publication date: November 14, 2024Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Shiro OGASAWARA, Yoshiaki SHOJI, Fumihiro YOKOSE
-
Patent number: 12124353Abstract: An operation log acquisition device includes processing circuitry configured to store a determination image that is an image of a characteristic area of an operation screen that is used to perform a predetermined operation, an event occurrence area in which an event may occur when the predetermined operation is performed, operation type specifying information that specifies an operation type, and an acquisition image area that is to be acquired when the predetermined operation is performed, in association with each other, upon detecting an occurrence of the event, acquire an occurrence time of the event, an occurrence position of the event, and a captured image of the operation screen, and determine whether or not the captured image acquired includes a matching area that the determination image matches, and acquire an event occurrence area of the determination image if the captured image includes the matching area.Type: GrantFiled: June 11, 2019Date of Patent: October 22, 2024Assignee: Nippon Telegraph and Telephone CorporationInventors: Kimio Tsuchikawa, Takeshi Masuda, Fumihiro Yokose, Sayaka Yagi, Yuki Urabe
-
Publication number: 20240296404Abstract: A determination device (10) receives designation of a division position of a log, and creates a rule for determining the division position of the log on the basis of a relationship between attribute values of log events before and after the received division position. Then, the determination device (10) determines a division position of a log to be processed by using the created rule.Type: ApplicationFiled: June 11, 2021Publication date: September 5, 2024Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Fumihiro YOKOSE, Kimio TSUCHIKAWA, Sayaka YAGI, Yuki URABE, Taisuke WAKASUGI, Haruo OISHI
-
Publication number: 20240289717Abstract: A visualization display device includes visualization display circuitry configured to acquire an operation log, generate an operation sequence in units of operations arrayed in a time series order for each case on the basis of the operation log and align the operation sequence in units of operations, and specify operation types that appear with a threshold or more at the same position in the operation sequence in units of operations of each case as operation types of a main flow on the basis of the aligned operation sequence in units of operations and arrange and visualize nodes corresponding to the operation types of the main flow in a time series order on one axis.Type: ApplicationFiled: June 23, 2021Publication date: August 29, 2024Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Yuki URABE, Kimio TSUCHIKAWA, Fumihiro YOKOSE, Sayaka YAGI
-
Publication number: 20240281353Abstract: A determination device (10) includes: a reception unit (15a) that receives an operation event; an estimation unit (15b) that estimates a determination criterion for determining whether the operation event is necessary or unnecessary on the basis of an attribute value of an operation log included in the operation event; and a determination unit (15c) that determines whether an operation event to be processed is necessary or unnecessary on the basis of the determination criterion.Type: ApplicationFiled: June 11, 2021Publication date: August 22, 2024Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Fumihiro YOKOSE, Kimio TSUCHIKAWA, Sayaka YAGI, Yuki URABE, Taisuke WAKASUGI, Haruo OISHI
-
Publication number: 20240282134Abstract: A determination device (10) includes: a reception unit (15a) that receives operation events; an estimation unit (15b) that estimates a determination criterion for determining identity of the operation events on the basis of an attribute value of an operation log included in the operation events; and a determination unit (15c) that determines identity for an operation event to be processed on the basis of the determination criterion.Type: ApplicationFiled: June 11, 2021Publication date: August 22, 2024Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Fumihiro YOKOSE, Kimio TSUCHIKAWA, Sayaka YAGI, Yuki URABE, Taisuke WAKASUGI, Haruo OISHI
-
Publication number: 20240273931Abstract: An identification device (10) includes a first identification unit (151a) that identifies first screen data including an image of a screen of an application and information regarding a screen component object that is an object of an element included in the screen, and outputs a first identification result associated with sample screen data that is screen data to be referred to, a derivation unit (152a) that derives a sample screen model used for identification in a virtualization environment on the basis of the sample screen data and the first identification result, and a second identification unit (153a) that identifies second screen data including an image of the screen and not including information regarding the screen component object, and outputs a second identification result associated with a sample screen model.Type: ApplicationFiled: June 11, 2021Publication date: August 15, 2024Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Shiro OGASAWARA, Hajime NAKAJIMA, Fumihiro YOKOSE, Hidetaka KOYA
-
Publication number: 20240153241Abstract: A classification device (10) acquires captured images of an operation screen before and after occurrence of an operation event of a terminal device. Then, the classification device (10) generates, as a difference image, a change occurring on the operation screen before and after the occurrence of the operation event by using the acquired captured image. Subsequently, the classification device (10) classifies the types of operated GUI components by using the generated difference image.Type: ApplicationFiled: March 17, 2021Publication date: May 9, 2024Inventors: Misa FUKAI, Kimio TSUCHIKAWA, Fumihiro YOKOSE, Yuki Urabe, Sayaka Yagi, Haruo OISHI
-
Publication number: 20240143131Abstract: A storage unit (14) stores a setting point list (14b) in which a predetermined setting point and an operation screen at the setting point are associated with each other. A generation unit (15b) sets, as a node, an operation screen on which processing content is reflected, generates an operation screen flow (14c) representing a processing order of the node by using an operation manual, and associates the operation screen flow (14c) and the setting point. An extraction unit (15d) extracts, from the operation screen flow (14c), a route from a node corresponding to a screen being operated to a setting point at a subsequent stage of the node. A presentation unit (15e) presents, to an operator, an operation screen on the extracted route.Type: ApplicationFiled: January 13, 2021Publication date: May 2, 2024Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Koki NAKANISHI, Fumihiro YOKOSE, Haruo OISHI
-
Publication number: 20240126675Abstract: A classification device (10) acquires an operation log related to operation information, identifies each operation performed by a user using the operation log, and creates a vector of each operation on the basis of a co-occurrence relationship between the identified operations. Then, the classification device (10) calculates a similarity between a predetermined number of operations adjacent to each other in chronological order using the created vector of each operation, determines a division point of the operations using the calculated similarity, and divides a time-series operation into operation sets on the basis of the division point. Then, the classification device (10) classifies the operation sets into classes on the basis of the number of types of operations common to the operation sets.Type: ApplicationFiled: December 8, 2021Publication date: April 18, 2024Inventors: Yuki Urabe, Kimio TSUCHIKAWA, Fumihiro YOKOSE, Ryo UCHIDA, Sayaka Yagi
-
Patent number: 11960711Abstract: A display control device has display setting information including setting information of a layer structure of display objects on a terminal screen and setting information of a group to which the display objects belong, display state information indicating a display state of the display object, and operation setting information defining which setting content a combination of an operation target and operation content on a screen indicate for a layer structure and a group of display objects for each combination of the operation target and the operation content. The display control device specifies the setting content to the display object based on the combination of the operation target and the operation content, the display state information, and the operation setting information when an operation on the display object occurs.Type: GrantFiled: July 3, 2019Date of Patent: April 16, 2024Assignee: Nippon Telegraph and Telephone CorporationInventors: Sayaka Yagi, Kimio Tsuchikawa, Fumihiro Yokose, Takeshi Masuda, Yuki Urabe
-
Publication number: 20240096055Abstract: An acquisition unit detects an operation event of a user and acquires an occurrence position of the operation event in a captured image of an operation screen. A specifying unit specifies an image of the occurrence position of the operation event from among images to be candidates for a GUI component extracted from the captured image and records the image and the operation event in association with each other. A classifying unit classifies a set of recorded images into clusters according to the similarity between the images. A generation unit generates an operation log by using an image corresponding to the operation event of each classified cluster.Type: ApplicationFiled: February 8, 2021Publication date: March 21, 2024Inventors: Kimio TSUCHIKAWA, Fumihiro YOKOSE, Misa FUKAI, Yuki URABE, Sayaka YAGI
-
Publication number: 20240020894Abstract: A display control device sets a node on the basis of history information of an operation performed by a user using a terminal device and generates a graph object in which a transition between nodes is expressed as a link. The display control device detects a main flow in which nodes having predetermined features are connected to each other among a plurality of nodes included in the graph object and calculates importance of the nodes included in the graph object. The display control device displays a flow in which the nodes included in the graph object are summarized on the basis of the importance of the nodes and a distance to a node in the main flow.Type: ApplicationFiled: November 12, 2020Publication date: January 18, 2024Inventors: Sayaka YAGI, Kimio TSUCHIKAWA, Haruo OISHI, Fumihiro YOKOSE, Yuki URABE
-
Patent number: 11875024Abstract: An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.Type: GrantFiled: May 15, 2020Date of Patent: January 16, 2024Assignee: Nippon Telegraph and Telephone CorporationInventors: Fumihiro Yokose, Kimio Tsuchikawa, Haruo Oishi, Yuki Urabe, Sayaka Yagi, Takeshi Masuda
-
Publication number: 20230343084Abstract: A data processing device includes an acquisition unit, a generation unit, and a recognition unit. The acquisition unit acquires a plurality of images of a window. The generation unit extracts image portions of GUI component possibilities from each one of the plurality of images acquired by the acquisition unit, and generates, for each acquired image, arrangement data regarding arrangement places where the extracted image portions are arranged. The recognition unit compares image portions of predetermined GUI component possibilities in which arrangement places correspond to each other between a plurality of pieces of arrangement data generated by the generation unit, and recognizes the predetermined GUI component possibilities as operable GUI components in a case where the image portions of the predetermined GUI component possibilities are different from each other.Type: ApplicationFiled: September 11, 2020Publication date: October 26, 2023Inventors: Yuki URABE, Kimio TSUCHIKAWA, Fumihiro YOKOSE, Sayaka YAGI
-
Patent number: 11797163Abstract: A display control device acquires event data, that is, data expressed as a set of fixed units of data, and uses the acquired event data to display an image of the event data visualized according to a predetermined visualization method. Additionally, in the case of receiving an operation of attaching an electronic label to the displayed image, the display control device stores information about the electronic label, the event data, and setting information related to the image when the electronic label was attached in association with each other in storage. Also, in the case of receiving the specification of an electronic label to be restored from among the electronic labels, the display control device acquires the data of the electronic label as well as the event data and setting information associated with the electronic label from the storage, and restores the image with the electronic label attached.Type: GrantFiled: February 26, 2020Date of Patent: October 24, 2023Assignee: Nippon Telegraph and Telephone CorporationInventors: Takeshi Masuda, Haruo Oishi, Akira Kataoka, Kimio Tsuchikawa, Fumihiro Yokose, Yuki Urabe, Makoto Komiyama, Sayaka Yagi
-
Patent number: 11797553Abstract: A timeline display device includes processing circuitry configured to store event data for displaying a figure that represents an operation along a time axis, the event data including a start time point and an end time point of the operation, acquire a search condition that specifies an appearance pattern of the figure that is displayed, and search for data pieces of the event data that match the acquired search condition.Type: GrantFiled: June 10, 2019Date of Patent: October 24, 2023Assignee: Nippon Telegraph and Telephone CorporationInventors: Fumihiro Yokose, Kimio Tsuchikawa, Sayaka Yagi, Yuki Urabe, Takeshi Masuda
-
Publication number: 20230230300Abstract: A display control apparatus includes a log processing unit that reads an operation log related to operation information and generates first and second object groups indicating operation information represented by first and second visualized representations in first and second two-dimensional planes of a three-dimensional, respectively, the second two-dimensional plane being that is different from the first two-dimensional plane, such that a position of a first object of the first object group and a position of a second object of the second object group which indicate same operation information match on a common axis of the first and second two-dimensional planes, a display control unit that sets a coordinate of each of the first and second objects on the common axis, and a visualization unit that draws an object corresponding to an instructed visualized representation in accordance with the coordinates to perform screen display.Type: ApplicationFiled: June 15, 2020Publication date: July 20, 2023Inventors: Sayaka YAGI, Kimio TSUCHIKAWA, Takeshi MASUDA, Fumihiro YOKOSE, Yuki URABE, Haruo OISHI
-
Publication number: 20230222713Abstract: A display control apparatus (10) generates, based on a hierarchical structure of data items included in an operation log, a graphical object representing a series of operations indicated in the operation log with a node and a link. The display control apparatus (10) generates visualized information in which information indicating a connection relationship between nodes belonging to a lower hierarchical level than that of a node belonging to a first hierarchical level is represented in the node in a nested manner based on the generated graphical object. The information indicating the connection relationship between nodes in the nest is information in which a start node on a first axis in the nest is connected with a link to an end node on a second axis. In addition, the display control apparatus (10) disposes, with respect to a node group of the first hierarchical level in the visualized information, nodes having higher commonality in values of the data items such that they are brought closer to each other.Type: ApplicationFiled: June 15, 2020Publication date: July 13, 2023Inventors: Sayaka YAGI, Kimio TSUCHIKAWA, Takeshi MASUDA, Fumihiro YOKOSE, Yuki URABE, Haruo OISHI
-
Publication number: 20230195280Abstract: An identification apparatus (10) includes a screen configuration comparison unit (1314) configured to determine equivalence of screen components between sample screen data and processing target screen data based on whether a screen component in a screen structure of the sample screen data and a screen component in a screen structure of the processing target screen data have similar relationships to other screen components in the respective screen structures.Type: ApplicationFiled: May 29, 2020Publication date: June 22, 2023Inventors: Shiro OGASAWARA, Takeshi MASUDA, Fumihiro YOKOSE, Hidetaka KOYA, Yuki URABE