Patents by Inventor Er-Xin Shang

Er-Xin Shang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11886790
    Abstract: Method and system to automatically verify the layout of a webpage on various screen sizes. The method includes retrieving screen size data associated with the webpage. The method further includes determining anchor points for the webpage based on the retrieved screen size data. The method also includes rendering the plurality of elements of the webpage based on the retrieved screen size data and the determined anchor points and identifying a respective location of each of the plurality of elements of the webpage to verify the layout of the plurality of elements of the webpage. If an error in the layout of the webpage is detected, a visual and/or audio alert is sent.
    Type: Grant
    Filed: August 5, 2021
    Date of Patent: January 30, 2024
    Assignee: Micro Focus LLC
    Inventors: Er-Xin Shang, Hua-Ming Zhai, Tezeen Yu
  • Patent number: 11704230
    Abstract: In some examples, a system processes event data and video frames produced by a program during execution of the program, the event data representing user actions with respect to a graphical user interface (GUI) of the program. The system identifies an area of the GUI that corresponds to a respective user action of the user actions, wherein identifying the area of the GUI uses a first video frame before an event corresponding to the respective user action, and a second video frame after the event corresponding to the respective user action. The system identifies, based on the identified area, a test object representing a user interface (UI) element, and generates a test script for testing the program, the test script including the test object.
    Type: Grant
    Filed: January 11, 2019
    Date of Patent: July 18, 2023
    Assignee: Micro Focus LLC
    Inventors: Er-Xin Shang, Bin Zhou, Chao Lin Jiang
  • Patent number: 11675689
    Abstract: According to examples, an apparatus may include a processor and a memory on which are stored machine-readable instructions that when executed by the processor, may cause the processor to track traffic events and user interface (UI) events in parallel and record a first event of a hybrid test script. The first event may be recorded in a traffic mode to record one or more of the traffic events. The processor may transition from the traffic mode to a UI mode and, responsive to the transition from the traffic mode to the UI mode, may share session data between the traffic events and the UI events. Based on the session data, the processor may record a second event of the hybrid test script in the UI mode.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: June 13, 2023
    Assignee: MICRO FOCUS LLC
    Inventors: Yan-Jun Yu, Er-Xin Shang, Fei Gao
  • Patent number: 11650911
    Abstract: Embodiments provide for automated testing of an Application Under Test (AUT) that utilizes an infinite scroll element. Automated testing of the AUT can comprise executing one or more test scripts on the AUT which can present a user interface including a plurality of elements and the test scripts can perform one or more functional tests on the AUT through the plurality of elements of the user interface. During performance of the one or more functional tests, a scroll event associated with an element of the user interface can be detected and a determination can be made as to whether the element associated with the scroll event is an infinite scroll element. In response to determining the element is an infinite scroll element, a set of test results for the functional test can be recorded including results for the infinite scroll element and an interaction with the infinite scroll element.
    Type: Grant
    Filed: June 8, 2021
    Date of Patent: May 16, 2023
    Assignee: Micro Focus LLC
    Inventors: Er-Xin Shang, Yun-Sheng Liu, Shuhui Fu, Yi-Bin Guo, Yun Yuan, Hua-Ming Zhai
  • Publication number: 20230078782
    Abstract: Systems and methods of associating text with a graphical user interface (GUI) object are disclosed. Disclosed systems and methods include identifying a GUI object and a text string. A positional relationship between the GUI object and the text string is determined. Based on the positional relationship between the GUI object and the text string, a map with an indication associating the GUI object with the text string is updated.
    Type: Application
    Filed: September 10, 2021
    Publication date: March 16, 2023
    Applicant: MICRO FOCUS LLC
    Inventors: Er-Xin Shang, Shuhui Fu, Yi-Bin Guo, Niv Lederer
  • Publication number: 20230075004
    Abstract: An image of a graphical user interface is captured. A process is started to record identification of a graphical object (e.g., a text field) in the image of the graphical user interface. Recording identification of the graphical object in the image of the graphical user interface is based on machine learning. An end to the process to record identification of the graphical object in the image of the graphical user interface is identified. A machine learned software object is updated. For example, the machine learned software object is updated with a location of the graphical object. The updated machine learned software object then is used to test the graphical object. For example, to automatically fill in the text field using a test script.
    Type: Application
    Filed: August 30, 2021
    Publication date: March 9, 2023
    Applicant: MICRO FOCUS LLC
    Inventors: Yun-Sheng Liu, Peng-Ji Yin, Er-Xin Shang, Gil Nakache, Tsachi Ben Zur, Anton Kaminsky, Shuhui Fu, Amos Nesher, Eyal Luzon
  • Publication number: 20230044682
    Abstract: Method and system to automatically verify the layout of a webpage on various screen sizes. The method includes retrieving screen size data associated with the webpage. The method further includes determining anchor points for the webpage based on the retrieved screen size data. The method also includes rendering the plurality of elements of the webpage based on the retrieved screen size data and the determined anchor points and identifying a respective location of each of the plurality of elements of the webpage to verify the layout of the plurality of elements of the webpage. If an error in the layout of the webpage is detected, a visual and/or audio alert is sent.
    Type: Application
    Filed: August 5, 2021
    Publication date: February 9, 2023
    Applicant: MICRO FOCUS LLC
    Inventors: Er-Xin Shang, Hua-Ming Zhai, Tezeen Yu
  • Patent number: 11573889
    Abstract: An image of a graphical user interface is captured. For example, a screen shot of a browser display is captured. Text syntax is executed that contains one or more parameters for identifying a graphical object. For example, the text syntax may identify a rectangle that contains the text “OK” where the text is red. Based on the text syntax, a graphical object is identified in the image of the graphical user interface. Information is returned that identifies how to access the graphical object in the graphical user interface. For example, coordinates of the graphical object are identified. This information can then be used in a test script using existing programming languages to test the graphical user interface. For example, the coordinates may be used to click on the OK button.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: February 7, 2023
    Assignee: Micro Focus LLC
    Inventors: Er-Xin Shang, Hua-Ming Zhai, Yun-Sheng Liu, Tezeen Yu
  • Patent number: 11567859
    Abstract: Embodiments of the disclosure provide systems and methods for executing a functional test on an application. According to one embodiment, a method for running a functional test on an application can comprise executing the function test on the application. The functional test can comprise a plurality of steps. The plurality of steps can comprise a set of related steps having one or more relationships between each other and a set of one or more independent steps having no relationships to other steps in the plurality of steps. The one or more relationships between the set of related steps can be deduced and an indication of the deduced one or more relationships between the set of related steps can be saved. The functional test can then be replayed on the application based on the saved indication of the deduced one or more relationships between the set of related steps.
    Type: Grant
    Filed: March 18, 2021
    Date of Patent: January 31, 2023
    Assignee: Micro Focus LLC
    Inventors: Hua-Ming Zhai, Er-Xin Shang, Kai Zhou
  • Patent number: 11561678
    Abstract: An image of a user interface of a device is captured. A graphical object is identified in the image of the user interface. For example, a menu item or a text object is identified in the image of the user interface. An Artificial Intelligence (AI) process is used to determine a confidence score for the graphical object; the confidence score identifies a confidence of how likely a type of the graphical object can be identified. In response to the first confidence score not meeting a threshold, a zoomed in image of the graphical object is taken or a zoomed-out image of the graphical object is taken. The zoomed in image or the zoomed-out image is used to increase the confidence score to better identify the type of the graphical object.
    Type: Grant
    Filed: October 28, 2021
    Date of Patent: January 24, 2023
    Assignee: Micro Focus LLC
    Inventors: Er-Xin Shang, Shuhui Fu, Yun Yuan
  • Publication number: 20220391313
    Abstract: Embodiments provide for automated testing of an Application Under Test (AUT) that utilizes an infinite scroll element. Automated testing of the AUT can comprise executing one or more test scripts on the AUT which can present a user interface including a plurality of elements and the test scripts can perform one or more functional tests on the AUT through the plurality of elements of the user interface. During performance of the one or more functional tests, a scroll event associated with an element of the user interface can be detected and a determination can be made as to whether the element associated with the scroll event is an infinite scroll element. In response to determining the element is an infinite scroll element, a set of test results for the functional test can be recorded including results for the infinite scroll element and an interaction with the infinite scroll element.
    Type: Application
    Filed: June 8, 2021
    Publication date: December 8, 2022
    Inventors: Er-Xin Shang, Yun-Sheng Liu, Shuhui Fu, Yi-Bin Guo, Yun Yuan, Hua-Ming Zhai
  • Publication number: 20220360517
    Abstract: According to examples, an apparatus may include a processor that may schedule virtual users in a load test of a system under test. An apparatus may access user-specified or prestored points. Each point may represent a number of virtual users that is to place a load on the system under test at a given time. The apparatus may apply curve fitting, such as Bézier curve fitting, to generate a curve on a graph in which one axis represents time and another axis represents a number of virtual users at a given time. In some examples, the apparatus may use a smoothing factor to adjust the contours of the generated curve. The apparatus may use the curve to determine curve-fitted points to schedule virtual users at times corresponding to the curve-fitted points. To instantiate the virtual users, the system may use coroutines to reduce computational requirements for instantiating the virtual users.
    Type: Application
    Filed: July 23, 2019
    Publication date: November 10, 2022
    Applicant: MICRO FOCUS LLC
    Inventors: DONG-XING HUANG, ER-XIN SHANG, YAN YANG
  • Publication number: 20220300401
    Abstract: According to examples, an apparatus may include a processor and a memory on which are stored machine-readable instructions that when executed by the processor, may cause the processor to track traffic events and user interface (UI) events in parallel and record a first event of a hybrid test script. The first event may be recorded in a traffic mode to record one or more of the traffic events. The processor may transition from the traffic mode to a UI mode and, responsive to the transition from the traffic mode to the UI mode, may share session data between the traffic events and the UI events. Based on the session data, the processor may record a second event of the hybrid test script in the UI mode.
    Type: Application
    Filed: March 17, 2021
    Publication date: September 22, 2022
    Applicant: MICRO FOCUS LLC
    Inventors: Yan-Jun YU, Er-XIN SHANG, Fei GAO
  • Publication number: 20220300396
    Abstract: An apparatus may include a processor (102) that may generate automated test scripts to test graphical user interface (GUI) functions of an application under test (AUT) (235). The apparatus may generate a screen element (220) that is overlaid onto at least one or all of the GUIs (210). The screen element (220) may therefore receive user inputs directed at the GUI (210), but block such inputs from being provided to the GUI (210). The user inputs received at the screen element (220) may be recorded in an automated test script for later replay. Blocking the user input may prevent a change in appearance of a GUI element (212) that would otherwise result from the user input, facilitating automated location of the GUI element (212) during replay of the automated test script.
    Type: Application
    Filed: June 6, 2019
    Publication date: September 22, 2022
    Inventors: HUA-MING ZHAI, ER-XIN SHANG, PING-JI YIN
  • Publication number: 20220300408
    Abstract: Embodiments of the disclosure provide systems and methods for executing a functional test on an application. According to one embodiment, a method for running a functional test on an application can comprise executing the function test on the application. The functional test can comprise a plurality of steps. The plurality of steps can comprise a set of related steps having one or more relationships between each other and a set of one or more independent steps having no relationships to other steps in the plurality of steps. The one or more relationships between the set of related steps can be deduced and an indication of the deduced one or more relationships between the set of related steps can be saved. The functional test can then be replayed on the application based on the saved indication of the deduced one or more relationships between the set of related steps.
    Type: Application
    Filed: March 18, 2021
    Publication date: September 22, 2022
    Inventors: Hua-Ming Zhai, Er-Xin Shang, Kai Zhou
  • Publication number: 20220291936
    Abstract: Systems and methods of automatically generating a video are described. Systems and methods include receiving a test script, generating a step action tree comprising a plurality of actions based on the test script, receiving a selection of a first action of the plurality of actions in the step action tree, and based on the selection of the first action, generating a video clip of a graphical user interface performing the first action and associating the multimedia clip with the first action.
    Type: Application
    Filed: March 15, 2021
    Publication date: September 15, 2022
    Inventors: Er-Xin Shang, Fei Gao, Yan-Jun Yu, Peter Raymond
  • Patent number: 11422696
    Abstract: In some examples, a system executes a program that generates a user interface (UI) screen, provides a user input event to the program during execution, and captures images of the UI screen before and after the user input event. The system determines, based on the captured images, whether a first region of the UI screen changed in response to the user input event, and indicates the first region as a user interactive region and adds an element representing the user interactive region to a representation of user interactive regions of a UI of the program.
    Type: Grant
    Filed: February 25, 2019
    Date of Patent: August 23, 2022
    Assignee: Micro Focus LLC
    Inventors: Er-Xin Shang, Wen-Jie Qian, Haiyu Gao
  • Patent number: 11416381
    Abstract: This document describes techniques and apparatuses for supporting web components associated with a document object model (DOM) corresponding to a data file in a web testing environment. A user interaction, relative to a web page or web application from which the DOM is rendered, is monitored in the web testing environment. The monitoring identifies a target element selected by the user that is referenced in a shadow DOM associated with the DOM. One or more parent shadow host elements of the DOM are identified relative to the target element. The one or more shadow host elements define a reduced path, with respect to a tree data structure representing the DOM and the shadow DOM, for linking a document object of the DOM to the target element. Indicia identifying the one or more shadow host elements as linking the document object of the DOM to the target element are recorded.
    Type: Grant
    Filed: July 17, 2020
    Date of Patent: August 16, 2022
    Assignee: Micro Focus LLC
    Inventors: Er-Xin Shang, Bin Zhou, Chao-Lin Jiang, Ran Li
  • Patent number: 11403209
    Abstract: A graphical user interface (GUI) of an application under test (AUT) is rendered. A GUI test object of the AUT is identified within the GUI. Test information regarding the GUI test object of the AUT is retrieved. The GUI test object of the AUT is rendered within the GUI to reflect the test information.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: August 2, 2022
    Assignee: MICRO FOCUS LLC
    Inventors: Er-Xin Shang, Bin Zhou, Bin Gao, Bin Li
  • Publication number: 20220229764
    Abstract: According to examples, an apparatus may include a processor that may identify sensitive information in a recording of an automated test script that is replayed to automatically test a graphical user interface (GUI) of an application under test (AUT). The apparatus may identify the sensitive information during the recording such that sensitive information is identified as the automated test is recorded or afterward based on an analysis of the recording. as based on user input that identifies the sensitive information (or areas containing the sensitive information), automated text analysis, or automated image analysis such as machine-learning based object detection. Once sensitive information (or area) is identified, the apparatus may generate and apply a mosaic to obscure the sensitive information (or area).
    Type: Application
    Filed: July 10, 2019
    Publication date: July 21, 2022
    Applicant: MICRO FOCUS LLC
    Inventors: HUA-MING ZHAI, BO TIAN, ER-XIN SHANG, CHU Jun Dong