Abstract: The present disclosure provides system and method embodiments for a status register comprising a plurality of bits, where each of the plurality of bits of the status register is associated with one of a plurality of entities. A trigger mechanism is configured to write a trigger data pattern to the status register, where the trigger data pattern comprises a first state value for each of the plurality of bits of the status register. A capture mechanism is configured to write a second state value to each bit of the status register that is associated with an entity that is presently associated with a first type of entity status information, in response to a detection that the trigger data pattern is written to the status register.

Abstract: A method, system, and computer-readable media for automatically detecting an abnormal data transfer rate in a channel instance. The method includes determining a normal data transfer rate for a particular channel instance and then monitoring data transfer rates for a channel instance. Corrective action may be taken when the data transfer rate in a channel instances deviates more than a threshold amount from the normal rate.

Abstract: An extraction method comprising: acquiring configuration information indicating a configuration of a processing device for each generation that represents a respective time period between configuration modifications, and extracting first information indicating configuration modifications between generations based on a plurality of generations of the acquired configuration information; acquiring performance information indicating various types of performance of the processing device at respective times, and extracting, as second information associated with one of the generations, a time when an abnormality was detected in change to a time series of the acquired performance information; acquiring event information indicating an event occurring in the processing device at respective times, and extracting, as third information associated with one of the generations, a time of event information creation when an abnormality was detected; and extracting the first information, the second information, and the third in

Abstract: Methods, apparatuses, and computer program products for correcting a failure associated with a current firmware image are provided. Embodiments include a firmware selection module detecting the failure associated with the current firmware image stored in firmware memory corresponding to a component of a system. Embodiments also include the firmware selection module selecting from a plurality of backup firmware images, a replacement firmware image based on a status of at least one backup firmware image in response to detecting the failure. Embodiments also include the firmware selection module storing the selected replacement firmware image in the firmware memory.

Abstract: A method for preventing read-disturb errors, a memory storage apparatus and a memory control circuit unit are provided. The method includes counting an operation numerical value when receiving an operation command from the host system, wherein a first physical erasing unit is selected for executing the operation command. The method also includes selecting a second physical erasing unit and reading data from the second erasing unit. The method further includes determining whether a data error occurs at the second physical erasing unit according to the data read from the second physical erasing unit, and if the data error occurs, selecting a third physical erasing unit, correcting the data read from the second physical erasing unit to generate corrected data and writing the corrected data into the third physical erasing unit.

Abstract: A user administers web hosting on user's server from his computer remotely. When a run time error is generated, an error message is sent to a server connected to a knowledge database. If the error matches the known error form the knowledge database, the user is provided an article with a solution to the run-time error. Statistics of occurrence of the errors are saved in the knowledge database. The frequently occurring errors are provided to developers for creating hosting application updates. Additionally, security policies of the user's server can be updated based on the data from the knowledge database.

Abstract: A sequence code verification system can be designed to include a data reader, a validity engine, and an error notifier. The data reader can read sequence codes from consecutive logical blocks. The validity engine can invalidate write operations in response to checking data validity by applying comparison operations to sequence codes and block offsets of batch write operations. The error notifier can notify a user of an error for each invalidated write operation batch. The system can validate data written to logical blocks on a storage subsystem adapted so that, during write operations, an additional sequence code is written to each logical block of data. The sequence code can remain constant for each write operation batch and the sequence code can be incremented for each new write operation batch.

Abstract: A method includes detecting that a first device in a memory array has degraded, the first device storing a portion of a data record, wherein the data record is encoded using a first error control technique. The method continues with recovering the data record using portions of the data record stored in devices other than the first device in the memory array and encoding the data record using a second error control technique. The method also includes storing the data record in the devices of the memory array other than the first device.

Abstract: Methods and apparatus are provided for read retry operations with read reference voltages ranked for different page populations of a memory. One method comprises obtaining a plurality of rankings of a plurality of read reference voltages for a plurality of page populations, wherein the rankings are based on a predefined performance metric; and reading a codeword from the memory a plurality of times, wherein each of the read operations uses a different one of the plurality of read reference voltages selected based on the rankings of the plurality of read reference voltages. The performance metric comprises, for example, a bit error rate, a bit polarity disparity, a substantially minimal syndrome weight and/or measures of an average system latency or a tail latency. The ranking is optionally based on a size of the page populations that had each of the ranked read reference voltages. Channel estimation is performed separately for each of the plurality of page populations.

Abstract: A system comprises a nonvolatile memory device comprising a memory cell array comprising a plurality of memory blocks each comprising a plurality of cell strings, each of cell strings comprises the plurality of memory cells stacked in a direction perpendicular to a substrate, a ground selection transistor disposed between the memory cells and the substrate, and a string selection transistor disposed between the memory cells and a bitline, and configured to read stored data from the memory cells using a plurality of read voltages; and a memory controller configured to read the memory cells using a reference voltage to generate on-cell data, and adjust the read voltages of the nonvolatile memory device based on the generated on-cell data.

Abstract: Systems and methods for performing partial block erase operations on a subset of word lines within a memory array prior to performing data refreshing or open-block programming are described. In some cases, data stored in memory cells connected to a word line with a fail bit count above an error threshold (e.g., more than two bit errors per page or more than three bit errors per word line) may be refreshed by performing a read operation on the memory cells, generating corrected data for the memory cells, performing a partial block erase operation on one or more word lines including the word line, and then writing the corrected data into the memory cells. The one or more word lines may include the word line with the fail bit count above the error threshold and an adjacent word line that is adjacent to the word line.

Abstract: A system includes a first nonvolatile memory array, a second nonvolatile memory array, and a memory controller. The memory controller is configured to write an indicator bit to the second nonvolatile memory array, determine whether the indicator bit is valid in response to a power up of the system after a high-temperature event, a received command after a high-temperature event, a predetermined number of power ups, or a power up or received command after each of a predetermined number of high-temperature events, and write data stored in the second nonvolatile memory array to the first nonvolatile memory array when the indicator bit is valid.

Abstract: A plurality of storage nodes is provided. The plurality of storage nodes is configured to communicate together as a storage cluster. Each of the plurality of storage nodes includes nonvolatile solid-state memory. The plurality of storage nodes is configured to distribute user data and metadata associated with the user data throughout the plurality of storage nodes such that the plurality of storage nodes maintain the ability to read the user data, using erasure coding, despite a loss of one of the plurality of storage nodes. A chassis enclosing the plurality of storage nodes includes power distribution, a high speed communication bus and the ability to install one or more storage nodes which may use the power distribution and communication bus in some embodiments. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory is also provided.

Abstract: A method begins by a processing module storing a set of encoded data slices in storage units. A data segment of data is encoded, in accordance with dispersed storage error encoding parameters, to produce the set of encoded data slices. The dispersed storage error encoding parameters include a decode threshold number and a pillar width number, which is at least twice the decode threshold number. The method continues with the processing module processing a first request for retrieval of the data segment by retrieving a first sub-set of encoded data slices, which includes the decode threshold number, and decoding them to produce a first recovered data segment. The method continues with the processing module processing a second request for retrieval of the data segment by retrieving a second sub-set of encoded data slices, which includes the decode threshold number, and decoding them to produce a second recovered data segment.

Abstract: The present disclosure provides a memory management method for a rewritable non-volatile memory module. The rewritable non-volatile memory module includes physical programming units, each of which includes multiple bits. The memory management method includes: identifying a first physical programming unit by applying a predetermined read voltage, where the first physical programming unit is identified as in a fully-erased status; identifying a second and a third physical programming units which are programmed before the first physical programming unit; acquiring status data of the second and the third physical programming unit; computing a difference of the status data between the second and the third physical programming unit; if the difference is larger than a threshold, identifying the second physical programming unit as in a program failure status.

Abstract: Described herein are techniques for storing data in a redundant manner on a plurality of storage units of a storage system. While all of the storage units are operating without failure, only error-correction blocks are stored on a first one of the storage units, while a combination of data blocks and error-correction blocks are stored on a second one of the storage units. Upon failure of the second storage unit, one or more data blocks and one or more error-correction blocks formerly stored on the second storage unit are reconstructed, and the one or more reconstructed data blocks and the one or more reconstructed error-correction blocks are stored on the first storage unit.

Abstract: An apparatus and method of providing conditional access to an electronic data store including a storage controller and a data storage resource. The method includes receiving, at the storage controller, a network request for access to the data storage resource from a client, the request including at least one required parameter defining the requested connection, obtaining information on the performance of the data storage resource, determining, based upon the information, whether a) the data storage resource can meet the or each required parameter of the request; and b) meeting the or each required parameter of the request will not violate any previously agreed parameters defining existing connections on the data storage resource; and denying the request if at least one of a) and b) are determined to be negative.

Abstract: A technique configures data storage equipment to (i) allow host I/O operations to start on storage devices while a credit tally is less than a predefined credit quota and (ii) block host I/O operations from starting on the storage devices while the tally is greater than the quota. The technique further involves, while a rebuild procedure is not being performed on the storage devices, (i) allocating host I/O credits at equal weight to the tally upon starting host I/O operations and (ii) de-allocating the credits at equal weight from the tally upon completion of the operations. The technique further involves, while the rebuild procedure is being performed on the storage devices, (i) allocating host I/O credits at greater than equal weight to the tally upon starting host I/O operations and (ii) de-allocating the credits at greater than equal weight from the tally upon completion of the operations.

Abstract: Various embodiments managing host recovery operations in a computing storage environment, by a processor device, are provided. Real-time indications are provided from a device to each of at least one of a plurality of hosts that a connected storage controller is entering a recovery operation, and real-time sense data is provided to the at least one of the plurality of hosts for presenting an indication of an expected recovery timeframe.

Abstract: Managing a virtual machine snapshot in O(1) time by initially storing data from a virtual machine executing under a host operating system, to a first host operating system managed data block and creating a first pointer that points to the first host operating system managed data block and associates the virtual machine to the data stored in the first host operating system managed data block. A first value, associated with the first host operating system managed data block, is initialized indicating the number of pointers created to associate the virtual machine to the first host operating system managed data block. Receiving, by the computer host operating system, a request to create a snapshot of the virtual machine creates a second pointer replicating the first pointer, and increments, by the computer host operating system, the first value associated with the first host operating system managed data block.

Abstract: A comprehensive approach to streaming backups for virtual machines (“VMs”) in a storage management system comprises improvements to the assignment of data agent proxies for VM secondary copy operations. New considerations in performing a VM streaming backup job include without limitation: determining and enforcing a system-wide per-proxy limit of concurrent data streams; generating an ordered priority list of the VMs to be backed up as a basis for choosing which proxies will back up the respective VM, though the illustrative system may not strictly adhere to the priority list based on further considerations; identifying a next available proxy based on data stream utilization at the proxy; and dynamically re-generating the priority list and re-evaluating considerations if some VMs become “stranded” due to a failure to be backed up. Secondary copy operations are distributed to proxies in ways that improve the chances of successfully completing VM streaming backups.

Abstract: The invention relates to a computer implemented method for creating a backup of data by a computer system. The creation of the backup comprises: assigning a first memory space in a main memory to data and loading the data into the first memory space; allocating a second memory space in the main memory for acting as container of one or more images of the data in the first memory space; creating the one or more images of the data in the first memory space; and storing the created one or more images in the second memory space and storing a respective copy of at least one of the one or more images in the one or more non-volatile storage media.

Abstract: Provided are techniques for managing backup operations from a client system to a primary server and secondary server. A determination is made at the client system of whether a state of the data on the secondary server permits a backup operation in response to determining that the primary server is unavailable when a force failover parameter is not set. The client system reattempts to connect to the primary server to perform the backup operation at the primary server in response to determining that the state of the data on the secondary server does not permit the backup operation. The client system performs the backup operation at the secondary server in response to determining that the state of the secondary server permits the backup operation.

Abstract: A computer implemented method, system, and program product for creating snapshots instructions at a replication site, the method comprising determining the differences between a first snapshot at a first time of a LUN and a second snapshot at a second time of the LUN, determining the differences between the second snapshot and a third snapshot at a third time of the LUN, creating a redacted snapshot of the second snapshot wherein the redacted snapshot contains pointers to the first snapshot for the common data in the first snapshot and the second snapshot; wherein the redacted snapshot contains pointers to the third snapshot for common data in the second snapshot and the third snapshot; and further wherein the redacted snapshot stored data that is not present in the first snapshot and is not present in the third snapshot.

Abstract: A media agent is configured to perform substantially autonomously to initiate, continue, and manage information management operations such as a backup job of a certain client's primary data, manage the operations, and generate and store resultant system-level metadata from the operations, etc. The media agent is configured to do this even when out of communication with the storage manager that manages the information management system. When communications are restored, the media agent reports the relevant metadata to the storage manager. The storage manager comprises corresponding enhancements, including specialized logic for identifying the media agent as an intelligent media agent capable of some autonomous functionality, for transmitting management parameters thereto, and for seamlessly integrating the received metadata into the storage manager's associated management infrastructure such as a management database.

Abstract: In an example embodiment, updated repository instances are typically developed on a development system, transferred to a testing system, and after testing, transferred to a production system. Such an updated instance may comprise content, sources and a data dictionary. As an updated instance is moved from one system to another, the change is applied to an original instance. A shadow copy of content is kept for the original instance. In another example embodiment, a shadow copy of content is created as part of the change process. The sources and data dictionary may have their own versioning mechanism. To undo the applied change, the sources and data dictionary are rolled back to their pre-change state. The content is retrieved from the shadow copy and restored to the original instance. Finally, stranded data is restored according to appropriate policies.

Abstract: Example apparatus and methods process virtual machine image level backups that may include files that are compressed and files that are not compressed. Example apparatus and methods may produce virtual machine image level backups by selectively compressing some files associated with the image while leaving other files in their uncompressed state. Example apparatus and methods may selectively recover a file or even an entire disk image from an image level backup that may include both compressed files and files that are not compressed. The file recovery or image recovery may be performed at the file level by accessing files in the image and selectively decompressing files that are compressed in the image while passing through files that are not compressed in the image. Different files in a single image may be compressed or decompressed using different techniques.

Abstract: Techniques for processing changes in a cluster database system are provided. A first instance in the cluster transfers a data block to a second instance in the cluster before a redo record that stores one or more changes that the first instance made to the data block is durably stored. The first instance also transfers, to the second instance, a block change timestamp that indicates when a redo record for the one or more changes was generated by the first instance. The first instance also separately sends, to the second instance, a last store timestamp that indicates when the last redo record that was durably stored was generated by the first instance. The block change timestamp and the last store timestamp are used by the second instance when creating redo records for changes (made by the second instance) that depend on the redo record generated by the first instance.

Abstract: A method and apparatus for data recovery for a RDBMS instance in a heterogeneous database system is provided. A failure of a first RDBMS instance is detected in a plurality of RDBMS instances of a shared-disk database system. A compute cluster is configured to store, in memory, one or more tables stored by the shared-disk database system. The first RDBMS instance is configured to modify the one or more tables stored by the shared-disk database system and transfer modified data to the compute cluster to update the one or more tables at the compute cluster. After detecting the failure of the first RDBMS instance, redo records generated by the first RDBMS instance are scanned, pending modified data that was not transferred to the compute cluster before the failure is identified, and the pending modified data is transferred to the compute cluster.

Abstract: An integrated fail-silence and fail-operational control system includes a primary controller controlling features of devices while operating under non-fault operating conditions. A secondary controller includes a fail detector/decider module monitoring faults in the primary controller. The fail detector/decider module determines whether the fault in the primary controller is associated with a fail-silence requirement or a fail-operational requirement. If the fail detector/decider module determines the fault is a fail-silence requirement, then the fail detector/decider module actuates a shutdown command to the primary controller to shut down a feature affected by the fault where the feature becomes non-operational. If the fail detector/decider module determines that the feature associated with the fault is a fail-operational requirement, then the fail detector/decider module signals the primary controller to relinquish controls of the feature to the secondary controller.

Abstract: Methods, computing systems and computer program products implement embodiments of the present invention that include arranging multiple storage devices as a RAID array and receiving, from a given storage device storing a dataset, a number of error messages exceeding a threshold. A mirrored subset of the dataset is retrieved from the given device, and a calculated subset of the dataset is retrieved from remaining devices in the RAID array. In a first embodiment, the mirrored subset is created first, and the calculated subset includes a relative complement of the mirrored subset with respect to the dataset. In a second embodiment, the calculated subset is created first, and the mirrored subset includes a relative complement of the calculated subset with respect to the dataset. The mirrored and the calculated datasets are stored to an additional storage device, and the given device is replaced with the additional device in the RAID array.

Abstract: This NGDE algorithm incorporates a minimum cardinality candidate diagnosis generator which exploits conflict set reduction rules to dramatically reduce the search space and thus reduce the computational resources required to find minimum cardinality diagnoses.

Abstract: A computer program product includes creating a test suite, wherein the test suite includes a plurality of test cases for execution on a plurality of test agents. The method distributes a first portion of test cases to any available test agents, wherein each test case out of the first portion of test cases does not have any associated preconditions. The receives test results and event information for a first test case out of the first portion of test cases from a first test agent. Responsive to determining the event information for the first test case includes a satisfied condition for a second test case with one or more associated preconditions, the method determines whether the satisfied condition for the second test case relates to a global variable or local variable.

Abstract: A server stores multiple configuration data which respectively provide different functions to a test system. A tester hardware is configured to be capable of changing at least a part of its functions according to the configuration data stored in nonvolatile memory included in the tester hardware. A control program is installed on an information processing apparatus. The control program provides the information processing apparatus with (i) a function of displaying multiple configuration data candidates on a display when the test system is set up, and (ii) a function of writing the configuration data selected by the user to the nonvolatile memory of the tester hardware.

Abstract: A mobile apparatus and a localization method thereof which perform localization of the mobile apparatus using a distributed filter system including a plurality of local filters independently operated and one fusion filter integrating results of localization performed through the respective local filters, and additionally apply accurate topological absolute position information to the distributed filter system to improve localization performance (accuracy, convergence and speed in localization, etc.) of the mobile apparatus on a wide space. The mobile apparatus includes at least one sensor, at least one first distribution filter generating current relative position information using a value detected by the at least one sensor, at least one second distribution filter generating current absolute position information using the value detected by the at least one sensor, and a fusion filter integrating the relative position information and the absolute position information to perform localization.

Abstract: Systems and methods for providing information security in a network environment. The method includes receiving a user selection of a data section recorded on a storage system. The method further includes determining a monitoring routine for the data section. The method further includes determining a physical location at which the data section is recorded in the storage system. The method further includes monitoring the physical location for faults according to the monitoring routine.

Abstract: According to one embodiment, a device state estimation apparatus includes a detector and an operating state estimator. The detector detects devices in the ON operating state, based on a comparison between a calculated one of a first characteristic of a current or power harmonic in a power feed line and a reference one of the first characteristic which has been predetermined for at least one device. The operating state estimator extracts at least one set of the second characteristics from plural sets of second characteristics associated with harmonic, which have been predetermined. Each set of the second characteristics is for operating states of each of the devices. The one set of the second characteristics is for operating states of the device in the ON operating state which is detected by the detector.

Abstract: Disclosed are various in various embodiments are systems and methods providing for storage of mass data such as metrics. A plurality of data models are generated in the server from a stream of metrics describing a state of a system. Each of the metrics is associated with one of a plurality of consecutive periods of time, and each data model represents the metrics associated with a corresponding one of the consecutive periods of time. The data models are stored in a data store and each of the metrics is discarded after use in generating at least one of the data models.

Abstract: Aspects of the invention may be used to allocate tasks among computing machines in large scale computing systems. In one aspect, the method includes executing a first task in the plurality of tasks on a first computing machine and determining a performance degradation threshold for the first task. The method further includes calculating a predicted performance degradation of the first task when a second task is executed on the first computing machine, wherein the predicted performance degradation is determined by comparing a performance interference score of the second task with a performance sensitivity curve of the first task. The method further includes executing the second task on the first computing machine when the predicted performance degradation of the first task is below the performance degradation threshold.

Abstract: Trace data streams are generated for tracing target processor activity. Various trace data streams are synchronized using markers called sync points. The sync points provide a unique identifier field and a context to the data that will follow it. All trace data streams may generate a sync point with this unique identifier. These unique identifiers allow synchronization between multiple trace data streams. When multiple trace data streams are on, it is possible that the data input rate may be higher than the data output rate. If synchronization is lost in such a case, there must be a scheme to resynchronize the streams. This invention is a technique for this needed resynchronization.

Abstract: An optimizing compiler includes a vector optimization mechanism that optimizes vector instructions by eliminating one or more vector element reverse operations. The compiler can generate code that includes multiple vector element reverse operations that are inserted by the compiler to account for a mismatch between the endian bias of the instruction and the endian preference indicated by the programmer or programming environment. The compiler then analyzes the code and reduces the number of vector element reverse operations to improve the run-time performance of the code. The compiler generates a debugger table that specifies which instructions have corresponding reformatting operations. A debugger then uses the debugger table to display contents of the vector register, which is displayed in regular form as well as in a form that is reformatted according to information in the debugger table.

Abstract: The analysis of an intermediate representation of source or program code. An initial version of an initial representation of the source or program code is accessed and statically analyzed. For one or more portions of this initial version, the analysis component queries an analysis-time resolution component that provides supplemental intermediate representations corresponding to the portion. This supplemental intermediate representation provides further clarity regarding the portion, and is analyzed. If defects are found, they may be reported.

Abstract: Without using a high-level programming language source code, a set of sync points is identified in an initial binary code. The initial binary code is executed at a first system. A value of the user data is captured from a user space of a memory as a baseline of the user data. A set of comparative sync points is identified in a second binary code. During an execution of the second binary code, a second value of the user data from a second user space of a second memory is found to fail in matching the baseline of the user data. An instruction before the comparative sync point in the second binary code is identified as a location of a faulty operation due to the failing.

Abstract: A stream of tuples is received to be processed by processing elements operating on one or more computer processors with each processing element having one or more stream operators. A breakpoint is identified for a stream operator that is configured to be triggered when time for processing of a tuple by the first stream operator is predicted to exceed a threshold time. A tuple is received at the stream operator having a set of attributes. A predicted time to process the tuple is determined based on the set of attributes. It is determined that the predicted time exceeds the threshold time. The breakpoint is triggered, in response to determining that the predicted time exceeds the threshold time, to pause processing of the tuple by the first stream operator.

Abstract: Methods, systems, and products are provided for code path tracking. Embodiments include identifying an instrumented trace point in software code to be path tracked; identifying a function executed at the instrumented trace point in the software code; identifying parameters for the function executed at the instrumented trace point; and recording a description of the function, the parameters, and the result of the execution of the function using the parameters.

Abstract: A first stream operator in a stream computing application receives and processes a first stream of tuples. The processing at the first stream operator is paused in response to receiving a first one of the tuples in the first stream that triggers a breakpoint in the first stream operator. A determination of whether a condition to release the breakpoint is met is made, and the breakpoint is released in response to determining that the condition is met. The condition to release the breakpoint may be that a count of tuples of the first stream is outside of a threshold. A second stream of tuples may be received for processing at a second stream operator. The condition to release the breakpoint may be that a count of tuples of the second stream is outside of a threshold.

Abstract: Disclosed herein are a method and a system for software defect positioning. The system collects at least one type of information with respect to the defect and analyzes the collected input to select a suitable mode of defect positioning procedure. The defect positioning procedures used by the system identify defect location/position based on history data. After identifying the location of the defect, the system communicates the identified defect location/position to a user using a suitable output interface.

Abstract: Embodiments detect differences between software systems by comparing statements collected therefrom in an order of execution. Highlighting point(s) of divergence between the executed statements allows rapid localization of differences between the software systems, which may be minor and otherwise difficult to discern within large volumes of underlying code. In some embodiments a highlighted departure in statement order may be attributable to slight code differences between the two software systems. In other embodiments the software systems may have identical code but reference different configuration data (e.g. as configuration files), a subtle distinction also revealed by comparing an order of executed statements. Certain embodiments may perform tracing/comparison between an order of execution of only selected statement types (e.g., SQL operations, database access, kernel events) based upon their specificity and ability to reveal significant functional differences.

Abstract: A system, method, and computer program product are provided for identifying, quantifying, and reducing wasted resources in software testing. In use, a first duration of time over which at least one software testing environment was not available for at least one first software testing project is determined. At least one wasted resource amount associated with the first software testing project is calculated, the wasted resource amount resulting from the software testing environment not being available during the first duration of time. A potential saving in software testing effort associated with this project and/or at least one second software testing project is automatically calculated, based, at least partially, on the cause of the unavailability of the testing environment, on the determined first duration of time and the calculated wasted resource amount, the potential saving being achievable by making the software testing environment available for the second software testing project.

Abstract: A testing framework extension may be provided. An application comprising a form may be created within a modeling framework. A variable associated with the form may be defined and an application programming interface (API) may be created according to the form. A test case may be efficiently executed without rendering a physical UI using the variable by making at least one call to the API thus exercising (at least one part of) the form logic and a result of executing the test case may be reported to a user.