Abstract: Embodiments disclosed herein include a system that is capable of processing test data across multiple sessions of a video game. In some cases, the tests are performed over multiple video games that share a game engine. The generated test data may be analyzed as the test is being performed and key performance indicators may be extracted from the test data reducing the test data by at least an order of magnitude. Further, the extracted key performance indicators are used to automatically conduct further testing, such as regression testing, based on an analysis of the key performance indicators with respect to trend data generated from prior tests of the video game or of a shared game engine used by multiple video games.