Abstract: Monitoring quality of experience (QoE) using a no-reference (NR) method. An uncompressed audio/video (AV) stream is received from output of a device under test (DUT), where the uncompressed AV stream includes content that is known to be devoid of a set of one or more AV artifacts. At least one of the set of AV artifacts is automatically tested for its existence using a no-reference method that does not use a comparison to an input reference AV stream. Upon determining that there is an AV event representing one of the set of AV artifacts based on the automatic testing, a video clip that includes the AV event is automatically generated. The automatically generated video clip is stored.

Abstract: Monitoring quality of experience (QoE) using a no-reference (NR) method. An uncompressed audio/video (AV) stream is received from output of a device under test (DUT), where the uncompressed AV stream includes content that is known to be devoid of a set of one or more AV artifacts. At least one of the set of AV artifacts is automatically tested for its existence using a no-reference method that does not use a comparison to an input reference AV stream. Upon determining that there is an AV event representing one of the set of AV artifacts based on the automatic testing, a video clip that includes the AV event is automatically generated. The automatically generated video clip is stored.

Abstract: An automation testing apparatus includes a controller that is configured to receive a set of one or more commands that are part of a test and programmatically manipulate a set of components that connect the automation testing apparatus with a device under test (DUT) to test the DUT according to the set of commands The set of components may include a power switch that is configured to turn on and off power to the DUT, a communication controller that is configured to send commands to be executed by the DUT, and an audio/video switch that is configured to turn on and off audio and/or video of the DUT. The controller logs the set of commands executed and a result of execution of the set of commands to analyze whether the test passed.