Audio processing using a video rasterizer
Audio processing using a video rasterizer allows simultaneous display of both audio and video data on the same raster display. Audio samples are clocked into a buffer memory, such as a first-in, first-out (FIFO) buffer, by an audio clock and clocked out of the buffer memory by a rasterizer (system) clock to allow the audio data to cross over from the audio clock domain to the video clock domain. The audio data is then upsampled by a sample ratio converter/interpolator before being processed by a video display engine. The video display engine includes a polyphase filter for upsampling display data for input to a rasterizer from which the data is read for display.
Latest Tektronix, Inc. Patents:
The present invention relates to audio/video test and measurement, and more particularly to audio processing using a video rasterizer for displaying representative waveforms.
In a video instrument, such as a video waveform monitor or vectorscope, the video data is sampled at a high data rate, such as 27 MHz. Therefore a system clock is used in the instrument which has a frequency that is an integer multiple of the video data rate. For raster scan displays the video data is stored in a rasterizer. The contents of the rasterizer are readout for display at a rate such that the display is updated usually thirty times per second. In contrast audio data is sampled at a much lower rate than the video data rate, such as 48 kHz. To provide a waveform display of the audio data conventionally requires separate equipment having circuitry designed for audio data rates.
U.S. Pat. No. 5,485,199 by Bob Elkind et al entitled “Digital Audio Waveform Display on a Video Waveform Display Instrument”, issued Jan. 16, 1996, stores digital audio data in a small buffer memory and replaces bursts of video data through a digital-to-analog converter (DAC) running at the video sample rate. This super-clocking of the digital audio data to the video data rate works well with analog waveform display technology, since the DAC reconstruction filter interpolates the audio data as if it were at the digital sample rate. Therefore a single DAC and filter may be used to combine audio waveforms with video waveforms for simultaneous display of the interpolated digital data.
Prior digital audio waveform monitors generate a raster display by writing to a dedicated frame buffer read by a display controller at a display frame rate. A video waveform monitor generates frames for the display in a similar manner, but at a much higher clock frequency and pixel rate. To combine video and audio waveforms in the same platform has required separate buffers for building the audio and video histograms.
What is desired is a method of simultaneously displaying audio and video data using a shared display technique without discarding any data.
BRIEF SUMMARY OF THE INVENTIONAccordingly the present invention provides audio processing using a video rasterizer. Audio samples are clocked into a buffer memory, such as a first-in, first-out (FIFO) buffer, by an audio clock and clocked out of the buffer memory by a rasterizer (system) clock to allow the audio data to cross over from the audio clock domain to the video clock domain. The audio data is then upsampled by a sample ratio converter/interpolator before being processed by a video display engine. The video display engine includes a polyphase filter for upsampling display data for input to a rasterizer from which the data is read for display. In this way both audio and video data use the same display technique to allow simultaneous display of both audio and video data on the same raster display.
The objects, advantages and other novel features of the present invention are apparent from the following detailed description when read in conjunction with the appended claims and attached drawing.
Referring now to
The audio data, to be treated simply as another set of video data, crosses into the video clock domain. The FIFO 20 is used for crossing clock boundaries that are significantly different, as is the case between audio and video data. The controller 24 blanks the display 14 during periods of time when the audio data is invalid, usually resulting from the fact that the video processing clock is not an integer multiple of the audio data rate. The controller 24 also allows the polyphase filter 16 to shift in new data. If the ratio of audio data rate to the audio bandwidth is not greater than the ratio that is expected at the polyphase filter 16, i.e., the video data has been upsampled, the sample ratio converter 22 is used to increase the audio data rate. The polyphase filter 16 is used to perform the final upsampling, resulting in a final sample rate increase hundreds of times over the original audio data rate, compared to two, four or eight times upsampling found in similar audio waveform monitors. Simultaneous audio and/or video waveforms may be displayed by replicating the multiplexer 26 and the polyphase filter 16.
The frequency response of a digital filter is directly related to the sample rate of the data being sampled. As a result doubling the sample rate of a filter doubles the bandwidth. Often digital filter frequency response plots are plotted with the X-axis normalized to indicate that the absolute frequency response is only known after the sampling rate is specified.
As a specific illustration a two-tap 512 phase polyphase filter is used as the polyphase filter 16 for rasterization. To have the desired frequency response the audio data is interpolated by eight before being sent to the polyphase filter 16. The interpolation may avoided if the two-tap filter is extended to a larger filter length. But since the data rate is much slower than the system clock rate, the 8× interpolation may be performed with a single multiplier and a 64 coefficient look-up table compared to extending the two-tap filter to 10 taps with the attendant cost of eight multipliers and eight 512 coefficient look-up tables. Since all the other measurement modes only need the two-tap filter, there is no benefit to altering it. In this way the video display engine is unchanged when adding the audio processing to it to become an audio/video display engine.
Referring now to the Table below and the timing diagram of
Therefore for each input audio sample eight phases are generated by the sample ratio converter 22, with each phase being upsampled by 35 by the polyphase filter 16, to produce the 280 display samples for each input audio sample.
Thus the present invention provides audio processing for a video waveform monitor using a video rasterizer by buffering input audio data and interpolating the audio data to provide upsampling for input to the video rasterizer which in turn has a polyphase filter for further upsampling the audio data.
Claims
1. An apparatus for displaying audio data at video data rates of the type having a polyphase filter for receiving display data and upsampling the display data for input to a display rasterizer further comprising:
- means for converting the audio data from an audio clock domain to a video clock domain; and
- means for interpolating the audio data from the converting means prior to input to the polyphase filter to produce interpolated audio data as the display data.
2. The apparatus as recited in claim 1 wherein the converting means comprises a buffer memory having the audio data clocked in at an audio clock rate and clocked out at a system clock rate in the video clock domain for input to the interpolating means.
3. The apparatus as recited in claim 1 or 2 wherein the interpolating means comprises a sample ratio converter having the audio data in the video clock domain as an input and providing the interpolated audio data as an output.
4. The apparatus as recited in claim 3 further comprising means for blanking the display rasterizer when the audio data is invalid.
5. The apparatus as recited in claim 1 or 2 further comprising means for blanking the display rasterizer when the audio data is invalid.
6. A method of simultaneously displaying audio and video data using a video display engine having a polyphase filter for upsampling display data and a rasterizer for storing the upsampled display data for display comprising the steps of:
- converting the audio data from an audio clock domain to a video clock domain; and
- upsampling the audio data in the video clock domain to produce interpolated audio data as the display data for input to the polyphase filter.
7. The method as recited in claim 6 further comprising the step of selecting between the upsampled audio and video data for input to the polyphase filter.
8. The method as recited in claim 6 or 7 wherein the converting step comprises the steps of:
- clocking the audio data into a buffer memory at an audio clock rate; and
- clocking the audio data from the buffer memory at a system clock rate in the video clock domain for input to the upsampling step.
9. The method as recited in claim 8 further comprising the step of blanking the rasterizer when the audio data is invalid.
10. The method as recited in claim 6 or 7 further comprising the step of blanking the rasterizer when the audio data is invalid.
Type: Grant
Filed: Feb 7, 2003
Date of Patent: May 2, 2006
Patent Publication Number: 20040155964
Assignee: Tektronix, Inc. (Beaverton, OR)
Inventor: Evan Albright (Portland, OR)
Primary Examiner: Sherrie Hsia
Attorney: Francis I. Gray
Application Number: 10/359,866
International Classification: H04N 17/00 (20060101);