Recording medium having data structure for managing reproduction of text subtitle data and recording and reproducing methods and apparatuses
In the data structure for managing reproduction of text subtitle data, a recording area stores at least one subplayitem. The subplayitem identifies more than one clip information file name, and each clip information file named by the subplayitem indicates an associated clip of text subtitle data to reproduce from the recording medium. The text subtitle data in each clip is associated with at least a portion of main presentation data recorded on the recording medium. The subplayitem indicates a single presentation interval for the associated clips.
The subject application claims priority under 35 U.S.C. 119 on Korean Application No. 10-2003-071905 filed Oct. 15, 2003; the entire contents of both applications are hereby incorporated by reference.
BACKGROUND OF THE INVENTION1. Field of the Invention
The present invention relates to high density recording media such as optical discs, and in particular, blu-ray read-only discs.
2. Description of the Related Art
Optical discs that are capable of storing large amounts of high-quality video and audio data, have been available on the market. The digital versatile disc (DVD) is one example of such an optical disc. Recently, DVD players and DVD recorders have been available on the market and have become one of the most popular consumer electronic products.
Subtitle information that is to be displayed on screen as characters or logo during playback of a DVD title (e.g., a movie) is, in general, recorded on the DVD as bitmap-formatted image data. During playback of main audio/video data recorded on the digital versatile disc, the subtitle information is read out from the digital versatile disc and output to an external device such as a TV set after a series of signal processing steps so that the subtitle is displayed on the screen of the external device. With a DVD player, a user can choose and watch a desired subtitle on a TV set during reproduction of the DVD title.
Recently, the standardization of new higher density optical discs than DVD, for example blu-ray read-only disc (BD-ROM) has been under development. Standard specifications and methods of providing a great level of flexibility in managing and displaying subtitles, which are recorded on the optical disc or supplied from a content provider server through the Internet, have not yet been established.
SUMMARY OF THE INVENTIONA recording medium according to the present invention includes a data structure for managing reproduction of text subtitle data.
In one embodiment, the recording medium stores at least one subplayitem. The subplayitem identifies more than one clip information file name, and each clip information file named by the subplayitem indicates an associated clip of text subtitle data to reproduce from the recording medium. The text subtitle data in each clip is associated with at least a portion of main presentation data recorded on the recording medium, and the subplayitem indicates a single presentation interval for the associated clips.
In one embodiment, the navigation area also stores at least one playitem, and the playitem indicates at least a portion of the main presentation data to reproduce. Here, the playitem identifies a clip information file name that indicates a clip of main presentation data to reproduce, and the clip information files identified by the subplayitem and the playitem are separate files.
In another embodiment, each clip information file named by the subplayitem indicates a different associated clip of text subtitle data. For example, more than one of the associated clips of text subtitle data are each associated with a different foreign language.
In a still further embodiment, the recording medium stores at least one playlist including navigation information for reproducing main presentation data and text subtitle data associated with the main presentation data. The navigation information also indicates that the text subtitle data is part of a text subtitle subpath. The playlist includes at least one subplayitem that provides navigation information for reproducing more than one clip of text subtitle data from the recording medium. The subplayitem indicates a single presentation interval for the clips of text subtitle data.
In yet another embodiment, the recording medium stores separate clips of text subtitle data and at least one separate clip of main presentation data. Here, the text subtitle data is associated with the main presentation data. The recording medium also stores a subplayitem providing navigation information for reproducing the separate clips of text subtitle data for a same presentation interval, and stores a playitem providing navigation information for reproducing the clip of main presentation data.
The present invention further provides apparatuses and methods for recording and reproducing the data structure according to the present invention.
BRIEF DESCRIPTION OF THE DRAWINGSThe accompanying drawings, which are included to provide a further understanding of the invention, illustrate the exemplary embodiments of the invention, and together with the description, serve to explain the principles of the present invention. In the drawings:
FIGS. 1 to 4 illustrate embodiments of a file system structure, navigation data structure, and disc volume of an optical disc in accordance with the present invention;
FIGS. 5 to 20 illustrate embodiments of navigation data structure in accordance with the present invention for linking a plurality of text subtitle streams to a main audio/video stream;
FIGS. 22 to 24 illustrate block diagrams of embodiments of partial components of the optical disc reproducing apparatuses in accordance with the present invention.
DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTSIn order that the invention may be fully understood, exemplary embodiments thereof will now be described with reference to the accompanying drawings.
The file structure of an optical disc such as a BD-ROM in accordance with one embodiment of the present invention is shown in
The PLAYLIST directory includes a plurality of playlist files (*.mpls), the CLIPINF directory including a plurality of clip information files (*.clpi), and the STREAM directory includes a plurality of MPEG2 transport stream formatted audio/video (A/V) stream clip files (*.m2ts). The playlist file is associated with and identifies at least one clip information file. The clip information file, in turn, is associated with and identifies an A/V stream clip file to reproduce.
The MovieObject.bdmv or JavaObject.bdmv files include executable navigation commands or a command program for controlling the playback of playlists.
The index.bdmv file links movie and/or Java objects to, for example, a plurality of titles. For example, as shown in
Accordingly, the index.bdmv file, MovieObject.bdmv file and/or JavaObject.bdmv file provide a hierarchical structure for controlling the playback of playlists. And, the playlist files and clip information files provide a hierarchical structure for controlling reproduction of A/V stream clip files.
As shown in
In the BD-ROM in accordance with the present invention, in addition to the main video data, bitmap-formatted subtitle data, text-formatted subtitle data, and/or etc. may be recorded thereon. Either or both of the bitmap-formatted subtitle data and text-formatted subtitle data (hereinafter referred to as bitmap subtitle and text subtitle, respectively) may be multiplexed with the main video data before it is recorded on the BD-ROM (referred to as ‘in-mux’) or may be recorded separately thereon with no multiplexing (referred to as ‘out-of-mux’).
Bitmap subtitle data or text subtitle data may also be supplied from a content provider server (CP server) through networks such as the Internet. The text subtitle data from the CP server may be transmitted in the MPEG2 transport stream (TS) format or a predetermined binary stream format like the extensible markup language (XML) format. A plurality of the text subtitle data may be supplied from the CP server so as to provide the subtitles for several different languages. Moreover, streams of another type like audio streams may be supplied from the CP server together with the subtitle data.
In the optical disc reproducing apparatus in accordance with the present invention, the subtitle data that are either read out from an optical disc or supplied from a CP server may be linked to a main video data in such a way that the subtitle data are chosen and displayed appropriately, in a various way in response to a user's request while playback of the main video data, which will be described below in detail.
New navigation data structures based on playlist, playitem, subplayitem, or a predetermined structure are defined and used to link the bitmap subtitle data and/or text subtitle data with a main A/V stream being read out from the optical disc.
The navigation data structures are applicable when the text subtitle data is recorded on the BD-ROM or when it is already stored in memory such as a hard disk (HDD), RAM, flash memory, etc. in the optical reproducing apparatus. It is onto this memory that the text subtitle data supplied from the CP server (or read out from the BD-ROM) may be downloaded (or uploaded).
In the case that a text subtitle data stream is stored in the memory, navigation information or linking information required to associate the text subtitle stream on the memory with a main A/V stream may have different representation based on utilization of the uniform resource locator (URL) representation scheme, which will be described below.
The URL-style representation of the linking information may be determined by corresponding the name of a directory in which the text subtitle stream is stored to a Web address of the CP server that supplies the text subtitle stream. For example, if the Web address is ‘http://A-studio.com/filename.ext’ or ‘ftp://A-studio.com/filename.ext’, then the URL-style representation becomes ‘URL=lid://bd-disc-name/directories/filename.ext’, where lid represents local identifier. When the optical disc reproducing apparatus starts to reproduce, the file on the CP server, ‘http://A-studio.com/filename.ext’ or ‘ftp://A-studio.com/filename.ext’ may be downloaded automatically in the directory of ‘lid://bd-disc-name/directories’ on the memory, and the URL-style representation of the linking information becomes ‘URL=lid://bd-disc-name/directories/filename.ext’.
As another URL-style representation, the URL-style representation of the linking information may be determined by corresponding the name of directory in which the text subtitle stream is stored to disc name and/or title name and/or chapter number. For example, the URL-style representation becomes ‘URL=lid://bd-disc-name/directories or title-name or chapter-number/filename.ext’. When the optical disc reproducing apparatus starts to reproduce an optical disc, the text subtitle stream file recorded thereon may be uploaded automatically in the directory of ‘lid://bd-disc-name/directories or title-name or chapter-number’ on the local persistent memory. The URL representation becomes ‘URL=lid://bd-disc-name/directories or title-name or chapter-number/filename.ext’.
As another URL-style representation, the URL-style representation of the linking information may be determined based on the directory name and/or file name designated by an author. For example, in order to insert a reference to the directory in which the text subtitle stream is recorded on the optical disc and/or a URL address of web pages containing the text subtitle stream on the CP server, the ‘directory and/or filename’ field may be inserted into a text subtitle clip information or a separate text subtitle directory and file information. Based on the ‘directory and/or filename’ fields, the text subtitle streams are uploaded and/or downloaded on the memory. In the case, The URL-style representation becomes ‘URL=P://directory—1/sub_directory—2/ . . . /filename.ext’.
As another URL-style representation, the HTTP-based or FTP-based directory name may be directly used for the URL-style representation of the linking information. For example, the URL-style representation may become ‘URL=http or ftp://A-studio.com/directories/filename.ext’. In this case, the memory may interpret the directory and filenames from the representations of ‘http://A-studio.com/directories/filename.ext’, or ‘ftp://A-studio.com/directories/filename.ext’, or ‘lid://A-studio.com/directories/filename.ext’, or the designated directory and file name that is automatically interpreted in reproduction.
The navigation structures for effectively linking the text subtitle streams that are supplied from the optical disc or the CP server to a main A/V stream recorded on the optical disc are described hereinafter in great detail.
Each of the subplayitems belonging to the playlist (SubPlayItem #1, #2) is linked to an associated clip information file. As shown in
In other words, each of the text subtitle streams is associated uniquely with one of the plurality of the subplayitems belonging to a playlist. Choice of a text subtitle stream is made in the playlist layer. The text subtitle stream of a particular language is chosen by selecting a subplayitem belonging to the playlist that is associated with the desired language during reproduction of the main A/V stream pointed by the playitem in the playlist. Accordingly, during reproduction of the main A/V stream, the selected text subtitle data is reproduced.
The clip filename associated with the subplayitem may also be represented by the URL representation scheme. In an alternative embodiment, the clip information of the text subtitle stream may be included in the clip information corresponding to the main A/V stream.
The subplayitem also includes a ‘length’ field indicating the length of the subplayitem, a ‘Clip_Codec_identifier’ field indicating the coding of the data, a ‘ref_to_STC_id’ field indicating a system time id for the clip steam file associated with the subplayitem, and ‘SubPlayItem_IN_time’ and ‘SubPlayItem_OUT_time’ fields indicating the presentation in time and presentation out time that define the playback interval of the clip stream file associated with the subplayitem. In this same manner, the playitem defines the presentation interval of the main A/V stream. Referring back to
In other words, a movie object or Java object is linked to a plurality of playlists, and one subplayitem belonging to each playlist is, in turn, associated uniquely with one of the plurality of text subtitle streams. The text subtitle stream of a particular language is chosen by selecting one playlist in the object layer.
To be specific, only one subplayitem associated with a text subtitle stream may be included in each playlist. For a browsable slide show application, another subplayitem may be included for linking an audio stream. The clip filename associated with the subplayitem may be represented by the URL representation scheme. In an alternative embodiment, the clip information of the text subtitle stream may be included in the clip information corresponding to the main A/V stream.
The portion of the playlist syntax, AppInfoPlayList, shown in
In association with this embodiment, in the object layer, a subtitle language register may exist that indicates the subtitle languages available. Movie object command procedures or Java programs perform changes in the text subtitle stream by changing playlists with reference to the register. An example of such a register is described below with respect to
In other words, the plurality of movie objects or Java objects are linked respectively to each of the plurality of playlists, and each subplayitem is associated uniquely with one of the plurality of text subtitle streams. The text subtitle stream of a particular language is chosen by changing objects in the object layer.
To be specific, only one subplayitem associated with a text subtitle stream may be included in each playlist. For a browsable slide show application, another subplayitem may be included for linking an audio stream. The clip filename associated with the subplayitem may be represented by the URL representation scheme. In an alternative embodiment, the clip information of the text subtitle stream may also be included in the clip information corresponding to the main A/V stream.
The subplayitem syntax in this embodiment is the same as described above with respect to
In other words, the playitem belonging to the playlist is linked to the main A/V stream and the plurality of text subtitle streams. Choice of a text subtitle stream is made in the clip or stream layer. The text subtitle stream of a particular language is chosen by selecting a text subtitle stream file based on the playlist while reproduction of the A/V stream.
The clip filename associated with the playitem may be represented by the URL representation scheme. Also, the clip information of the text subtitle streams may be included in the clip information corresponding to the main A/V stream.
As shown in
If the ‘exist_text_subtitle’ field indicates that text subtitle streams are included, then the playitem further includes a ‘number_of_text_subtitles’ field for representing the number of text subtitles, an ‘is_seamless_text_subtitle_change’ field for indicating if seamless change between text subtitle streams is possible or not, and an ‘Application’ field as discussed above with respect to
In other words, one subplayitem belonging to the playlist is linked to the plurality of text subtitle streams. Choice of a text subtitle stream is made in the clip or stream layer. The text subtitle stream of a particular language is chosen by changing text subtitle stream files based on the playlist while reproduction of the A/V stream.
To be specific, only one subplayitem associated with the different text subtitle streams may be included in each playlist. As such, the playback or reproduction interval (e.g., ‘SubPlayItem_IN_time’ and ‘SubPlayItem_OUT_time’) is the same for each clip of text subtitle stream.
For a browsable slide show application, another subplayitem may be included for linking an audio stream. The clip filename associated with the subplayitem may be represented by the URL representation scheme. The clip information of the text subtitle streams may also be included in the clip information corresponding to the main A/V stream.
The subplayitem syntax also includes the ‘SubPlayItem_IN_time’ and ‘SubPlayItem_OUT_time’ fields indicating the presentation in time and presentation out time that define the playback or reproduction interval of the clip stream files associated with the subplayitem. Accordingly, when the ‘SubPlayItem_type’ field indicates the subplayitem is associated with text subtitles, the presentation interval defines the same playback time for each of the text subtitles referenced by the subplayitem. For each text subtitle provided by the ‘number_of_text_subtitles’ field, the subplayitem provides a clip information filename. The clip information filename provides either a name of a clip information file that indicates a clip of a text subtitle stream or directly indicates the name of the clip of a text subtitle stream.
In other words, a text subtitle management information layer is added to manage the text subtitle streams. The text subtitle management information is referenced based on the subplayitem in the playlist layer. Each playlist includes a single subplayitem associated with the text subtitle management information.
For a browsable slide show application, another subplayitem may be included for linking an audio stream. The clip filename associated with the subplayitem_may be represented by the URL representation scheme. The clip information of the text subtitle streams may also be included in the clip information corresponding to the main A/V stream.
The syntax of text subtitle management information includes, among other things, a ‘number_of_text_subtitles’ field for representing the number of text subtitles, an ‘is_seamless_text_subtitle change’ field for indicating if seamless change between text subtitle streams is possible or not, and an ‘Application’ field as described in previous embodiments. For each text subtitle provided by the ‘number_of_text_subtitles’ field, the subplayitem provides a clip information filename. The clip information filename provides either a name of a clip information file that indicates a clip of a text subtitle stream or directly indicates the name of the clip of a text subtitle stream. The ‘Application’ field is included either in the subplayitem syntax or in the text subtitle management information syntax.
The text subtitle management information is defined in the object layer, and therefore the plurality of the text subtitle streams are managed in the text subtitle management information layer. In this embodiment, the text subtitle management information has the same syntax as described above with respect to
The text subtitle management information is referenced and the plurality of text subtitle streams are managed in the object layer. The clip filename in the movie object or Java object may be represented by the URL representation scheme.
For each text subtitle provided by the ‘number_of_text_subtitles’ field, the subplayitem provides a ‘Clip_Information_file_name’ field, a ‘Target_PlayList’ field, a ‘Target_PlayItem’ field and an ‘Application’ field. The clip information filename provides either a name of a clip information file that indicates a clip of a text subtitle stream or directly indicates the name of the clip of a text subtitle stream. The ‘Application’ field is the same as described in previous embodiments. The ‘Target_PlayList’ and ‘Target_PlayItem’ fields are for storing index information of the playlists and/or playitems that are associated in one-to-one correspondence with the plurality of text subtitle streams.
The optical disc reproducing apparatus may be connected to a CP sever 300 through the internet 200. The CP server 300 supplies bitmap subtitle streams or text subtitle streams that may be in the MPEG2 TS stream format or a predetermined binary stream of XML format.
The navigation data described before with reference to
The text subtitle stream from the CP server 300 may be a multiplexed stream of multiple language text subtitle streams only or a multiplexed stream of text subtitle streams and audio streams. The bitmap or text subtitle streams supplied from the CP server 300 are uploaded to memory 13, which is a HDD, RAM, flash memory, etc.
The decoding process of the bitmap and text subtitle streams will be described below in detail. A text subtitle stream recorded on a BD-ROM in the MPEG2 TS stream format separately from main A/V stream is read out from the BD-ROM and may then be uploaded to the memory 13. The text subtitle stream is then supplied to the text subtitle processor 15 through the source stream switch 12 and the second demux 17. The text subtitle processor 15 may be configured as a component of the Java processor 14 or a separate text processor as shown.
Based on the text subtitle stream processed by the text subtitle processor 15, font presentation graphic data are generated from the font engine 19 and then input to the presentation graphic data selector 24. Presentation graphic data corresponding to, e.g., a bitmap subtitle stream may also supplied to the presentation graphic data selector 24 from the memory 13 through the switch 12, the first demux 16 or second demux 17, the presentation graphic source switch 18 and the presentation graphic decoder 21. As will be appreciated, the presentation graphic decoder 21 decodes the presentation graphic data. The presentation graphic data selector 24 in one embodiment selectively chooses one of the presentation graphic data from the font engine 19 (text subtitle graphic data) or from the presentation graphic decoder 21 (bitmap subtitle graphic data), and supplies this data to the presentation graphic plane 26.
Meanwhile, reproduced background data (if any) is supplied by the switch 12 to a background plane 28, and reproduced A/V data is supplied by the switch 12 to the video decoder 22 via the first demux 16. The video decoder 22 decodes the A/V data. The mixer 29 mixes the decoded A/V data with the background data (if any). The mixer 30 mixes the output of the mixer 29 with the output from the presentation graphic plane 26.
In this manner, either bitmap subtitles or text subtitles may be displayed together with main video pictures. As alluded to before, both the text subtitle stream and the bitmap subtitle stream may be supplied from the CP server 300.
When a text subtitle stream has been recorded on a BD-ROM in a predefined binary format such as XML, the text subtitle stream is uploaded to the memory 13 and then supplied directly to the text subtitle processor 15 bypassing the second demux 17. Based on the output of the text subtitle processor 15, font presentation graphic data are generated from the font engine 19 and then input to the presentation graphic data selector 24. Here, either presentation graphic data from the font engine 19 (text subtitle graphic data) or from the presentation graphic decoder 21 (bitmap subtitle graphic data) is chosen selectively as output. The output of the presentation graphic data selector 24 is supplied to the presentation graphic plane 26 so that either bitmap subtitles or text subtitles may be displayed together with main video pictures. This is accomplished by mixer 30 which mixes the output from mixer 29 and the presentation graphics plane 26. Also, both or either of the text subtitle stream and bitmap subtitle streams may be supplied from the CP server 300.
Interactive graphic data such as menu selector button are supplied to the interactive graphic decoder 20 through the demux 16, and the output of the interactive graphic decoder 20 is input to the interactive graphic data switch 23. Interactive graphic data may also be supplied from the Java processor 14 and/or the font engine 19, and are input to the interactive graphic data switch 23. The interactive graphic data switch 23 determines which input is chosen as an output to the interactive graphic plane 25. The output from the interactive graphics plane 25 is then mixed by mixer 31 with the output from mixer 30.
The interactive graphic data selector 24 may be implemented as a switch or as a mixer, as shown in
The present invention provides a recording medium having a data structure for managing the reproduction of text subtitle data, and provides methods and apparatuses for recording the data structure on the recording medium.
While the invention has been disclosed with respect to a limited number of embodiments, those skilled in the art, having the benefit of this disclosure, will appreciate numerous modifications and variations there from. For example, while described with respect to a Blu-ray ROM optical disk in several instances, the present invention is not limited to this standard of optical disk or to optical disks. It is intended that all such modifications and variations fall within the spirit and scope of the invention.
Claims
1. A recording medium having a data structure for managing reproduction of text subtitle data, comprising:
- a navigation area storing at least one subplayitem, the subplayitem identifying more than one clip information file name, each clip information file named by the subplayitem indicates an associated clip of text subtitle data to reproduce from the recording medium, the text subtitle data in each clip being associated with at least a portion of main presentation data recorded on the recording medium, the subplayitem indicating a single presentation interval for the associated clips.
2. The recording medium of claim 1, wherein the navigation area stores at least one playitem, the playitem indicating at least a portion of the main presentation data to reproduce.
3. The recording medium of claim 2, wherein the playitem identifies a clip information file name that indicates a clip of main presentation data to reproduce.
4. The recording medium of claim 3, wherein the clip information files identified by the subplayitem and the playitem are different.
5. The recording medium of claim 3, wherein the clip of main presentation data is a separate file from the associated clips of text subtitle data.
6. The recording medium of claim 2, wherein the navigation area stores at least one playlist, the playlist including the playitem and the subplayitem.
7. The recording medium of claim 6, wherein the playlist includes information that the subplayitem is associated with a text subtitle presentation path.
8. The recording medium of claim 1, wherein each clip information file named by the subplayitem indicates a different associated clip of text subtitle data.
9. The recording medium of claim 8, wherein more than one of the associated clips of text subtitle data are each associated with a different foreign language.
10. The recording medium of claim 9, wherein two of the languages are Korean and English.
11. The recording medium of claim 1, further comprising:
- a data area storing the associated clips of text subtitle data.
12. The recording medium of claim 11, wherein at least one of the associated clips of text subtitle stores the text subtitle data as transport packets.
13. A recording medium having a data structure for managing reproduction of text subtitle data, comprising:
- a navigation area storing at least one playlist including navigation information for reproducing main presentation data and text subtitle data associated with the main presentation data, the navigation information indicating that the text subtitle data forms at least part of a text subtitle subpath, the playlist including at least one subplayitem that provides navigation information for reproducing more than one clip of text subtitle data from the recording medium, the subplayitem indicating a single presentation interval for the clips of text subtitle data.
14. A recording medium having a data structure for managing reproduction of text subtitle data, comprising:
- a data area storing separate clips of text subtitle data and at least one separate clip of main presentation data, the text subtitle data being associated with the main presentation data; and
- a navigation area storing a subplayitem providing navigation information for reproducing the separate clips of text subtitle data for a same presentation interval, and the navigation area storing a playitem providing navigation information for reproducing the clip of main presentation data.
15. The recording medium of claim 14, wherein
- the playitem provides a presentation interval for reproducing the clip of main presentation data; and
- the presentation interval provided by the subplayitem is associated with the presentation interval provided by the playitem.
16. The recording medium of claim 14, wherein each clip of text subtitle data is associated with a different language.
17. The recording medium of claim 16, wherein two of the languages are Korean and English.
18. A method of recording a data structure for managing reproduction of a text subtitle on a recording medium, the method comprising:
- recording at least one subplayitem on the recording medium, the subplayitem identifying more than one clip information file name, each clip information file named by the subplayitem indicates an associated clip of text subtitle data to reproduce from the recording medium, the text subtitle data in each clip being associated with at least a portion of main presentation data recorded on the recording medium, the subplayitem indicating a single presentation interval for the associated clips.
19. A method of reproducing a data structure for managing reproduction of a text subtitle from a recording medium, comprising:
- reproducing at least one subplayitem from the recording medium, the subplayitem identifying more than one clip information file name, each clip information file named by the subplayitem indicates an associated clip of text subtitle data to reproduce from the recording medium, the text subtitle data in each clip being associated with at least a portion of main presentation data recorded on the recording medium, the subplayitem indicating a single presentation interval for the associated clips.
20. An apparatus for reproducing a data structure for managing reproduction of text subtitle data from a recording medium, comprising:
- a pick-up to reproduce at least one subplayitem from the recording medium, the subplayitem identifying more than one clip information file name, each clip information file named by the subplayitem indicates an associated clip of text subtitle data to reproduce from the recording medium, the text subtitle data in each clip being associated with at least a portion of main presentation data recorded on the recording medium, the subplayitem indicating a single presentation interval for the associated clips.