Abstract: To provide database generation techniques that can accurately and efficiently generate a database useable in text-based sound signal search. A sound signal database generation apparatus includes: a latent variable generation unit that generates, from a sound signal, a latent variable corresponding to the sound signal using a sound signal encoder; a data generation unit that generates a natural language representation corresponding to the sound signal from the latent variable and a condition concerning an index for a natural language representation using a natural language representation decoder; and a sound signal database generation unit that generates a record including the natural language representation corresponding to the sound signal and the sound signal from the natural language representation corresponding to the sound signal and the sound signal, and generates a sound signal database made up of the record.

Abstract: To provide techniques for generating, from a sound signal, a natural language representation corresponding to the sound signal while controlling a predetermined index for a natural language representation. A data generation apparatus 200 includes: a latent variable generation unit 210 that generates, from a sound signal, a latent variable corresponding to the sound signal using an encoder; and a data generation unit 220 that generates a natural language representation corresponding to the sound signal from the latent variable and a condition concerning an index for the natural language representation using a decoder.

Abstract: To provide sound signal search techniques that can search for sound signals without tagging with text data. A sound signal search apparatus includes: a recording unit that records a sound signal database made up of records each including a latent variable corresponding to a sound signal and the sound signal, the latent variable being generated from the sound signal with a sound signal encoder; a latent variable generation unit that generates, from a natural language representation being input (hereinafter referred to as an input natural language representation), a latent variable corresponding to the input natural language representation using a natural language representation encoder; and a search unit that determines sound signals corresponding to the input natural language representation as a search result from the latent variable corresponding to the input natural language representation using the sound signal database.

Abstract: To provide translation techniques for translating a natural language representation in one language into a natural language representation in another language using sound. With L1 and L2 being different languages from each other, a translation data generation apparatus includes: a latent variable generation unit that generates, from a natural language representation in the language L1, a latent variable corresponding to the natural language representation in the language L1 using a language L1 encoder; an index calculation unit that calculates an index for the natural language representation in the language L1 from the natural language representation in the language L1; and a natural language representation generation unit that generates a natural language representation in the language L2 corresponding to the natural language representation in the language L1 from the latent variable and the index for the natural language representation in the language L1 using a language L2 decoder.