Abstract: Provided are a method and device for synthesizing speech with modified utterance features. The method of synthesizing speech with modified utterance features may include generating an initial embedding vector based on predetermined utterance information, generating a low-dimensional embedding vector by reducing dimensionality of the initial embedding vector by using a predetermined dimensionality reduction technique, adjusting a component value of the low-dimensional embedding vector based on a user input, and generating a modified embedding vector by restoring dimensionality of the low-dimensional embedding vector of which the component value is adjusted.
Abstract: Provided is a method and apparatus for analyzing a viewer of content. A method includes collecting an image through a camera provided adjacent to an object of interest, detecting a face of a person from the image, analyzing the detected face of the person, determining, based on the analyzing, whether the detected person gazes at the object of interest, and generating object-of-interest viewing data associated with a person identified as being gazing at the object of interest.
Abstract: A method of providing a service for a conversation with a virtual character replicating a deceased person is provided. The method of the present disclosure includes predicting a response message of a virtual character replicating a deceased person in response to a message input by a user, generating a speech corresponding to an oral utterance of the response message on the basis of speech data of the deceased person and the response message, and generating a final video of the virtual character uttering the response message on the basis of a driving video guiding the movement of the virtual character and the speech.
Abstract: This application relates to a method of synthesizing a speech of which a speed and a pitch are changed. In one aspect, the method includes a spectrogram may be generated by performing a short-time Fourier transformation on a first speech signal based on a first hop length and a first window length, and speech signals of sections having a second window length at the interval of a second hop length from the spectrogram. A ratio between the first hop length and the second hop length may be set to be equal to the value of a playback rate and a ratio between the first window length and the second window length may be set to be equal to the value of a pitch change rate, thereby generating a second speech signal of which the speed and the pitch are changed.
Type:
Grant
Filed:
July 20, 2021
Date of Patent:
October 3, 2023
Assignee:
Xinapse Co., Ltd.
Inventors:
Jinbeom Kang, Dong Won Joo, Yongwook Nam