Patents by Inventor Fumiaki OTA

Fumiaki OTA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11854518
    Abstract: An electronic musical instrument includes an operation unit that receives a user performance; and at least one processor. wherein the at least one processor performs the following: in accordance with a user operation specifying a chord on the operation unit, obtaining lyric data of a lyric and obtaining a plurality of pieces of waveform data respectively corresponding to a plurality of pitches indicated by the specified chord; inputting the obtained lyric data to a trained model that has been trained and learned singing voices of a singer so as to cause the trained model to output acoustic feature data in response thereto; synthesizing each of the plurality of pieces of waveform data with the acoustic feature data so as to generate a plurality of pieces of synthesized waveform data; and outputting a polyphonic synthesized singing voice based on the generated plurality of pieces of synthesized waveform data.
    Type: Grant
    Filed: December 7, 2022
    Date of Patent: December 26, 2023
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 11854521
    Abstract: In an electronic musical instrument that can output stored lyrics of a song in accordance with operations by a user, a processor determines whether a pedal is on or off, and if the pedal is off, the lyric is advanced in accordance with a user operation of a keyboard, and if the pedal is on, the lyric is not advanced in accordance with a user operation of a keyboard.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: December 26, 2023
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Atsushi Nakamura
  • Publication number: 20230102310
    Abstract: An electronic musical instrument includes an operation unit that receives a user performance; and at least one processor. wherein the at least one processor performs the following: in accordance with a user operation specifying a chord on the operation unit, obtaining lyric data of a lyric and obtaining a plurality of pieces of waveform data respectively corresponding to a plurality of pitches indicated by the specified chord; inputting the obtained lyric data to a trained model that has been trained and learned singing voices of a singer so as to cause the trained model to output acoustic feature data in response thereto; synthesizing each of the plurality of pieces of waveform data with the acoustic feature data so as to generate a plurality of pieces of synthesized waveform data; and outputting a polyphonic synthesized singing voice based on the generated plurality of pieces of synthesized waveform data.
    Type: Application
    Filed: December 7, 2022
    Publication date: March 30, 2023
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Patent number: 11545121
    Abstract: An electronic musical instrument includes at least one processor that, in accordance with a user operation on an operation unit, obtains lyric data and waveform data corresponding to a first tone color; inputs the obtained lyric data to a trained model so as to cause the trained model to output acoustic feature data in response thereto; generates waveform data corresponding to a singing voice of a singer and corresponding to a second tone color that is different from the first tone color, based on the acoustic feature data outputted from the trained model and the obtained waveform data corresponding to the first tone color; and outputs a singing voice based on the generated waveform data corresponding to the second tone color.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: January 3, 2023
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 11468870
    Abstract: An electronic musical instrument includes: a memory that stores lyric data including lyrics for a plurality of timings, pitch data including pitches for said plurality of timings, and a trained model that has been trained and learned singing voice features of a singer; and at least one processor, wherein at each of said plurality of timings, the at least one processor: if the operation unit is not operated, obtains, from the trained model, a singing voice feature associated with a lyric indicated by the lyric data and a pitch indicated by the pitch data; if the operation unit is operated, obtains, from the trained model, a singing voice feature associated with the lyric indicated by the lyric data and a pitch indicated by the operation of the operation unit; and synthesizes and outputs singing voice data based on the obtained singing voice feature of the singer.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: October 11, 2022
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Publication number: 20220076651
    Abstract: An electronic musical instrument includes: a plurality of keys that include at least first keys corresponding to a first pitch range and second keys corresponding to a second pitch range; and at least one processor, configured to perform the following: causing a syllable position in a phrase that is digitally synthesized for output to be not advanced no matter how the second keys in the second pitch range are operated while a key operation in the first pitch range is being continuously maintained; and causing the syllable position to advance every time a key operation in the second pitch rang is performed while none of the first keys in the first pitch range are being operated.
    Type: Application
    Filed: August 23, 2021
    Publication date: March 10, 2022
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Atsushi NAKAMURA
  • Publication number: 20220076658
    Abstract: An electronic musical instrument includes: a plurality of keys that include at least first keys corresponding to a first pitch range and second keys corresponding to a second pitch range; and at least one processor, configured to perform the following: in accordance with a key operation in the first pitch range, determining a syllable position contained in a phrase; and in accordance with a key operation in the second pitch rang, instructing a sound production of a digitally synthesized sound corresponding to the determined syllable position.
    Type: Application
    Filed: August 23, 2021
    Publication date: March 10, 2022
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Atsushi NAKAMURA
  • Publication number: 20210295819
    Abstract: An electronic musical instrument outputs synthesized lyrics of a song based on lyric data in accordance with operations by a user. One or more processors in electronic musical instrument generate voice synthesis data for a lyric of the song based on the lyric data for the song at a timing at which said lyric is supposed to be outputted regardless of whether or not a user operation of the operating unit is detected at said timing; when the user operation of the operating unit is detected at said timing, cause voice sound synthesized based on the generated voice synthesis data to be outputted; and when the user operation of the operating unit is not detected at said timing, cause the voice sound synthesized based on the generated voice synthesis data not to be outputted.
    Type: Application
    Filed: March 15, 2021
    Publication date: September 23, 2021
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Atsushi NAKAMURA
  • Publication number: 20210193114
    Abstract: In an electronic musical instrument that can output stored lyrics of a song in accordance with keyboard operations by a user, a processor determines whether a melody should be advanced or not while multiple keys of a keyboard are pressed by the user using prescribed criteria, if the processor determines that the melody should be advanced, the processor advances the lyric in response to the user's multiple key operation and if the processor determines that the melody should not be advanced, the processor does not advance the lyric in response to the user's multiple key operation.
    Type: Application
    Filed: December 21, 2020
    Publication date: June 24, 2021
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Atsushi NAKAMURA
  • Publication number: 20210193098
    Abstract: In an electronic musical instrument that can output stored lyrics of a song in accordance with operations by a user, a processor determines whether a pedal is on or off, and if the pedal is off, the lyric is advanced in accordance with a user operation of a keyboard, and if the pedal is on, the lyric is not advanced in accordance with a user operation of a keyboard.
    Type: Application
    Filed: December 21, 2020
    Publication date: June 24, 2021
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Atsushi NAKAMURA
  • Publication number: 20210027753
    Abstract: An electronic musical instrument includes at least one processor that, in accordance with a user operation on an operation unit, obtains lyric data and waveform data corresponding to a first tone color; inputs the obtained lyric data to a trained model so as to cause the trained model to output acoustic feature data in response thereto; generates waveform data corresponding to a singing voice of a singer and corresponding to a second tone color that is different from the first tone color, based on the acoustic feature data outputted from the trained model and the obtained waveform data corresponding to the first tone color; and outputs a singing voice based on the generated waveform data corresponding to the second tone color.
    Type: Application
    Filed: September 29, 2020
    Publication date: January 28, 2021
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20210012758
    Abstract: An electronic musical instrument includes: a memory that stores lyric data including lyrics for a plurality of timings, pitch data including pitches for said plurality of timings, and a trained model that has been trained and learned singing voice features of a singer; and at least one processor, wherein at each of said plurality of timings, the at least one processor: if the operation unit is not operated, obtains, from the trained model, a singing voice feature associated with a lyric indicated by the lyric data and a pitch indicated by the pitch data; if the operation unit is operated, obtains, from the trained model, a singing voice feature associated with the lyric indicated by the lyric data and a pitch indicated by the operation of the operation unit; and synthesizes and outputs singing voice data based on the obtained singing voice feature of the singer.
    Type: Application
    Filed: September 29, 2020
    Publication date: January 14, 2021
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Patent number: 10825434
    Abstract: An electronic musical instrument in one aspect of the disclosure includes a keyboard, a processor and a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least first and second notes together with associated first and second lyric parts that are to be successively played at the first and second timings, respectively, wherein if while a digitally synthesized first signing voice corresponding to the first note is being output, a user specifies, via keyboard, a third pitch that is different from the first and second notes prior to the arrival of the second timing, the at least one processor synthesizes a modified first singing voice having the third pitch in accordance with the data of the first lyric part, and causes the digitally synthesized modified first singing voice to be audibly output at the third timing.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: November 3, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Atsushi Nakamura, Masaru Setoguchi, Makoto Danjyo, Fumiaki Ota
  • Patent number: 10825433
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model so as to cause the trained acoustic model to output the acoustic feature data in response to the inputted prescribed lyric data and the inputted pitch data, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of the acoustic feature data output by the trained acoustic model.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: November 3, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 10810981
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of at least a portion of acoustic feature data output by the trained acoustic model, and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: October 20, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 10789922
    Abstract: An electronic musical instrument in one aspect of the disclosure includes; a plurality of operation elements to be performed by a user for respectively specifying different pitches; a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least a first note with a first pitch and an associated first lyric part that are to be played at a first timing; and at least one processor, wherein if the user does not operate any of the plurality of operation elements in accordance with the first timing, the at least one processor digitally synthesizes a default first singing voice that includes the first lyric part and that has the first pitch in accordance with data of the first note stored in the memory, and causes the digitally synthesized default first singing voice to be audibly output at the first timing.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: September 29, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 10629179
    Abstract: An electronic musical instrument includes: a memory that stores a machine-learning trained acoustic model mimicking voice of a singer and at least one processor. When a vocoder mode is on, prescribed lyric data and pitch data corresponding to a user operation of an operation element of the musical instrument are inputted to the trained acoustic model, and inferred singing voice data that infers a singing voice of the singer is synthesized on the basis of acoustic feature data output by the trained acoustic model and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element. When the vocoder mode is off, the inferred singing voice data is synthesized based on the acoustic feature data without using the sound waveform data.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: April 21, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Publication number: 20190392807
    Abstract: An electronic musical instrument includes: a memory that stores a machine-learning trained acoustic model mimicking voice of a singer and at least one processor. When a vocoder mode is on, prescribed lyric data and pitch data corresponding to a user operation of an operation element of the musical instrument are inputted to the trained acoustic model, and inferred singing voice data that infers a singing voice of the singer is synthesized on the basis of acoustic feature data output by the trained acoustic model and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element. When the vocoder mode is off, the inferred singing voice data is synthesized based on the acoustic feature data without using the sound waveform data.
    Type: Application
    Filed: June 20, 2019
    Publication date: December 26, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20190392798
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model so as to cause the trained acoustic model to output the acoustic feature data in response to the inputted prescribed lyric data and the inputted pitch data, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of the acoustic feature data output by the trained acoustic model.
    Type: Application
    Filed: June 20, 2019
    Publication date: December 26, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20190392799
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of at least a portion of acoustic feature data output by the trained acoustic model, and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element.
    Type: Application
    Filed: June 20, 2019
    Publication date: December 26, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA