Patents by Inventor Masaru Setoguchi

Masaru Setoguchi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11854518
    Abstract: An electronic musical instrument includes an operation unit that receives a user performance; and at least one processor. wherein the at least one processor performs the following: in accordance with a user operation specifying a chord on the operation unit, obtaining lyric data of a lyric and obtaining a plurality of pieces of waveform data respectively corresponding to a plurality of pitches indicated by the specified chord; inputting the obtained lyric data to a trained model that has been trained and learned singing voices of a singer so as to cause the trained model to output acoustic feature data in response thereto; synthesizing each of the plurality of pieces of waveform data with the acoustic feature data so as to generate a plurality of pieces of synthesized waveform data; and outputting a polyphonic synthesized singing voice based on the generated plurality of pieces of synthesized waveform data.
    Type: Grant
    Filed: December 7, 2022
    Date of Patent: December 26, 2023
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Publication number: 20230102310
    Abstract: An electronic musical instrument includes an operation unit that receives a user performance; and at least one processor. wherein the at least one processor performs the following: in accordance with a user operation specifying a chord on the operation unit, obtaining lyric data of a lyric and obtaining a plurality of pieces of waveform data respectively corresponding to a plurality of pitches indicated by the specified chord; inputting the obtained lyric data to a trained model that has been trained and learned singing voices of a singer so as to cause the trained model to output acoustic feature data in response thereto; synthesizing each of the plurality of pieces of waveform data with the acoustic feature data so as to generate a plurality of pieces of synthesized waveform data; and outputting a polyphonic synthesized singing voice based on the generated plurality of pieces of synthesized waveform data.
    Type: Application
    Filed: December 7, 2022
    Publication date: March 30, 2023
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Patent number: 11545121
    Abstract: An electronic musical instrument includes at least one processor that, in accordance with a user operation on an operation unit, obtains lyric data and waveform data corresponding to a first tone color; inputs the obtained lyric data to a trained model so as to cause the trained model to output acoustic feature data in response thereto; generates waveform data corresponding to a singing voice of a singer and corresponding to a second tone color that is different from the first tone color, based on the acoustic feature data outputted from the trained model and the obtained waveform data corresponding to the first tone color; and outputs a singing voice based on the generated waveform data corresponding to the second tone color.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: January 3, 2023
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 11468870
    Abstract: An electronic musical instrument includes: a memory that stores lyric data including lyrics for a plurality of timings, pitch data including pitches for said plurality of timings, and a trained model that has been trained and learned singing voice features of a singer; and at least one processor, wherein at each of said plurality of timings, the at least one processor: if the operation unit is not operated, obtains, from the trained model, a singing voice feature associated with a lyric indicated by the lyric data and a pitch indicated by the pitch data; if the operation unit is operated, obtains, from the trained model, a singing voice feature associated with the lyric indicated by the lyric data and a pitch indicated by the operation of the operation unit; and synthesizes and outputs singing voice data based on the obtained singing voice feature of the singer.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: October 11, 2022
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Publication number: 20210027753
    Abstract: An electronic musical instrument includes at least one processor that, in accordance with a user operation on an operation unit, obtains lyric data and waveform data corresponding to a first tone color; inputs the obtained lyric data to a trained model so as to cause the trained model to output acoustic feature data in response thereto; generates waveform data corresponding to a singing voice of a singer and corresponding to a second tone color that is different from the first tone color, based on the acoustic feature data outputted from the trained model and the obtained waveform data corresponding to the first tone color; and outputs a singing voice based on the generated waveform data corresponding to the second tone color.
    Type: Application
    Filed: September 29, 2020
    Publication date: January 28, 2021
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20210012758
    Abstract: An electronic musical instrument includes: a memory that stores lyric data including lyrics for a plurality of timings, pitch data including pitches for said plurality of timings, and a trained model that has been trained and learned singing voice features of a singer; and at least one processor, wherein at each of said plurality of timings, the at least one processor: if the operation unit is not operated, obtains, from the trained model, a singing voice feature associated with a lyric indicated by the lyric data and a pitch indicated by the pitch data; if the operation unit is operated, obtains, from the trained model, a singing voice feature associated with the lyric indicated by the lyric data and a pitch indicated by the operation of the operation unit; and synthesizes and outputs singing voice data based on the obtained singing voice feature of the singer.
    Type: Application
    Filed: September 29, 2020
    Publication date: January 14, 2021
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Patent number: 10825433
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model so as to cause the trained acoustic model to output the acoustic feature data in response to the inputted prescribed lyric data and the inputted pitch data, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of the acoustic feature data output by the trained acoustic model.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: November 3, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 10825434
    Abstract: An electronic musical instrument in one aspect of the disclosure includes a keyboard, a processor and a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least first and second notes together with associated first and second lyric parts that are to be successively played at the first and second timings, respectively, wherein if while a digitally synthesized first signing voice corresponding to the first note is being output, a user specifies, via keyboard, a third pitch that is different from the first and second notes prior to the arrival of the second timing, the at least one processor synthesizes a modified first singing voice having the third pitch in accordance with the data of the first lyric part, and causes the digitally synthesized modified first singing voice to be audibly output at the third timing.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: November 3, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Atsushi Nakamura, Masaru Setoguchi, Makoto Danjyo, Fumiaki Ota
  • Patent number: 10810981
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of at least a portion of acoustic feature data output by the trained acoustic model, and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: October 20, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 10789922
    Abstract: An electronic musical instrument in one aspect of the disclosure includes; a plurality of operation elements to be performed by a user for respectively specifying different pitches; a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least a first note with a first pitch and an associated first lyric part that are to be played at a first timing; and at least one processor, wherein if the user does not operate any of the plurality of operation elements in accordance with the first timing, the at least one processor digitally synthesizes a default first singing voice that includes the first lyric part and that has the first pitch in accordance with data of the first note stored in the memory, and causes the digitally synthesized default first singing voice to be audibly output at the first timing.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: September 29, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Patent number: 10629179
    Abstract: An electronic musical instrument includes: a memory that stores a machine-learning trained acoustic model mimicking voice of a singer and at least one processor. When a vocoder mode is on, prescribed lyric data and pitch data corresponding to a user operation of an operation element of the musical instrument are inputted to the trained acoustic model, and inferred singing voice data that infers a singing voice of the singer is synthesized on the basis of acoustic feature data output by the trained acoustic model and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element. When the vocoder mode is off, the inferred singing voice data is synthesized based on the acoustic feature data without using the sound waveform data.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: April 21, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Danjyo, Fumiaki Ota, Masaru Setoguchi, Atsushi Nakamura
  • Publication number: 20190392807
    Abstract: An electronic musical instrument includes: a memory that stores a machine-learning trained acoustic model mimicking voice of a singer and at least one processor. When a vocoder mode is on, prescribed lyric data and pitch data corresponding to a user operation of an operation element of the musical instrument are inputted to the trained acoustic model, and inferred singing voice data that infers a singing voice of the singer is synthesized on the basis of acoustic feature data output by the trained acoustic model and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element. When the vocoder mode is off, the inferred singing voice data is synthesized based on the acoustic feature data without using the sound waveform data.
    Type: Application
    Filed: June 20, 2019
    Publication date: December 26, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20190392799
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of at least a portion of acoustic feature data output by the trained acoustic model, and on the basis of instrument sound waveform data that are synthesized in accordance with the pitch data corresponding to the user operation of the operation element.
    Type: Application
    Filed: June 20, 2019
    Publication date: December 26, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20190392798
    Abstract: An electronic musical instrument includes: a memory that stores a trained acoustic model obtained by performing machine learning on training musical score data and training singing voice data of a singer; and at least one processor, wherein the at least one processor: in accordance with a user operation on an operation element in a plurality of operation elements, inputs prescribed lyric data and pitch data corresponding to the user operation of the operation element to the trained acoustic model so as to cause the trained acoustic model to output the acoustic feature data in response to the inputted prescribed lyric data and the inputted pitch data, and digitally synthesizes and outputs inferred singing voice data that infers a singing voice of the singer on the basis of the acoustic feature data output by the trained acoustic model.
    Type: Application
    Filed: June 20, 2019
    Publication date: December 26, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20190318715
    Abstract: An electronic musical instrument in one aspect of the disclosure includes; a plurality of operation elements to be performed by a user for respectively specifying different pitches; a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least a first note with a first pitch and an associated first lyric part that are to be played at a first timing; and at least one processor, wherein if the user does not operate any of the plurality of operation elements in accordance with the first timing, the at least one processor digitally synthesizes a default first singing voice that includes the first lyric part and that has the first pitch in accordance with data of the first note stored in the memory, and causes the digitally synthesized default first singing voice to be audibly output at the first timing.
    Type: Application
    Filed: April 15, 2019
    Publication date: October 17, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Makoto DANJYO, Fumiaki OTA, Masaru SETOGUCHI, Atsushi NAKAMURA
  • Publication number: 20190318712
    Abstract: An electronic musical instrument in one aspect of the disclosure includes a keyboard, a processor and a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least first and second notes together with associated first and second lyric parts that are to be successively played at the first and second timings, respectively, wherein if while a digitally synthesized first signing voice corresponding to the first note is being output, a user specifies, via keyboard, a third pitch that is different from the first and second notes prior to the arrival of the second timing, the at least one processor synthesizes a modified first singing voice having the third pitch in accordance with the data of the first lyric part, and causes the digitally synthesized modified first singing voice to be audibly output at the third timing.
    Type: Application
    Filed: April 15, 2019
    Publication date: October 17, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventors: Atsushi NAKAMURA, Masaru SETOGUCHI, Makoto DANJYO, Fumiaki OTA
  • Publication number: 20190304327
    Abstract: A singing practice device includes a memory having stored thereon a musical piece data of a musical piece that includes an accompaniment and a vocal part to be sung by a user and at least one processor, wherein when a first segment of the vocal part to be sung by the user during a first time interval arrives while the accompaniment is being played back, the at least one processor determines whether an utterance is input by the user through an audio input device during the first time interval and causes the accompaniment to continue being played back until a point in time immediately before the next time interval only when the utterance was input by the user during the first time interval.
    Type: Application
    Filed: March 26, 2019
    Publication date: October 3, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventor: Masaru SETOGUCHI
  • Patent number: 10431193
    Abstract: According to the present invention, there is provided an electronic musical instrument that allows a player to learn a certain range covering a key of correct pitch and to feel as if he or she were playing the music. The instrument includes a controller to perform a pitches determination process of, based upon first timing and first pitch included in music data, determining pitches within a fixed range from the first pitch, which is allowed to be designated in accordance with the first timing, a display process of displaying an identifier to identify the pitches determined, and an automatic playing process of advancing automatic playing of the music data by producing sound corresponding to the first pitch from a sound producing unit when one of the pitches identified by the identifier displayed by the display process is designated.
    Type: Grant
    Filed: September 13, 2018
    Date of Patent: October 1, 2019
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Masaru Setoguchi
  • Patent number: 10403254
    Abstract: According to the present invention, there is provided an electronic musical instrument, comprising: a plurality of keys; a memory that stores each pattern data showing a combination of a plurality of pitches that comprises a consonance; a speaker; and a processor that executes the following: determining processing for determining whether a combination of the operated keys matches any of the pattern data stored in the memory, first outputting processing for outputting a first sound, when the combination of the operated keys matches any of the pattern data, and second outputting processing for outputting a second sound, when the combination of the operated keys does not match any of the pattern data.
    Type: Grant
    Filed: September 13, 2018
    Date of Patent: September 3, 2019
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Masaru Setoguchi
  • Publication number: 20190096373
    Abstract: According to the present invention, there is provided an electronic musical instrument, comprising: a plurality of keys; a memory that stores each pattern data showing a combination of a plurality of pitches that comprises a consonance; a speaker; and a processor that executes the following: determining processing for determining whether a combination of the operated keys matches any of the pattern data stored in the memory, first outputting processing for outputting a first sound, when the combination of the operated keys matches any of the pattern data, and second outputting processing for outputting a second sound, when the combination of the operated keys does not match any of the pattern data.
    Type: Application
    Filed: September 13, 2018
    Publication date: March 28, 2019
    Applicant: CASIO COMPUTER CO., LTD.
    Inventor: Masaru SETOGUCHI