Patents by Inventor Runyu Shi

Runyu Shi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9905232
    Abstract: The present technology relates to an encoding device and method, a decoding device and method, capable of improving audio signal transmission efficiency. An identification information generation unit determines whether or not an audio signal is to be encoded on the basis of the audio signal. The identification information generation unit generates identification information indicating the determination result. An encoding unit encodes only the audio signals which are determined to be encoded. A packing unit generates a bit stream containing the identification information and encoded audio signals. As a result of storing only encoded audio signals and the identification information indicating whether or not the respective audio signals are to be encoded in the bit stream, the transmission efficiency of the audio signals can be improved. The present technology can be applied to an encoder and a decoder.
    Type: Grant
    Filed: May 21, 2014
    Date of Patent: February 27, 2018
    Assignee: SONY CORPORATION
    Inventors: Mitsuyuki Hatanaka, Toru Chinen, Yuki Yamamoto, Runyu Shi
  • Publication number: 20180033440
    Abstract: There is provided a decoding device including at least one circuit configured to acquire one or more encoded audio signals including a plurality of channels and/or a plurality of objects and priority information for each of the plurality of channels and/or the plurality of objects, and to decode the one or more encoded audio signals according to the priority information.
    Type: Application
    Filed: March 16, 2015
    Publication date: February 1, 2018
    Applicant: Sony Corporation
    Inventors: Toru Chinen, Masayuki Nishiguchi, Runyu Shi, Mitsuyuki Hatanaka, Yuki Yamamoto
  • Patent number: 9875746
    Abstract: The present invention pertains to an encoding device and method, a decoding device and method, and to a program, with which sound of an appropriate volume level can be obtained with a smaller quantity of codes. A first gain calculation circuit calculates a first gain for volume level correction of an input time series signal, and a second gain calculation circuit calculates a second gain for volume level correction of a downmixed signal obtained by downmixing of the input time series signal. A gain encoding circuit computes the gain differential between the first gain and the second gain, the gain differential between time frames, and the gain differential within time frames, and encodes the first gain and the second gain. The present invention can be applied in encoding devices and decoding devices.
    Type: Grant
    Filed: September 5, 2014
    Date of Patent: January 23, 2018
    Assignee: Sony Corporation
    Inventors: Hiroyuki Honma, Toru Chinen, Runyu Shi, Mitsuyuki Hatanaka
  • Patent number: 9866985
    Abstract: The present technology relates to an audio signal output device and a method, an encoding device and a method, a decoding device and a method, and a program for realizing audio reproduction with a more realistic feeling. In a case where an audio signal generated to be output as a sound from an ideal speaker that is a virtual speaker placed in an ideal position is input, the distance between the ideal speaker and a real reproduction speaker is determined. Gain adjustment is then performed on the audio signal with the gain corresponding to the determined distance, the audio signal subjected to the gain adjustment is reproduced by the reproduction speaker. Accordingly, even in a case where there is a difference in position between the ideal speaker and the reproduction speaker, audio reproduction with a more realistic feeling can be realized. The present technology can be applied to reproduction devices.
    Type: Grant
    Filed: May 21, 2014
    Date of Patent: January 9, 2018
    Assignee: SONY CORPORATION
    Inventors: Runyu Shi, Toru Chinen, Yuki Yamamoto, Mitsuyuki Hatanaka
  • Patent number: 9805729
    Abstract: The present technique relates to an encoding device and a method, a decoding device and a method, and a program capable of obtaining higher quality audio. An encoding unit encodes position information and a gain of an object in a current frame in multiple encoding modes. A compressing unit generates, for each combination of encoding modes of each pieces of position information and gains, encoded meta data including encoding mode information indicating the encoding modes and encoded data which are the encoded position information and gains, and compresses the encoding mode information included in the encoding meta data. A determining unit selects encoded meta data of which amount of data is the least from among the encoded meta data generated for each combination, thus determining the encoding mode of each pieces of position information and gains. The present technique can be applied to an encoder and a decoder.
    Type: Grant
    Filed: May 21, 2014
    Date of Patent: October 31, 2017
    Assignee: SONY CORPORATION
    Inventors: Runyu Shi, Yuki Yamamoto, Toru Chinen, Mitsuyuki Hatanaka
  • Patent number: 9781539
    Abstract: The present technology relates to an encoding device and method, a decoding device and method, and a program which can obtain high quality audio with a less code amount. A signal encoding unit encodes audio signals and outputs a resultant signal code string. A coefficient encoding unit encodes mixing coefficients for use in a mixing process of the audio signals and outputs a resultant coefficient code string. A multiplexing unit multiplexes the signal code string and the coefficient code string and outputs a resultant output code string. The coefficient encoding unit rearranges the mixing coefficients at the time of encoding the mixing coefficients on the basis of distances between input-side sound source positions and speaker positions on a reproduction side and calculates differential values between the mixing coefficients on the basis of arrangement order of the mixing coefficients, thereby encoding the mixing coefficients.
    Type: Grant
    Filed: September 29, 2014
    Date of Patent: October 3, 2017
    Assignee: SONY CORPORATION
    Inventors: Runyu Shi, Toru Chinen, Hiroyuki Honma, Mitsuyuki Hatanaka
  • Publication number: 20170245086
    Abstract: The present technology relates to a sound processing apparatus and method, and a program for enabling more stable localization of a sound image. A virtual speaker is assumed to exist on the lower side among the sides of a tetragon having its corners formed with four speakers surrounding a target sound image position on a spherical plane. Three-dimensional VBAP is performed with respect to the virtual speaker and the two speakers located at the upper right and the upper left, to calculate gains of the two speakers at the upper right and the upper left and the virtual speaker, the gains being to be used for fixing a sound image at the target sound image position. Further, two-dimensional VBAP is performed with respect to the lower right and lower left speakers, to calculate gains of the lower right and lower left speakers, the gains being to be used for fixing a sound image at the position of the virtual speaker.
    Type: Application
    Filed: May 10, 2017
    Publication date: August 24, 2017
    Applicant: Sony Corporation
    Inventors: Yuki Yamamoto, Toru Chinen, Runyu Shi, Mitsuyuki Hatanaka
  • Publication number: 20170185257
    Abstract: An interface display method, apparatus, and storage medium are provided. The interface display method includes: receiving a first sliding signal acting on a user interface; translating and displaying an interface content in the user interface according to the first sliding signal; and when the interface content is translated to a scrolling area at an edge of the user interface, displaying the interface content in the scrolling area in a scrolling manner, the scrolling manner being a display manner in which the interface content is projected on a plane of the scrolling area when the interface content scrolls and retracts along a scrolling path in a three dimensional space.
    Type: Application
    Filed: November 29, 2016
    Publication date: June 29, 2017
    Inventors: Runyu SHI, Weishan LI, Ni WAN
  • Patent number: 9681249
    Abstract: The present technology relates to a sound processing apparatus and method, and a program for enabling more stable localization of a sound image. A virtual speaker is assumed to exist on the lower side among the sides of a tetragon having its corners formed with four speakers surrounding a target sound image position on a spherical plane. Three-dimensional VBAP is performed with respect to the virtual speaker and the two speakers located at the upper right and the upper left, to calculate gains of the two speakers at the upper right and the upper left and the virtual speaker, the gains being to be used for fixing a sound image at the target sound image position. Further, two-dimensional VBAP is performed with respect to the lower right and lower left speakers, to calculate gains of the lower right and lower left speakers, the gains being to be used for fixing a sound image at the position of the virtual speaker.
    Type: Grant
    Filed: April 11, 2014
    Date of Patent: June 13, 2017
    Assignee: Sony Corporation
    Inventors: Yuki Yamamoto, Toru Chinen, Runyu Shi, Mitsuyuki Hatanaka
  • Publication number: 20170140763
    Abstract: There is provided a decoding device comprising at least one buffer and at least one processor. The at least one processor is configured to select, based at least in part on a size of the at least one buffer, at least one audio element from among multiple audio elements in an input bit stream; and generate an audio signal by decoding the at least one audio element.
    Type: Application
    Filed: June 16, 2015
    Publication date: May 18, 2017
    Applicant: Sony Corporation
    Inventors: Yuki Yamamoto, Toru Chinen, Runyu Shi, Mitsuhiro Hirabayashi
  • Publication number: 20170127207
    Abstract: A sound recording method and device are provided in the field of multimedia processing. The method is applied in a mobile terminal including three microphones, including: acquiring three channels of sound signals collected by the three microphones; calculating a central channel signal, a left channel signal, a right channel signal, a rear left channel signal and a rear right channel signal in a multi-channel surround audio system according to the three channels of sound signals; calculating a bass channel signal in the multi-channel surround audio system according to the three channels of sound signals; and combining the above signals to obtain a sound signal of the multi-channel surround audio system.
    Type: Application
    Filed: March 2, 2016
    Publication date: May 4, 2017
    Applicant: Xiaomi Inc.
    Inventors: Runyu SHI, Dawei Xiong, Weishan Li
  • Publication number: 20170127118
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method which are capable of improving an efficiency of acquiring a predetermined type of audio data among a plurality of types of audio data. Audio data of a predetermined track is acquired in one audio file in which audio data of 3D audio is divided into a plurality of tracks depending on the type of 3D audio and the tracks are arranged, the audio data of each track being successively arranged in the file for a predetermined length of time. The present disclosure is applicable to, for example, an information processing system including a file generation device that generates a file, a Web server that records a file generated by the file generation device, and a video playback terminal that plays back a file.
    Type: Application
    Filed: May 22, 2015
    Publication date: May 4, 2017
    Inventors: MITSUHIRO HIRABAYASHI, TORU CHINEN, YUKI YAMAMOTO, RUNYU SHI
  • Publication number: 20170092280
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method which are capable of improving an efficiency of acquiring a predetermined type of audio data among a plurality of types of audio data. Audio data of a predetermined track is acquired in a file in which a plurality of types of audio data are divided into a plurality of tracks depending on the types and the tracks are arranged. The present disclosure is applicable to, for example, an information processing system including a file generation device that generates a file, a Web server that records a file generated by the file generation device, and a video playback terminal that plays back a file.
    Type: Application
    Filed: May 22, 2015
    Publication date: March 30, 2017
    Inventors: MITSUHIRO HIRABAYASHI, TORU CHINEN, YUKI YAMAMOTO, RUNYU SHI
  • Publication number: 20170047076
    Abstract: The present disclosure relates to a method and a device for achieving object audio recording and an electronic apparatus. The method may include: performing a sound collection operation via a plurality of microphones simultaneously so as to obtain a mixed sound signal; identifying the number of sound sources and position information of each sound source and separating out an object sound signal corresponding to each sound source from the mixed sound signal according to the mixed sound signal and set position information of each microphone; and combining the position information and the object sound signal of individual sound sources to obtain audio data in an object audio format.
    Type: Application
    Filed: July 18, 2016
    Publication date: February 16, 2017
    Applicant: Xiaomi Inc.
    Inventors: Runyu SHI, Chiafu YEN, Hui DU
  • Publication number: 20160286332
    Abstract: The present technology relates to an encoding device and method, a decoding device and method, and a program which can obtain high quality audio with a less code amount. A signal encoding unit encodes audio signals and outputs a resultant signal code string. A coefficient encoding unit encodes mixing coefficients for use in a mixing process of the audio signals and outputs a resultant coefficient code string. A multiplexing unit multiplexes the signal code string and the coefficient code string and outputs a resultant output code string. The coefficient encoding unit rearranges the mixing coefficients at the time of encoding the mixing coefficients on the basis of distances between input-side sound source positions and speaker positions on a reproduction side and calculates differential values between the mixing coefficients on the basis of arrangement order of the-mixing coefficients, thereby encoding the mixing coefficients.
    Type: Application
    Filed: September 29, 2014
    Publication date: September 29, 2016
    Inventors: RUNYU SHI, TORU CHINEN, HIROYUKI HONMA, MITSUYUKI HATANAKA
  • Publication number: 20160225376
    Abstract: The present invention pertains to an encoding device and method, a decoding device and method, and to a program, with which sound of an appropriate volume level can be obtained with a smaller quantity of codes. A first gain calculation circuit calculates a first gain for volume level correction of an input time series signal, and a second gain calculation circuit calculates a second gain for volume level correction of a downmixed signal obtained by downmixing of the input time series signal. A gain encoding circuit computes the gain differential between the first gain and the second gain, the gain differential between time frames, and the gain differential within time frames, and encodes the first gain and the second gain. The present invention can be applied in encoding devices and decoding devices.
    Type: Application
    Filed: September 5, 2014
    Publication date: August 4, 2016
    Applicant: Sony Corporation
    Inventors: Hiroyuki Honma, Toru Chinen, Runyu Shi, Mitsuyuki Hatanaka
  • Publication number: 20160165374
    Abstract: The present technology relates to an information processing device and method for allowing a sound image to be localized with higher precision, and a program. When a target sound image is outside a mesh, the target sound image is moved in a vertical direction while a position in a horizontal direction of the target sound image remains fixed, so that the target sound image is present on a boundary of the mesh. Specifically, a mesh detection unit detects a mesh including a position in the horizontal direction of the target sound image. A candidate position calculation unit calculates a position that is a movement target of the target sound image, based on loudspeaker positions that are at opposite ends of an arc of the detected mesh that is a destination, and the position in the horizontal direction of the target sound image. As a result, the target sound image can be moved onto a boundary of the mesh. The present technology is applicable to a sound processing device.
    Type: Application
    Filed: July 11, 2014
    Publication date: June 9, 2016
    Applicant: Sony Corporation
    Inventors: Runyu Shi, Toru Chinen, Yuki Yamamoto, Mitsuyuki Hatanaka
  • Publication number: 20160156944
    Abstract: The present disclosure relates to an information processing device and information processing method capable of recognizing an acquisition position of voice data on an image. A web server transmits image frame size information indicating image frame size of image data and audio position information indicating acquisition position of voice data. The present disclosure is applicable to an information processing system or other like system including file generation device, web server, and video playback terminal to perform tiled streaming using a manner compliant with moving picture experts group phase-dynamic adaptive streaming over HTTP (MPEG-DASH).
    Type: Application
    Filed: July 1, 2014
    Publication date: June 2, 2016
    Applicant: SONY CORPORATION
    Inventors: Shinobu HATTORI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI, Toru CHINEN, Runyu SHI, Minoru TSUJI, Yuki YAMAMOTO
  • Publication number: 20160133261
    Abstract: The present technique relates to an encoding device and a method, a decoding device and a method, and a program capable of obtaining higher quality audio. An encoding unit encodes position information and a gain of an object in a current frame in multiple encoding modes. A compressing unit generates, for each combination of encoding modes of each pieces of position information and gains, encoded meta data including encoding mode information indicating the encoding modes and encoded data which are the encoded position information and gains, and compresses the encoding mode information included in the encoding meta data. A determining unit selects encoded meta data of which amount of data is the least from among the encoded meta data generated for each combination, thus determining the encoding mode of each pieces of position information and gains. The present technique can be applied to an encoder and a decoder.
    Type: Application
    Filed: May 21, 2014
    Publication date: May 12, 2016
    Inventors: Runyu SHI, Yuki YAMAMOTO, Toru CHINEN, Mitsuyuki HATANAKA
  • Publication number: 20160133260
    Abstract: The present technology relates to an encoding device and method, a decoding device and method, and a program therefor capable of improving audio signal transmission efficiency. An identification information generation unit determines whether or not an audio signal is to be encoded on the basis of the audio signal, and generates identification information indicating the determination result. An encoding unit encodes only audio signals determined to be encoded. A packing unit generates a bit stream containing the identification information and encoded audio signals. As a result of storing only encoded audio signals in the bit stream and storing the identification information indicating whether or not the respective audio signals are to be encoded in the bit stream in this manner, the transmission efficiency of audio signals can be improved. The present technology can be applied to an encoder and a decoder.
    Type: Application
    Filed: May 21, 2014
    Publication date: May 12, 2016
    Inventors: Mitsuyuki HATANAKA, Toru CHINEN, Yuki YAMAMOTO, Runyu SHI