Patents by Inventor Lie Lu

Lie Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20170171687
    Abstract: Example embodiments disclosed herein relate to audio object clustering with single channel quality preservation. A method of clustering audio objects is disclosed. The method includes determining cluster positions based on object positions of the audio objects and a reference speaker layout, the reference speaker layout indicating speakers located at different speaker positions. The method also includes determining object-to-cluster gains based on the determined cluster positions, the object positions and the reference speaker layout, an object-to-cluster gain defining a proportion of the respective audio object that is assigned to a cluster associated with one of the determined cluster positions. The method further includes clustering the audio objects based on the object-to-cluster gains and the cluster positions for generating cluster signals. Corresponding system, computer program product and device for clustering audio objects are also disclosed.
    Type: Application
    Filed: December 12, 2016
    Publication date: June 15, 2017
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Dirk Jeroen Breebaart, Lianwu Chen, Lie Lu
  • Publication number: 20170155369
    Abstract: Volume leveler controller and controlling method are disclosed. In one embodiment, A volume leveler controller includes an audio content classifier for identifying the content type of an audio signal in real time; and an adjusting unit for adjusting a volume leveler in a continuous manner based on the content type as identified. The adjusting unit may configured to positively correlate the dynamic gain of the volume leveler with informative content types of the audio signal, and negatively correlate the dynamic gain of the volume leveler with interfering content types of the audio signal.
    Type: Application
    Filed: February 14, 2017
    Publication date: June 1, 2017
    Inventors: Jun WANG, Lie LU, Alan J. SEEFELDT
  • Patent number: 9654895
    Abstract: Diffuse or spatially large audio objects may be identified for special processing. A decorrelation process may be performed on audio signals corresponding to the large audio objects to produce decorrelated large audio object audio signals. These decorrelated large audio object audio signals may be associated with object locations, which may be stationary or time-varying locations. For example, the decorrelated large audio object audio signals may be rendered to virtual or actual speaker locations. The output of such a rendering process may be input to a scene simplification process. The decorrelation, associating and/or scene simplification processes may be performed prior to a process of encoding the audio data.
    Type: Grant
    Filed: July 24, 2014
    Date of Patent: May 16, 2017
    Assignees: Dolby Laboratories Licensing Corporation, Dolby International AB
    Inventors: Dirk Jeroen Breebaart, Lie Lu, Nicolas R. Tsingos, Antonio Mateos Sole
  • Publication number: 20170133039
    Abstract: Example embodiments disclosed herein relate to perception based multimedia processing. There is provided a method for processing multimedia data, the method includes automatically determining user perception on a segment of the multimedia data based on a plurality of clusters, the plurality of clusters obtained in association with predefined user perceptions and processing the segment of the multimedia data at least in part based on determined user perception on the segment. Corresponding system and computer program products are disclosed as well.
    Type: Application
    Filed: June 24, 2015
    Publication date: May 11, 2017
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Claus BAUER, Lie LU, Mingqing HU, Jun WANG, Poppy CRUM, Rhonda WILSON, Regunathan RADHAKRISHNAN
  • Patent number: 9621124
    Abstract: Equalizer controller and controlling method are disclosed. In one embodiment, an equalizer controller includes an audio classifier for identifying the audio type of an audio signal in real time; and an adjusting unit for adjusting an equalizer in a continuous manner based on the confidence value of the audio type as identified.
    Type: Grant
    Filed: March 17, 2014
    Date of Patent: April 11, 2017
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Lie Lu, Jun Wang, Alan Seefeldt, Mingqing Hu
  • Publication number: 20170026017
    Abstract: Volume leveler controller and controlling method are disclosed. In one embodiment, A volume leveler controller includes an audio content classifier for identifying the content type of an audio signal in real time; and an adjusting unit for adjusting a volume leveler in a continuous manner based on the content type as identified. The adjusting unit may configured to positively correlate the dynamic gain of the volume leveler with informative content types of the audio signal, and negatively correlate the dynamic gain of the volume leveler with interfering content types of the audio signal.
    Type: Application
    Filed: October 4, 2016
    Publication date: January 26, 2017
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Jun WANG, Lie LU, Alan SEEFELDT
  • Patent number: 9548713
    Abstract: Volume leveler controller and controlling method are disclosed. In one embodiment, A volume leveler controller includes an audio content classifier for identifying the content type of an audio signal in real time; and an adjusting unit for adjusting a volume leveler in a continuous manner based on the content type as identified. The adjusting unit may configured to positively correlate the dynamic gain of the volume leveler with informative content types of the audio signal, and negatively correlate the dynamic gain of the volume leveler with interfering content types of the audio signal.
    Type: Grant
    Filed: March 17, 2014
    Date of Patent: January 17, 2017
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Jun Wang, Lie Lu, Alan Seefeldt
  • Patent number: 9547715
    Abstract: Methods and apparatus for detecting a repetitive pattern in a sequence of audio frames are described. Similarity values of a first similarity matrix with first resolution for the sequence are calculated. An adaptive threshold is estimated from the similarity values for classifying the similarity values into repetition or non-repetition. For each of one or more offsets of a second similarity matrix with second resolution higher that the first resolution, similarity values of the second similarity matrix corresponding to the offset are calculated. Then the calculated similarity values are binarized with the adaptive threshold to obtain binarized data. Finally, the repetitive pattern is detected from the binarized data. The requirement on memory may be reduced because less data are stored in detecting the repetitive pattern.
    Type: Grant
    Filed: August 1, 2012
    Date of Patent: January 17, 2017
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Lie Lu, Bin cheng
  • Publication number: 20160358618
    Abstract: Embodiments of the present invention relate to audio object clustering by utilizing temporal variation of audio objects. There is provided a method of estimating temporal variation of an audio object for use in audio object clustering. The method comprises obtaining at least one segment of an audio track associated with the audio object, the at least one segment containing the audio object; estimating variation of the audio object over a time duration of the at least one segment based on at least one property of the audio object and adjusting, at least partially based on the estimated variation of the audio object, a contribution of the audio object to the determination of a centroid in the audio object clustering. Corresponding system and computer program product are disclosed.
    Type: Application
    Filed: February 23, 2015
    Publication date: December 8, 2016
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Lianwu CHEN, Lie LU, Dirk Jeroen BREEBAART
  • Publication number: 20160337776
    Abstract: Audio objects that are present in input audio content in one or more frames are determined. Output clusters that are present in output audio content in the one or more frames are also determined. Here, the audio objects in the input audio content are converted to the output clusters in the output audio content. One or more spatial error metrics are computed based at least in part on positional metadata of the audio objects and positional metadata of the output clusters.
    Type: Application
    Filed: January 5, 2015
    Publication date: November 17, 2016
    Applicants: DOLBY LABORATORIES LICENSING CORPORATION, DOLBY INTERNATIONAL AB
    Inventors: Dirk Jeroen BREEBAART, Lianwu CHEN, Lie LU, Antonio Mateos SOLE, Nicolas R. TSINGOS
  • Patent number: 9495449
    Abstract: Described is a technology by which a playback list comprising similar songs is automatically built based on automatically detected/generated song attributes, such as by extracting numeric features of each song. The attributes may be downloaded from a remote connection, and/or may be locally generated on the playback device. To build a playlist, a seed song's attributes may be compared against attributes of other songs to determine which other songs are similar to the seed song and thus included in the playlist. Another way to build a playlist is based on similarity of songs to a set of user provided-attributes, such as corresponding to moods or usage modes such as “resting” “reading” “jogging” or “driving” moods/modes. The playlist may be dynamically adjusted based on user interaction with the device, such as when a user skips a song, queues a song, or dequeues a song.
    Type: Grant
    Filed: February 3, 2014
    Date of Patent: November 15, 2016
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Lie Lu, Frank Torsten Bernd Seide, Gabriel White
  • Publication number: 20160323460
    Abstract: Described is a technology by which a user hums, sings or otherwise plays a user-provided rendition of a ringtone (or ringback tone) through a mobile telephone to a ringtone search service (e.g., a WAP, interactive voice response or SMS-based search platform). The service matches features of the user's rendition against features of actual ringtones to determine one or more matching candidate ringtones for downloading. Features may include pitch contours (up or down), pitch intervals and durations of notes. Matching candidates may be ranked based on the determined similarity, possibly in conjunction with weighting criterion such as the popularity of the ringtone and/or the importance of the matched part. The candidate set may be augmented with other ringtones independent of the matching, such as the most popular ones downloaded by other users, ringtones from similar artists, and so forth.
    Type: Application
    Filed: June 15, 2016
    Publication date: November 3, 2016
    Inventors: Lie LU, Yutao XIE, Xing XIE, Jiafan OU, Ruihao WENG
  • Patent number: 9460736
    Abstract: Embodiments for measuring content coherence and embodiments for measuring content similarity are described. Content coherence between a first audio section and a second audio section is measured. For each audio segment in the first audio section, a predetermined number of audio segments in the second audio section are determined. Content similarity between the audio segment in the first audio section and the determined audio segments is higher than that between the audio segment and all the other audio segments in the second audio section. An average of the content similarity between the audio segment in the first audio section and the determined audio segments is calculated. The content coherence is calculated as an average, the maximum or the minimum of the averages calculated for the audio segments in the first audio section. The content similarity may be calculated based on Dirichlet distribution.
    Type: Grant
    Filed: November 25, 2015
    Date of Patent: October 4, 2016
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Lie Lu, Mingqing Hu
  • Publication number: 20160267914
    Abstract: Embodiments of the present invention relate to audio object extraction. A method for audio object extraction from audio content of a format based on a plurality of channels is disclosed. The method comprises applying audio object extraction on individual frames of the audio content at least partially based on frequency spectral similarities among the plurality of channels. The method further comprises performing audio object composition across the frames of the audio content, based on the audio object extraction on the individual frames, to generate a track of at least one audio object. Corresponding system and computer program product are also disclosed.
    Type: Application
    Filed: November 25, 2014
    Publication date: September 15, 2016
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Mingqing HU, Lie LU, Jun WANG
  • Publication number: 20160267177
    Abstract: Described is a technology by which a playback list comprising similar songs is automatically built based on automatically detected/generated song attributes, such as by extracting numeric features of each song. The attributes may be downloaded from a remote connection, and/or may be locally generated on the playback device. To build a playlist, a seed song's attributes may be compared against attributes of other songs to determine which other songs are similar to the seed song and thus included in the playlist. Another way to build a playlist is based on similarity of songs to a set of user provided-attributes, such as corresponding to moods or usage modes such as “resting” “reading” “jogging” or “driving” moods/modes. The playlist may be dynamically adjusted based on user interaction with the device, such as when a user skips a song, queues a song, or dequeues a song.
    Type: Application
    Filed: May 25, 2016
    Publication date: September 15, 2016
    Inventors: Lie Lu, Frank Torsten Bernd Seide, Gabriel White
  • Patent number: 9396257
    Abstract: Described is a technology by which a user hums, sings or otherwise plays a user-provided rendition of a ringtone (or ringback tone) through a mobile telephone to a ringtone search service (e.g., a WAP, interactive voice response or SMS-based search platform). The service matches features of the user's rendition against features of actual ringtones to determine one or more matching candidate ringtones for downloading. Features may include pitch contours (up or down), pitch intervals and durations of notes. Matching candidates may be ranked based on the determined similarity, possibly in conjunction with weighting criterion such as the popularity of the ringtone and/or the importance of the matched part. The candidate set may be augmented with other ringtones independent of the matching, such as the most popular ones downloaded by other users, ringtones from similar artists, and so forth.
    Type: Grant
    Filed: December 29, 2011
    Date of Patent: July 19, 2016
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Lie Lu, Yutao Xie, Xing Xie, Jiafan Ou, Ruihao Weng
  • Publication number: 20160192105
    Abstract: Diffuse or spatially large audio objects may be identified for special processing. A decorrelation process may be performed on audio signals corresponding to the large audio objects to produce decorrelated large audio object audio signals. These decorrelated large audio object audio signals may be associated with object locations, which may be stationary or time-varying locations. For example, the decorrelated large audio object audio signals may be rendered to virtual or actual speaker locations. The output of such a rendering process may be input to a scene simplification process. The decorrelation, associating and/or scene simplification processes may be performed prior to a process of encoding the audio data.
    Type: Application
    Filed: July 24, 2014
    Publication date: June 30, 2016
    Applicants: DOLBY INTERNATIONAL AB, Dolby Laboratories Licensing Corporation
    Inventors: Dirk Jeroen BREEBAART, Lie LU, Nicolas R. TSINGOS, Antonio MATEOS SOLE
  • Publication number: 20160180858
    Abstract: Embodiments are directed to a method for processing an input audio signal, comprising: splitting the input audio signal into at least two components, in which the first component is characterized by fast fluctuations in the input signal envelope, and a second component that is relatively stationary over time; processing the second, stationary component by a decorrelation circuit; and constructing an output signal by combining the output of the decorrelator circuit with the input signal and/or the first component signal.
    Type: Application
    Filed: July 23, 2014
    Publication date: June 23, 2016
    Applicants: DOLBY LABORATORIES LICENSING CORPORATION, DOLBY INTERNATIONAL AB
    Inventors: Dirk Jeroen BREEBAART, Lie LU, Antonio MATEOS SOLE, Nicolas R. TSINGOS
  • Publication number: 20160150343
    Abstract: Embodiments of the present invention relate to adaptive audio content generation. Specifically, a method for generating adaptive audio content is provided. The method comprises extracting at least one audio object from channel-based source audio content, and generating the adaptive audio content at least partially based on the at least one audio object. Corresponding system and computer program product are also disclosed.
    Type: Application
    Filed: June 17, 2014
    Publication date: May 26, 2016
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Jun WANG, Lie LU, Mingqing HU, Dirk Jeroen BREEBAART, Nicolas R. TSINGOS
  • Publication number: 20160078879
    Abstract: Apparatus and methods for audio classifying and processing are disclosed. In one embodiment, an audio processing apparatus includes an audio classifier for classifying an audio signal into at least one audio type in real time; an audio improving device for improving experience of audience; and an adjusting unit for adjusting at least one parameter of the audio improving device in a continuous manner based on the confidence value of the at least one audio type.
    Type: Application
    Filed: March 25, 2014
    Publication date: March 17, 2016
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Lie LU, Alan J. SEEFELDT, Jun WANG