Source: https://patents.google.com/patent/US10034113B2/en
Timestamp: 2019-05-20 21:38:52
Document Index: 84115736

Matched Legal Cases: ['§ 119', 'Application No. 61', 'Application No. 2012800046625', 'Application No. 12731992', 'Application No. 2013', 'Application No. 10', 'Application No. 12731992', 'Application No. 12731992']

US10034113B2 - Immersive audio rendering system - Google Patents
US10034113B2
US10034113B2 US14/801,652 US201514801652A US10034113B2 US 10034113 B2 US10034113 B2 US 10034113B2 US 201514801652 A US201514801652 A US 201514801652A US 10034113 B2 US10034113 B2 US 10034113B2
US14/801,652
US20160044431A1 (en
2012-01-03 Priority to US13/342,743 priority patent/US9088858B2/en
2015-07-16 Application filed by DTS LLC filed Critical DTS LLC
2015-07-16 Priority to US14/801,652 priority patent/US10034113B2/en
2016-02-11 Publication of US20160044431A1 publication Critical patent/US20160044431A1/en
2018-07-24 Publication of US10034113B2 publication Critical patent/US10034113B2/en
This application is a continuation of U.S. patent application Ser. No. 13/342,743 filed Jan. 3, 2012 and issued as U.S. Pat. No. 9,088,858, which claims priority under 35 U.S.C. § 119(e) to U.S. Provisional Application No. 61/429,600 filed Jan. 4, 2011, entitled “Immersive Audio Rendering System.” The disclosure of each of these prior applications is hereby incorporated by reference in its entirety.
The depth processing system 310C can process any type of audio object, including MPEG-encoded objects or the audio objects described in U.S. Pat. No. 8,396,575, the disclosure of which is hereby incorporated by reference in its entirety. In some embodiments, the audio objects may include base channel objects and extension objects, as described in U.S. Pat. No. 9,026,450, the disclosure of which is hereby incorporated by reference in its entirety. Thus, in one embodiment the depth processing system 310C may perform depth estimation (using, e.g., a depth estimator 320) from the base channel objects and may also perform filter transform modulation (block 320 c) based on the extension objects and their respective metadata. In other words, audio object metadata may be used in addition to or instead of channel data for determining depth.
The outputs of the smoother 512 are denoted as RMS( )′ in FIG. 5. The RMS(L+R)′ signal is provided to a depth calculator 524. As described above, the magnitude of the L−R signal can reflect depth information in the two input signals. Thus, the magnitude of the RMS and smoothed L−R signal can also reflect depth information. For example, larger magnitudes in the RMS(L−R)′ signal can reflect closer signals than smaller magnitudes of the RMS(L−R)′ signal. Said another way, the values of the L−R or RMS(L−R)′ signal reflect the degree of correlation between the L−R signals. In particular, the L−R or RMS(L−R)′ (or RMS(L−R)) signal can be an inverse indicator of the interaural cross-correlation coefficient (IACC) between the left and right signals. (If the L and R signals are highly correlated, for example, their L−R value will be close to 0, while their IACC value will be close to 1, and vice versa.)
calculating depth steering information using the left and right audio signals, the depth steering information based at least partly on the spatial position of the sound source and corresponding to an amount of decorrelation to be performed on the left and right audio signals;
decorrelating the left and right audio signals by an amount that depends at least partly on the depth steering information to produce decorrelated left and right audio signals;
calculating difference information in the decorrelated left and right audio signals;
applying at least one perspective filter to the difference information to produce first left and right output signals;
applying crosstalk cancellation to the first left and right output signals to reduce backwave crosstalk and obtain second left and right output signals; and
providing the second left and right output signals for playback,
2. The method of claim 1, further comprising performing at least one of: detecting an envelope of the difference information or smoothing the difference information.
3. The method of claim 2, further comprising modulating the application of the at least one perspective filter based at least in part on one or both of the envelope of the difference information and the smoothed difference information.
4. The method of claim 3, further comprising normalizing the difference information based at least in part on signal levels of the decorrelated left and right audio signals.
5. The method of claim 4, wherein the modulating comprises modulating the application of the at least one perspective filter based at least in part on the normalized difference information.
6. The method of claim 4, wherein the normalizing comprises computing a geometric mean of the left and right audio signals and dividing the difference information with the computed geometric mean.
7. The method of claim 1, wherein decorrelating the left and right audio signals comprises dynamically adjusting one or both of a delay and a gain applied to the left and right audio signals.
8. The method of claim 1, wherein calculating the depth steering information comprises decorrelating the left and right audio signals.
9. An audio signal processing system comprising:
receive left and right audio signals, the left and right audio signals each comprising information about a spatial position of a sound source relative to a listener,
calculate depth steering information using the left and right audio signals, the depth steering information based at least partly on the spatial position of the sound source and corresponding to an amount of decorrelation to be performed on the left and right audio signals,
decorrelate the left and right audio signals by an amount that depends at least partly on the depth steering information to produce decorrelated left and right audio signals, and
calculate a difference signal in the decorrelated left and right audio signals; and
a surround processor configured to:
apply at least one perspective filter to the difference signal to produce first left and right output signals, wherein the surround processor comprises one or more processors,
apply crosstalk cancellation to the first left and right output signals to obtain second left and right output signals, and
provide the second left and right output signals for playback;
wherein the signal analyzer and the surround processor are implemented at least partially in electronic hardware.
10. The system of claim 9, wherein the signal analyzer is further configured perform at least one of: detect an envelope of the difference signal or smooth the difference signal.
11. The system of claim 10, wherein the surround processor is further configured to modulate the application of the at least one perspective filter based at least in part on one or both of the envelope of the difference signal and the smoothed difference signal.
12. The system of claim 9, wherein the signal analyzer is further configured to normalize the difference signal based at least in part on signal levels of the left and right audio signals.
13. The system of claim 12, wherein the surround processor is further configured to modulate the application of the at least one perspective filter based at least in part on the normalized difference signal.
14. The system of claim 12, wherein the signal analyzer is further configured to normalize the difference signal by at least computing a geometric mean of the left and right audio signals and dividing the difference signal with the computed geometric mean.
15. The system of claim 9, wherein the signal analyzer is configured to decorrelate the left and right audio signals by dynamically adjusting one or both of a delay and a gain applied to the left and right audio signals.
16. The system of claim 9, wherein the signal analyzer is configured to calculate the depth steering information based on decorrelating the left and right audio signals.
17. Non-transitory physical computer storage comprising instructions stored therein configured to implement, in one or more hardware processors, operations for processing an audio signal, the operations comprising:
calculating first difference information using the left and right audio signals, the first difference information based at least partly on the spatial position of the sound source and corresponding to an amount of decorrelation to be performed on the left and right audio signals;
decorrelating the left and right audio signals by an amount that depends at least partly on the first difference information to produce decorrelated left and right audio signals;
calculating second difference information in the decorrelated left and right audio signals;
applying at least one perspective filter to the second difference information to produce first left and right output signals;
applying crosstalk cancellation to the first left and right output signals to obtain second left and right output signals; and
providing the second left and right output signals for playback.
18. The storage of claim 17, wherein the operations further comprise normalizing the second difference information and modulating the application of the at least one perspective filter based at least in part on the normalized second difference information.
US14/801,652 2011-01-04 2015-07-16 Immersive audio rendering system Active US10034113B2 (en)
US13/342,743 US9088858B2 (en) 2011-01-04 2012-01-03 Immersive audio rendering system
US14/801,652 US10034113B2 (en) 2011-01-04 2015-07-16 Immersive audio rendering system
US13/342,743 Continuation US9088858B2 (en) 2011-01-04 2012-01-03 Immersive audio rendering system
US20160044431A1 US20160044431A1 (en) 2016-02-11
US10034113B2 true US10034113B2 (en) 2018-07-24
CN107409264A (en) 2015-01-16 2017-11-28 三星电子株式会社 Method for processing sound on basis of image information, and corresponding device
JPH10295000A (en) 1997-02-07 1998-11-04 Bose Corp Surround sound encoding and decoding device
JP2008281355A (en) 2007-05-08 2008-11-20 Jfe Engineering Kk Corrosion risk evaluation method, maintenance plan creation method, corrosion risk evaluation program, maintenance plan creation program, corrosion risk evaluation device, and maintenance plan creation device
JP2011504478A (en) 2007-11-22 2011-02-10 ベーリンガー インゲルハイム インターナショナル ゲゼルシャフト ミット ベシュレンクテル ハフツング Novel compounds
JPH06319199A (en) 1993-01-14 1994-11-15 Rocktron Corp Multi-dimensional acoustic circuit and method therefor
JP2001503942A (en) 1996-11-07 2001-03-21 エス・アール・エス・ラブス・インコーポレーテッド Method of providing what multichannel audio emphasis system and the same for use in recording and playback
US20090190766A1 (en) 1996-11-07 2009-07-30 Srs Labs, Inc. Multi-channel audio enhancement system for use in recording playback and methods for providing same
TW200809772A (en) 2006-06-30 2008-02-16 Creative Tech Ltd Audio enhancement module for portable media player
CN101123829A (en) 2006-07-21 2008-02-13 索尼株式会社 Audio signal processing apparatus, audio signal processing method, and program
US9154897B2 (en) * 2011-01-04 2015-10-06 Dts Llc Immersive audio rendering system
Chinese Office Action for Chinese Application No. 2012800046625 dated Aug. 28, 2015.
Extended European Search Report in European Application No. 12731992.9, dated Oct. 10, 2016, in 8 pages.
International Preliminary Report on Patentability dated Feb. 1, 2013 in PCT Application No. PCT/US2012/20102.
International Search Report and Written Opinion issued in application No. PCT/US2012/020099 dated May 4, 2012.
International Search Report and Written Opinion issued in application No. PCT/US2012/020102 dated May 1, 2012.
Japanese Office Action for Japanese Application No. 2013-548464 dated Jul. 28, 2015.
Office Action and English translation issued in Korean Application No. 10-2013-7020526, dated Jul. 24, 2017, in 7 pages.
Office Action in European Application No. 12731992.9, dated Jul. 11, 2017, in 4 pages.
Office Action issued in European Application No. 12731992.9, dated Jul. 11, 2017, in 4 pages.
Potard et al., "Decorrelation Techniques for the Rendering of Apparent Sound Source Width in 3D Audio Displays", Proc. of the 7th Int. Conference on Digital Audio Effects (DAFx'04), Naples, Italy, Oct. 5-8, 2004, pp. 280-284.
US9154897B2 (en) 2015-10-06