Title of Invention	METHOD OF MIXING AUDIO CHANNELS USING CORRELATED OUTPUTS
Abstract	A method of mixing audio channels (R, C, L) is effective at rebalancing the audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels (R, C, L) by processing the audio channels to generate one or more 'correlated' audio signals for each pair of input channels. The in-phase correlated signal (150, 152) representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels. The present approach may also generate an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that may be mixed with the input channels.

Title of Invention

METHOD OF MIXING AUDIO CHANNELS USING CORRELATED OUTPUTS

Abstract

A method of mixing audio channels (R, C, L) is effective at rebalancing the audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels (R, C, L) by processing the audio channels to generate one or more 'correlated' audio signals for each pair of input channels. The in-phase correlated signal (150, 152) representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels. The present approach may also generate an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that may be mixed with the input channels.

Full Text	FORM2 THE PATENTS ACT, 1970 (39 of 1970) & THE PATENTS RULES, 2003 COMPLETE SPECIFICATION (See section 10, rule 13) "METHOD OF MIXING AUDIO CHANNELS USING CORRELATED OUTPUTS" DTS, Inc. an American company of 5171 Clareton Drive, Agoura Hills, California 91301, U.S.A The following specification particularly describes the invention and the manner in which it is to be performed. WO 2006/026463 PCT/US2005/030471 METHOD OF MIXING AUDIO CHANNELS USING CORRELATED OUTPUTS BACKGROUND OF THE INVENTION 5 Field of the Invention This invention relates to mixing of audio signals and more specifically to a mix or downmix of two or more audio channels using a correlated output. 10 Description of the Related Art Multi-channel audio has received enthusiastic acceptance by movie watchers in both traditional theater and home theater venues as it provides a true "surround sound" experience far superior to mixed stereo content. Dolby AC3 (Dolby digital) 15 audio coding system is a world-wide standard for encoding stereo and 5.1 channel audio sound tracks. DTS Coherent Acoustics is another frequently used multi-channel audio coding system. DTS Coherent Acoustics is now being used to provide multi-channel music for special events and home 20 listening via broadcast, CDs and DVDs 5.1, 6.1, 7.1, 10.2 and other multi-channel formats Car audio systems have over the years advanced from mono to stereo to the multi-speaker systems standard in most every automobile today. However, most content is still provided in a 25 2-channel stereo (L,R) format. The audio system mixes and delays the two channels to the multi-speaker lay out to provide an enhanced audio experience. However with the growing availability of multi-channel music, multi-channel audio systems are being implemented in automobiles to provide 30 passengers with a "surround sound" experience. Although a significant improvement over existing audio WO 2006/026463 PCT/US2005/030471 2 systems, the confines of the car and proximity of passengers to particular speakers affect the surround-sound experience. In general, the desired mix embodied in the multi-channel format may become "unbalanced". For example, a passenger 5 sitting in the front passenger's seat may here too much of the discrete R channel that is emanating from the front right speaker effectively losing some of the benefits of the surround sound presentation. Even more extreme, a passenger in the back seat may here only the surround sound channels. 10 As a result, automakers have found that some amount of remixing of the discrete channels can reestablish the desired balance and improve the surround sound experience for everyone in the car. As shown in Figure 1, a typical mixer 10 remixes the discrete R,C,L input channels 12,14,16 into R,C,L output 15 channels 18,20,22 for an automobile. Each channel is passed through a delay 24 and mixed (multiplied by gain coefficients Gi 26 and summed 28) with the adjacent channels. Standard mixing equations are: R = G1R + G2C 20 C = G3C + G4L + G5R, and L - G6L + G7C. The mixed channels are passed through equalizers 30 to the output channels 18,20,22 for playback on the L,C,R channel speakers in the automobile. 25 Although this approach is generally effective at rebalancing the audio to provide a reasonable surround-sound experience for every passenger in the automobile there are a few potential problems. This approach may introduce unwanted artifacts when two channels include the same or very similar 30 content but with a relative time or phase delay. Furthermore, this approach may over mix the signals that were assigned to a 3 WO 2006/026463 PCT/US2005/030471 3 specific channel thereby degrading the "discreteness" of the multi-channel audio. SUMMARY OF THE INVENTION 5 The present invention provides a method of mixing audio channels that is effective at rebalancing the audio or downmixing audio channels without introducing unwanted artifacts or overly degrading the discrete presentation of the original audio. 10 This is accomplished between any two or more input channels by processing the audio channels to generate one or more "correlated" audio signals for each pair of input channels. The correlated audio signal(s) are then mixed with the input audio channels to provide the output channels. The 15 correlator can be implemented using any suitable technology including but not limited to Neural Networks, Independent Component Analysis (ICA), Adaptive Filtering or Matrix Decoders. In one embodiment, only the in-phase correlated signal is 20 mixed with the two input channels. The in-phase correlated signal represents the same or very similar signals that are present in both channels and in-phase (no or minimal time delay). By mixing only this portion of the audio signals we are able to achieve the desired rebalancing without 25 introducing unwanted artifacts or degrading the discreteness of multi-channel audio. In another embodiment, the correlation process provides the in-phase correlated signal, an out-of-phase correlated signal (same or similar signals with appreciable time or phase 30 delay) and one or more independent signals (signals not present in the other input channel) that are mixed with the input channels. This approach provides more mixing 4 WO 2006/026463 PCTAJS2005/030471 4 flexibility. The mixer may set the mixing coefficients of the out-of-phase and independent signals to zero thereby achieving the same results as if only the in-phase correlated signal were mixed. Or the mixer may simply lower the coefficients in 5 these signals to provide a smoother mix. In other applications, the mixer may want to reduce or remove the out-of-phase signal but retain some of the independent signal. For example, in a 3:2 downmix from L,C,R input channels to L,R output channels it may be desirable to mix the independent C 10 channel signals into the L and R output channels. These and other features and advantages of the invention will be apparent to those skilled in the art from the following detailed description of preferred embodiments, taken together with the accompanying drawings, in which: 15 BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1, as described above, is a known configuration for mixing the discrete L, C and R audio channels in an automobile to improve the surround-sound experience; 20 FIG. 2 is a configuration for mixing the discrete L, C and R audio channels using the correlated outputs between the L and C and R and C channels in accordance with the present invention; FIG. 3 is a block diagram of a correlator generating a 25 correlated output; Fig. 4 is a block diagram of a correlator generating correlated, out-of-phase and independent outputs; FIGs. 5a through 5h are simplified diagrams showing time and frequency domain representations of the L and R input 30 channels and frequency domain representations of 2:1 and 4:1 correlated outputs; FIG. 6 is a block diagram of an embodiment of the WO 2006/026463 PCT/US2005/030471 5 correlator using a 2:4 matrix decoder; FIG. 7 is a simplified block diagram of an automobile audio system; FIG. 8 is a block diagram of the multi-channel mixer; and 5 FIG. 9 is a block diagram of the multi-channel mixer that exploits the downmix capabilities of the correlator shown in FIG. 4 in an automobile. DETAILED DESCRIPTION OF THE INVENTION 10 The application of multi-channel audio to automobiles revealed the desirability for remixing of the discrete audio channels to provide a more uniform surround sound experience for all passengers. However, although a straightforward mix was effective at rebalancing the multi-channel audio this 15 approach could produce unwanted artifacts. If, for example, the R and C channels included the same or very similar content with appreciable phase or time delays, remixing these two channels could produce phase distortion and/or amplitude distortion. Furthermore, much of the desirability of multi- 20 channel audio stems from the discrete unmixed presentation of the audio channels. The remixing process may soften the discrete presentation of the audio. Therefore, the present invention provides a method of mixing audio channels that is effective at rebalancing the 25 audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels by processing the audio channels to generate one or more "correlated" audio signals for each pair of input channels. 30 The in-phase correlated signal representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels. The 6 WO 2006/026463 PCT/US2005/030471 6 present approach may also generate an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that 5 may be mixed with the input channels. The provision of both the in-phase correlated signal and the pair of independent signals makes the present approach well suited for the downmixing of audio channels as well. Although the techniques were developed in the context of 10 improving the surround sound experience provided by multichannel audio in a automobile, the present invention is generally applicable- to any two or more audio channels in which mixing occurs in any setting. 15 Mixing with Correlated Outputs As shown in Figure 2, a mixer 40 remixes the discrete R,C,L input channels 42,44,46 into R,C,L output channels 48,50,52 for an automobile. Each channel is passed through a delay 54. The R and C and L and C channels are input to 20 correlators 56 and 58, respectively, which generate correlated audio signals 60 and 62. These correlated audio signals 60 and 62 are mixed (multiplied by gain coefficients Gi 64 and summed 66) with the adjacent channels. The mixed channels are passed through equalizers 68 to the output channels 48,50,52 for 25 playback on the L,C,R channel speakers in, for example, the automobile. The correlators 56 and 58 can be implemented using any suitable technology including but not limited to Neural Networks, Independent Component Analysis (ICA), Adaptive 30 Filtering or Matrix Decoders. As shown in Figure 3, a correlator 70 can be configured to produce a single in-phase 7 WO 2006/026463 PCT/US2005/030471 7 correlated audio signal (LCC, RCC) that is mixed as follows: R - G8R + G9RCC (1) C = G10C + G11LCC + G12RCC, and (2) L = G13L + G14LCC. (3) 5 In this approach, the out-of-phase correlated signals and independent signals are removed. Of course there are no bright lines or clear definitions that separate in-phase from out-of-phase and correlated from independent. How these components of the audio content are separated will depend upon 10 the technology used to implement the correlator and the desired characteristics of the correlated signal. In some applications it may be desirable to retain only very high correlated signals. In other applications, it may be desirable to retain some of the out-of-phase and independe 15 signals. As shown in Figure 4, this desire for increased flexibility can be accommodated with a correlator 72 that is configured to produce an in-phase correlated audio signal (RIP,LIP), an out-of-phase correlated audio signal (ROP,LOP) 20 and L and R independent audio signals(RCI,CRI and LCI,CLI). In general, each of these components can be mixed in accordance with mixing equations: R = G15R + (G16RIP + G17ROP + G18RCI + G19CRI) (4) C = G20C + (G21LIP + G22LOP + G23LCI + G24CLI)+ 25 (G25RIP + G26ROP + G27RCI + G28CRI), and (5) L = G29L + (G30LIP + G31L0P + G32LCI + G33CLI). (6) Similar to above how these different correlated components are computed will depend upon the implementing technology and the desired characteristics of the different components. 30 In a typical implementation, the out of phase components and the independent components for that output channel may be discarded. In this case the equations simplify to: WO 2006/026463 PCT/US2005/030471 8 R = G15R + (G16RIP + G19CRI) (7) C = G20C + (G21LIP + G23LCI) + (G25RIP + G27RCI), and (8) L = G29L + (G30LIP + G33CLI) (9) 5 leaving only the in-phase correlated signals and the independent signals from the other channel. Figures 5a through 5h illustrate a simple four tone example highlighting the benefits and flexibility provided by mixing correlated outputs. In this example, the L channel 10 includes a 1kHz tone, a 5kHz tone and a 15kHz tone. The R channel has a 5 kHz tone, a 10 kHz tone and a 15 kHz tone. The 5 kHz tones are in phase and correlated. The 15 kHz tones are out of phase. The time domain waveforms 72 and 74 for the L (top) and R (bottom) channels are shown in Figure 5a. The 15 frequency content 76 and 78 of the L and R channels are shown in Figures 5b and 5c, respectively. A 2:1 correlator of the type illustrated in Figure 3 above, produces a single in-phase correlated audio signal 80 as shown in Figure 5d. This signal can then be mixed with 20 either or both the left and right channels to rebalance the 5kHz tone without introducing any phase or amplitude distortions associated with the out-of-phase 15 kHz tones or mixing in any of the independent audio signals, 1kHz into the R channel or 10kHz in the L channel. 25 A 2:4 correlator of the type illustrated in Figure 4 above, produces an independent L signal 82 at 1kHz, independent R signal 84 at 10kHz, in-phase correlated signal 86 at 5kHz, and an out-of-phase correlated signal 88 at 15kHz as shown in Figure 5e-5h. These signals can then be 30 independently mixed with either or both the left and right channels. In some cases only the in-phase correlate signal 86 WO 2006/026463 PCT/US2005/030471 9 will be mixed and the other discarded or set to zero. Alternately, the mixer may prefer to add a small component of these other signals. For example, in a 3:2 downmix in which the C channel does not have a discrete speaker, it may be 5 necessary to mix some of the independent signals. Correlator Implementations Matrix Decoder As mentioned above, the correlator may be implemented 10 using a matrix decoder. The earliest multi-channel systems matrix encoded multiple audio channels, e.g. left, right, center and surround (L,R,C,S) channels, into left and right total (Lt,Rt) channels and recorded them in the standard stereo format. The Prologic encoder 4 matrix encodes this mix 15 as follows: Lt = L +.707C + S(+90°), and (10) Rt = R + .707C +S(-90), (11) A matrix decoder decodes the two discrete channels Lt,Rt and expands them into four discrete reconstructed channels 20 L,R,C and S that are amplified and distributed to a five speaker system. Many different proprietary algorithms are used to perform an active decode and all are based on measuring the power of Lt+Rt (C) , Lt-Rt (S) , Lt (L) and Rt (R) to calculate gain factors Hi whereby, 25 L = HlLt + H2Rt (12) R = H3Lt + H4Rt (13) C = H5Lt + H6Rt, and (14) S = H7Lt + H8Rt. (15) More specifically, Dolby Pro Logic provides a set of gain 30 factors for a null point at the center of a five-point sound field. The Pro Logic decoder measures the absolute power of the two-channel matrix encoded signals Lt and Rt and WO 2006/026463 PCT/US2005/030471 10 calculates power levels for each of the L, R, C and S channels. These power levels are then used to calculate L/R and C/S dominance vectors whose vector sum defines a single dominance vector in the five-point sound field from which the 5 single dominant signal should emanate. The power levels and dominance vectors are time averaged to improve stability. The decoder scales the set of gain coefficients at the null point according to the dominance vectors to provide gain factors Hi. DTS Neo:6 decoder includes a multiband filter bank, a 10 matrix decoder and a synthesis filter, which together decode Lt and Rt and reconstruct the multi-channel output. Neo:6 computes L/R and C/S dominance vector for each subband and averages them using both a slow and fast average. Neo:6 uses the dominance vector to map the Lt, Rt subband signals into an 15 expanded 9-point sound field. Neo:6 computes gain coefficients for the vector in each subband based on the values of the gain coefficients in the sound field. This allows the subbands to be steered independently in a sound field that observes the motion picture channel configuration. 20 Matrix Decoder as a Correlator As shown in Figure 6, a 2:4 matrix decoder 90 is designed to deconstruct Lt and Rt to reconstruct the L, R, C and S channels as encoded in equations 10 and 11. An analysis of 25 these equations shows that the L and R channels are independent in Lt and Rt, the C channel is perfectly correlated and the S channel is 180° out-of-phase. Therefore, as shown in Figure 6, if Lt and Rt are simply two audio channels, and not matrix encoded channels, then the 30 reconstructed C channel will represent any in-phase correlated audio signals in Lt and Rt, the reconstructed S channel will represent any out-of-phase correlated audio signals and the WO 2006/026463 PCT/US2005/030471 11 reconstructed L and R channels will represent independent audio signals from the two input audio channels. Note, a 2:3 matrix decoder in which the S channel is mixed into the L and R channels can be used if only the in-phase correlated signal is required. The specific algorithm used to calculate the gain factors Hi will determine the degree of correlation, phase shift or independence captured in each of these channels. To illustrate, consider the following idealized cases: 10 Case 1: Lt, Rt highly correlated (Lt = Rt) L HI and H2 = 0.354, -0.354, C HI and H2 = 0.707, 0.707, R HI and H2 = -0.354, 0.354, 15 S HI and H2 = 0.707, -0.707, In this case, L, R and S will be 0 and C will contain equal amounts of both L and R. As expected, in-phase contribution will be large and the other components will be zero. . Depending on where the steering vector ends up new 20 coefficients are calculated from a grid of optimal ones using interpolation Case 2: Lt, Rt complete out of phase (Lt •= -1.0*Rt) L Gl and G2 = 0.354, 0.354, 25 C Gl and G2 = 0.5, 0.5, R Gl and G2 = 0.354, 0.354, S HI and H2 = 0.707, -0.707, In this case, all of the outputs will be zero. 30 Case 3: Lt is dominate (Rt = 0) L HI and H2 = 1.0, 0.0, 12 WO 2006/026463 PCT/US2005/030471 12 C HI and H2 = 0.0, 0.5, R HI and H2 - 0.0, 0.707, S HI and H2 = 0.0, -1, In this case, all of the outputs are zero except for the 5 left channel which contains the left input. Multi-Channel Automotive Audio System As discussed above the motivation for the present invention was to improve the surround sound experience 10 provided by multi-channel audio such as provided by Dolby AC3 or DTS Coherent Acoustics. By mixing correlated audio signals, the multi-channel mixer provides the desired rebalanced of the multi-channel audio without producing unwanted artifacts or softening the discrete presentation of the audio. 15 As shown in Figures 7 and 8, a typical automotive sound system 100 a plurality of speakers 102 including at least L front and R front in the passenger cabin 104 of the car. In this example, speaker system also includes C front, R and L side and R and L rear and may include a C rear. A multi- 20 channel decoder 106 decodes multi-channel encoded audio from a disk 108 (or broadcast) into multiple discrete audio input channels including at least L front, C front and R front. In this 5.1 channel format right Rs and left Ls surround channels are also provided. The .1 or low frequency channel is not 25 shown. A multi-channel mixer 110 mixes the discrete R,C,L channels using correlated outputs into the R,C,L channels for the respective speakers. Each channel is passed through a delay 112. The R and C and L and C channels are input to 30 correlators 114 and 116, respectively, which generate correlated audio signals 118 and 120. These correlated audio 13 WO 2006/026463 PCT/US2005/030471 13 signals 118 and 120 are mixed (multiplied by gain coefficients Gi 122 and summed 124) with the adjacent channels. The mixed channels are passed through equalizers 126 to the R,C, L output channels for playback on the R,C,L channel speakers. 5 In this particular application 5.1 audio is being mixed into a 7 speaker system, which is not uncommon. Because of typical home speaker configurations, 5.1 content is more common but many cars use 7 speaker systems. In this case the Rs and Ls discrete channels are mixed to the R side and R read 10 and L side and L rear, respectively. The Rs (Ls) channel is passed through a delay 130, split and multiplied by mixing coefficients 132. One branch is passed through an equalizer 134 and provided to the R read (L rear). The other branch is mixed with the mixed R (L) channel (delay 136, mixing 15 coefficient 138, and summing node 140), passed through an equalizer 142 and provided to the R side (L side). If the content were provided in a 7.1 format, the R, R side and R rear discrete audio channels could be mixed using correlated outputs in a manner similar to that described for 20 the R,C,L. The left side channels could be similarly mixed. Furthermore, if the audio was available in an 8.1 format and the speaker system included a C rear speaker, all of the rear speakers could be so mixed. As shown in Figure 9, the speaker system in the car is 25 not provided with a C front speaker. The 3 front channels (R,C,L) must be downmixed into only 2 channels (R,L). This is a common occurrence in non-automotive applications where the C channel speaker does not exist. The C channel is simply mixed into both the L and R speakers. In the automotive setting, 30 the same approach can be taken. However, the ideal coefficients for mixing the C channel may not be the same as WO 2006/026463 PCT/US2005/030471 14 the desired coefficients for rebalancing and further may create unwanted artifacts do to the out-of-phase correlated signals between the input channels. Instead, the correlators 150 and 152 generate the in- 5 phase, out-of-phase, and pair of independent audio signals. The mixer now has the flexibility to mix the in-phase components as needed to rebalance the signal, discard the out-of-phase components to avoid phase distortion and mix the independent C channel to preserve the audio signals in that 10 channel. The capability to flexibly downmix N channels into M where N>M in this manner will have applicability outside automotive applications. For example, content is being generated for new exhibition venues with more discrete 15 channels, e.g. 10.2. However, many of the commercial and consumer venues will have 5.1, 6.1 or 7.1 speaker configurations that will require downmixing. While several illustrative embodiments of the invention have been shown and described, numerous variations and 20 alternate embodiments will occur to those skilled in the art. Such variations and alternate embodiments are contemplated, and can be made without departing from the spirit and scope of the invention as defined in the appended claims. WE CLAIM; 1. A method of mixing audio channels, comprising: Providing first and second audio input channels; Correlating the first and second audio input channels to provide an in-phase correlated audio signal between the first and second audio input channels; Multiplying the in-phase correlated audio signal by a first gain coefficient; and Mixing the in-phase correlated audio signal with the first audio input channel into a first audio output channel. 2. The method of claim 1, wherein the first and second audio input channels are correlated in a plurality of subbands to provide a like plurality of in-phase correlated audio signals in the respective subbands, each subband having its own first gain coefficient. 3. The method of claim 1, wherein the in-phase correlated signal represents the same or similar audio signals with little or no time or phase delay in the first and second audio input channels. 4. The method of claim 2, wherein correlating the first and second audio input channels further provides a separate independent signal representing audio signals present in the second input audio channel but not present in the first input audio channel, further comprising: Multiplying the independent signal by a second gain coefficient; and Mixing the independent and in-phase correlated audio signals with the first audio input channel into the first audio output channel. 5. The method of claim 4, wherein the first and second audio input channels are correlated in a plurality of subbands to provide a like plurality of in-phase correlated audio signals and first independent signals in the respective subbands, each subband having its own first gain coefficient. 16 6. The method of claim 4, wherein correlating the first and second audio input channels further provides a separate out-of-phase correlated signal. 7. The method of claim 6, wherein the out-of-phase correlated signal is discarded. 8. The method of claim 1, wherein the correlation is performed using one of neural networks, ICA, adaptive prediction or matrix decoding. 9. The method of claim 1, wherein the correlation of the first and second input channels is performed with a 2:3 matrix decoding to produce the in-phase correlated audio signal and separate first and second matrix signals that include independent audio signals for the first and second input channels, respectively, and out-of-phase correlated signals, wherein said in-phase audio signal is multiplied by the first gain coefficient arid mixed with said first input channel and said separate first and second matrix signals are discarded. 10. The method of claim 1, wherein the correlation of the first and second input channels is performed by a 2:4 matrix decoding to produce the in-phase correlated signal, a separate out-of-phase correlated signal and separate first and second independent signals, further comprising: Multiplying the first and second independent signals and said out-of-phase correlated signal by second, third and fourth gain coefficient, respectively; and Mixing the first and second independent audio signals and out-of-phase correlated signal with the first audio input channel into the first audio output channel. 11. The method of claim 10, wherein the fourth gain coefficient is set to zero to discard said out-of-phase signal. 17 12. The method of claim 1, wherein said first and second input channels are discrete channels of a multi-channel discrete audio signal. 13. A method of mixing audio channels, comprising: Providing right CR), center (C) and left CL) audio input channels; Correlating the R and C audio channels to provide a C-R in-phase correlated audio signal between the R and C channels and a C-R independent audio signal representing audio signals present in the C audio input channel but not present in the R audio input channel in respective audio channels; Correlating the C and L audio channels to provide a C-L in-phase correlated audio signal between the L and C channels and a C-L independent audio signal representing audio signals present in the C audio input channel but not present in the L audio input channel in respective audio channels; Multiplying the C-R in-phase correlated and C-R independent audio signals by respective gain coefficients and mixing them with the R input channel into a R output channel; and Multiplying the C-L in-phase correlated and C-L independent audio signals by respective gain coefficients and mixing them with the L input channel into a L output channel. 14. The method of claim 13, wherein R and C and C and L input channels are correlated in a plurality of subbands to provide a like plurality of first and second in-phase correlated audio signals in the respective subbands, each subband having its own gain coefficient. 15. The method of claim 13, wherein correlating the R and C and L and C audio input channels further provides R-C and L-C independent signals that represent audio signals present in the R and L channels but not the C channel in respective audio channels further comprising: Multiplying the C-R and C-L in-phase correlated audio signals and the R-C and L-C independent signals by respective gain coefficients and mixing them with the C input channel into a C output channel 18 16. The method of claim 13, wherein correlating the R and C audio input channels further provides a C-R out-of phase correlated signal in an audio channel and correlating the L and C audio input channels further provides a C-L out-of-phase correlated signal in an audio channel, further comprising: Multiplying the C-R out-of-phase correlated signal by a negative gain coefficient to bring it in-phase and mixing it with the R audio input channel into the R output channel; and Multiplying the C-L out-of-phase correlated signal by a negative gain coefficient to bring it in-phase and mixing it with the L audio input channel into the L output channel. 17. A method of mixing audio channels, comprising: Providing first, second and third audio input channels; Processing the first and second channels to provide a first in-phase correlated signal, a first out-of-phase correlated signal, and first and second independent signals; Processing the second and third channels to provide a second in-phase correlated signal, a second out-of- phase correlated signal, and second and third independent signals; Mixing the first in-phase correlated signal, a first out-of-phase correlated signal, and the first and second independent signals with the first input channel into a first output channel; and Mixing the second in-phase correlated signal, a second out-of-phase correlated signal, and the second and third independent signals with the third input channel into a third output channel. 18. The method of claim 17, wherein the first and second out-of-phase correlated signals are discarded. 19. The method of claim 17, wherein said first and second channels and said second and third channels are each 2:4 matrix decoded to produce the signals. 19 20. An audio mixer, comprising: A correlator that correlates first and second audio input channels to provide a an in-phase correlated audio signal between the first and second audio input channels; and A mixer that multiplies the in-phase correlated audio signal by a gain coefficient and mixes it with the first input channel into a first output channel. 21. The audio mixer of claim 20, wherein the first and second audio input channels are correlated in a plurality of subbands to provide a like plurality of in-phase correlated audio signals in the respective subbands, each subband having its own gain coefficient. 22. The audio mixer of claim 20, wherein the correlator further provides a separate independent signal representing audio signals present in said second audio input channel but not the first audio input channel, said mixer multiplying the independent signal by a gain coefficient and mixing it with the first input channel into the first output channel. 23. An audio mixer, comprising: a decoder that receives multi-channel encoded audio data and outputs multiple discrete audio input channels including at least left (L) , center (C) and right CR) channels, a first matrix decoder that matrix decodes the R and C channels to produce a first in-phase correlated audio signal; a first mixer that mixes the first in-phase correlated audio signal with the R input channel into a R output channel; a second matrix decoder that matrix decodes the L and C channels to produce a second in-phase correlated audio signal; and a second mixer that mixes the second in-phase correlated audio signal with the L input channel into a 1 output channel. 20 24. The audio mixer of claim 23, wherein said first and second matrix decoders comprise 2:3 decoders that output left and right channels that are discarded and a center channel that provides the in-phase correlated audio signal. 25. The audio mixer of claim 23, wherein said first and second matrix decoders comprise 2:4 decoders that output left and right channels that provide R and C and L and C independent audio signals, respectively, output a center channel that provides the in-phase correlated audio signal, and output a surround channel that provides an out-of-phase correlated audio signal that is discarded. 26. An audio system, comprising: an automobile having a passenger cabin; a plurality of speakers including at least L front and R front in the passenger cabin; A multi-channel decoder for decoding multi-channel encoded audio into multiple discrete audio input channels including at least L front, C front and R front; and A multi-channel mixer that Correlates the R and C audio channels and C and L audio channels to provide C-R and C-L in-phase correlated audio signals and C-R and C-L independent audio signals representing audio signals in the C audio input channel not present in the R and L channels, respectively; Multiplies the C-R in-phase correlated audio signal and C-R independent audio signal by respective gain coefficients and mixes them with the R input channel into a R output channel that is directed to the P. front speaker; and Multiplies the C-L in-phase correlated audio signal and C-L independent audio signal by respective gain coefficients and mixes them with the L input channel into a L output channel that is directed to the L front speaker. 21 27. The audio system of claim 26, wherein the P. and C and C and L audio channels are correlated in a plurality of subbands to provide a like plurality of first and second in-phase correlated audio signals in the respective subbands, each subband having its own gain coefficient. 28. The audio system of any of the preceding claims, wherein correlating the P. and C audio channels and C and L audio channels further provides C-R and C-L out-of-phase correlated signals that are inverted and multiplied by respective gain coefficients to bring them in-phase and mixed with the P. and L input audio channels, respectively. 29. The audio system of claim 26, wherein correlating the P. and C audio channels and C and L audio channels further provides R-C and L-C independent signals including audio signals present in the R and L audio channels but not present in the C audio channel, respectively, said mixer multiplying the C-R and C-L inphase correlated signals and R-C and L-C independent signals by respective gain coefficients and mixing them with the C input channel into a C output channel that is directed to a C front speaker. Dated this 23rd February, 2007 22 ■ ABSTRACT METHOD OF MIXING AUDIO CHANNELS USING CORRELATED OUTPUTS A method of mixing audio channels (R, C, L) is effective at rebalancing the audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels (R, C, L) by processing the audio channels to generate one or more 'correlated' audio signals for each pair of input channels. The in-phase correlated signal (150, 152) representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels. The present approach may also generate an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that may be mixed with the input channels. 23

Full Text

FORM2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
"METHOD OF MIXING AUDIO CHANNELS USING CORRELATED
OUTPUTS"
DTS, Inc. an American company of 5171 Clareton Drive, Agoura Hills, California 91301, U.S.A
The following specification particularly describes the invention and the manner in which it is to be performed.

WO 2006/026463

PCT/US2005/030471

METHOD OF MIXING AUDIO CHANNELS USING CORRELATED OUTPUTS
BACKGROUND OF THE INVENTION
5 Field of the Invention
This invention relates to mixing of audio signals and more specifically to a mix or downmix of two or more audio channels using a correlated output.
10 Description of the Related Art
Multi-channel audio has received enthusiastic acceptance by movie watchers in both traditional theater and home theater venues as it provides a true "surround sound" experience far superior to mixed stereo content. Dolby AC3 (Dolby digital)
15 audio coding system is a world-wide standard for encoding stereo and 5.1 channel audio sound tracks. DTS Coherent Acoustics is another frequently used multi-channel audio coding system. DTS Coherent Acoustics is now being used to provide multi-channel music for special events and home
20 listening via broadcast, CDs and DVDs 5.1, 6.1, 7.1, 10.2 and other multi-channel formats
Car audio systems have over the years advanced from mono to stereo to the multi-speaker systems standard in most every automobile today. However, most content is still provided in a
25 2-channel stereo (L,R) format. The audio system mixes and delays the two channels to the multi-speaker lay out to provide an enhanced audio experience. However with the growing availability of multi-channel music, multi-channel audio systems are being implemented in automobiles to provide
30 passengers with a "surround sound" experience.
Although a significant improvement over existing audio

WO 2006/026463

PCT/US2005/030471

2
systems, the confines of the car and proximity of passengers
to particular speakers affect the surround-sound experience. In general, the desired mix embodied in the multi-channel format may become "unbalanced". For example, a passenger
5 sitting in the front passenger's seat may here too much of the discrete R channel that is emanating from the front right speaker effectively losing some of the benefits of the surround sound presentation. Even more extreme, a passenger in the back seat may here only the surround sound channels.
10 As a result, automakers have found that some amount of remixing of the discrete channels can reestablish the desired balance and improve the surround sound experience for everyone in the car. As shown in Figure 1, a typical mixer 10 remixes the discrete R,C,L input channels 12,14,16 into R,C,L output
15 channels 18,20,22 for an automobile. Each channel is passed through a delay 24 and mixed (multiplied by gain coefficients Gi 26 and summed 28) with the adjacent channels. Standard mixing equations are:
R = G1*R + G2*C
20 C = G3*C + G4*L + G5*R, and
L - G6*L + G7*C. The mixed channels are passed through equalizers 30 to the output channels 18,20,22 for playback on the L,C,R channel speakers in the automobile.
25 Although this approach is generally effective at rebalancing the audio to provide a reasonable surround-sound experience for every passenger in the automobile there are a few potential problems. This approach may introduce unwanted artifacts when two channels include the same or very similar
30 content but with a relative time or phase delay. Furthermore, this approach may over mix the signals that were assigned to a

3

WO 2006/026463

PCT/US2005/030471

3
specific channel thereby degrading the "discreteness" of the
multi-channel audio.
SUMMARY OF THE INVENTION
5 The present invention provides a method of mixing audio channels that is effective at rebalancing the audio or downmixing audio channels without introducing unwanted artifacts or overly degrading the discrete presentation of the original audio.
10 This is accomplished between any two or more input channels by processing the audio channels to generate one or more "correlated" audio signals for each pair of input channels. The correlated audio signal(s) are then mixed with the input audio channels to provide the output channels. The
15 correlator can be implemented using any suitable technology including but not limited to Neural Networks, Independent Component Analysis (ICA), Adaptive Filtering or Matrix Decoders.
In one embodiment, only the in-phase correlated signal is
20 mixed with the two input channels. The in-phase correlated signal represents the same or very similar signals that are present in both channels and in-phase (no or minimal time delay). By mixing only this portion of the audio signals we are able to achieve the desired rebalancing without
25 introducing unwanted artifacts or degrading the discreteness of multi-channel audio.
In another embodiment, the correlation process provides the in-phase correlated signal, an out-of-phase correlated signal (same or similar signals with appreciable time or phase
30 delay) and one or more independent signals (signals not present in the other input channel) that are mixed with the input channels. This approach provides more mixing
4

WO 2006/026463

PCTAJS2005/030471

4
flexibility. The mixer may set the mixing coefficients of the out-of-phase and independent signals to zero thereby achieving the same results as if only the in-phase correlated signal were mixed. Or the mixer may simply lower the coefficients in
5 these signals to provide a smoother mix. In other applications, the mixer may want to reduce or remove the out-of-phase signal but retain some of the independent signal. For example, in a 3:2 downmix from L,C,R input channels to L,R output channels it may be desirable to mix the independent C
10 channel signals into the L and R output channels.
These and other features and advantages of the invention will be apparent to those skilled in the art from the following detailed description of preferred embodiments, taken together with the accompanying drawings, in which:
15
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1, as described above, is a known configuration for mixing the discrete L, C and R audio channels in an automobile to improve the surround-sound experience;
20 FIG. 2 is a configuration for mixing the discrete L, C and R audio channels using the correlated outputs between the L and C and R and C channels in accordance with the present invention;
FIG. 3 is a block diagram of a correlator generating a 25 correlated output;
Fig. 4 is a block diagram of a correlator generating correlated, out-of-phase and independent outputs;
FIGs. 5a through 5h are simplified diagrams showing time and frequency domain representations of the L and R input
30 channels and frequency domain representations of 2:1 and 4:1 correlated outputs;
FIG. 6 is a block diagram of an embodiment of the

WO 2006/026463

PCT/US2005/030471

5 correlator using a 2:4 matrix decoder;
FIG. 7 is a simplified block diagram of an automobile audio system;
FIG. 8 is a block diagram of the multi-channel mixer; and
5 FIG. 9 is a block diagram of the multi-channel mixer that exploits the downmix capabilities of the correlator shown in FIG. 4 in an automobile.
DETAILED DESCRIPTION OF THE INVENTION
10 The application of multi-channel audio to automobiles revealed the desirability for remixing of the discrete audio channels to provide a more uniform surround sound experience for all passengers. However, although a straightforward mix was effective at rebalancing the multi-channel audio this
15 approach could produce unwanted artifacts. If, for example, the R and C channels included the same or very similar content with appreciable phase or time delays, remixing these two channels could produce phase distortion and/or amplitude distortion. Furthermore, much of the desirability of multi-
20 channel audio stems from the discrete unmixed presentation of the audio channels. The remixing process may soften the discrete presentation of the audio.
Therefore, the present invention provides a method of mixing audio channels that is effective at rebalancing the
25 audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels by processing the audio channels to generate one or more "correlated" audio signals for each pair of input channels.
30 The in-phase correlated signal representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels. The
6

WO 2006/026463

PCT/US2005/030471

6
present approach may also generate an out-of-phase correlated
signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that
5 may be mixed with the input channels. The provision of both the in-phase correlated signal and the pair of independent signals makes the present approach well suited for the downmixing of audio channels as well.
Although the techniques were developed in the context of
10 improving the surround sound experience provided by multichannel audio in a automobile, the present invention is generally applicable- to any two or more audio channels in which mixing occurs in any setting.
15 Mixing with Correlated Outputs
As shown in Figure 2, a mixer 40 remixes the discrete R,C,L input channels 42,44,46 into R,C,L output channels 48,50,52 for an automobile. Each channel is passed through a delay 54. The R and C and L and C channels are input to
20 correlators 56 and 58, respectively, which generate correlated audio signals 60 and 62. These correlated audio signals 60 and 62 are mixed (multiplied by gain coefficients Gi 64 and summed 66) with the adjacent channels. The mixed channels are passed through equalizers 68 to the output channels 48,50,52 for
25 playback on the L,C,R channel speakers in, for example, the automobile.
The correlators 56 and 58 can be implemented using any suitable technology including but not limited to Neural Networks, Independent Component Analysis (ICA), Adaptive
30 Filtering or Matrix Decoders. As shown in Figure 3, a correlator 70 can be configured to produce a single in-phase
7

WO 2006/026463

PCT/US2005/030471

7
correlated audio signal (LCC, RCC) that is mixed as follows:
R - G8*R + G9*RCC (1)
C = G10*C + G11*LCC + G12*RCC, and (2)
L = G13*L + G14*LCC. (3)
5 In this approach, the out-of-phase correlated signals and independent signals are removed. Of course there are no bright lines or clear definitions that separate in-phase from out-of-phase and correlated from independent. How these components of the audio content are separated will depend upon
10 the technology used to implement the correlator and the desired characteristics of the correlated signal. In some applications it may be desirable to retain only very high correlated signals. In other applications, it may be desirable to retain some of the out-of-phase and independe
15 signals.
As shown in Figure 4, this desire for increased flexibility can be accommodated with a correlator 72 that is configured to produce an in-phase correlated audio signal (RIP,LIP), an out-of-phase correlated audio signal (ROP,LOP)
20 and L and R independent audio signals(RCI,CRI and LCI,CLI). In general, each of these components can be mixed in accordance with mixing equations:
R = G15*R + (G16*RIP + G17*ROP + G18*RCI + G19*CRI) (4)
C = G20*C + (G21*LIP + G22*LOP + G23*LCI + G24*CLI)+
25 (G25*RIP + G26*ROP + G27*RCI + G28*CRI), and (5)
L = G29*L + (G30*LIP + G31*L0P + G32*LCI + G33*CLI). (6) Similar to above how these different correlated components are computed will depend upon the implementing technology and the desired characteristics of the different components.
30 In a typical implementation, the out of phase components and the independent components for that output channel may be discarded. In this case the equations simplify to:

WO 2006/026463

PCT/US2005/030471

8
R = G15*R + (G16*RIP + G19*CRI) (7)
C = G20*C + (G21*LIP + G23*LCI) + (G25*RIP +
G27*RCI), and (8)
L = G29*L + (G30*LIP + G33*CLI) (9)
5 leaving only the in-phase correlated signals and the independent signals from the other channel.
Figures 5a through 5h illustrate a simple four tone example highlighting the benefits and flexibility provided by mixing correlated outputs. In this example, the L channel
10 includes a 1kHz tone, a 5kHz tone and a 15kHz tone. The R channel has a 5 kHz tone, a 10 kHz tone and a 15 kHz tone. The 5 kHz tones are in phase and correlated. The 15 kHz tones are out of phase. The time domain waveforms 72 and 74 for the L (top) and R (bottom) channels are shown in Figure 5a. The
15 frequency content 76 and 78 of the L and R channels are shown in Figures 5b and 5c, respectively.
A 2:1 correlator of the type illustrated in Figure 3 above, produces a single in-phase correlated audio signal 80 as shown in Figure 5d. This signal can then be mixed with
20 either or both the left and right channels to rebalance the 5kHz tone without introducing any phase or amplitude distortions associated with the out-of-phase 15 kHz tones or mixing in any of the independent audio signals, 1kHz into the R channel or 10kHz in the L channel.
25 A 2:4 correlator of the type illustrated in Figure 4 above, produces an independent L signal 82 at 1kHz, independent R signal 84 at 10kHz, in-phase correlated signal 86 at 5kHz, and an out-of-phase correlated signal 88 at 15kHz as shown in Figure 5e-5h. These signals can then be
30 independently mixed with either or both the left and right channels. In some cases only the in-phase correlate signal 86

WO 2006/026463

PCT/US2005/030471

9
will be mixed and the other discarded or set to zero.
Alternately, the mixer may prefer to add a small component of these other signals. For example, in a 3:2 downmix in which the C channel does not have a discrete speaker, it may be
5 necessary to mix some of the independent signals.
Correlator Implementations
Matrix Decoder
As mentioned above, the correlator may be implemented
10 using a matrix decoder. The earliest multi-channel systems matrix encoded multiple audio channels, e.g. left, right, center and surround (L,R,C,S) channels, into left and right total (Lt,Rt) channels and recorded them in the standard stereo format. The Prologic encoder 4 matrix encodes this mix
15 as follows:
Lt = L +.707C + S(+90°), and (10)
Rt = R + .707C +S(-90), (11)
A matrix decoder decodes the two discrete channels Lt,Rt
and expands them into four discrete reconstructed channels
20 L,R,C and S that are amplified and distributed to a five
speaker system. Many different proprietary algorithms are
used to perform an active decode and all are based on
measuring the power of Lt+Rt (C) , Lt-Rt (S) , Lt (L) and Rt (R)
to calculate gain factors Hi whereby,
25 L = Hl*Lt + H2*Rt (12)
R = H3*Lt + H4*Rt (13)
C = H5*Lt + H6*Rt, and (14)
S = H7*Lt + H8*Rt. (15)
More specifically, Dolby Pro Logic provides a set of gain
30 factors for a null point at the center of a five-point sound field. The Pro Logic decoder measures the absolute power of the two-channel matrix encoded signals Lt and Rt and

WO 2006/026463

PCT/US2005/030471

10
calculates power levels for each of the L, R, C and S
channels. These power levels are then used to calculate L/R and C/S dominance vectors whose vector sum defines a single dominance vector in the five-point sound field from which the
5 single dominant signal should emanate. The power levels and dominance vectors are time averaged to improve stability. The decoder scales the set of gain coefficients at the null point according to the dominance vectors to provide gain factors Hi. DTS Neo:6 decoder includes a multiband filter bank, a
10 matrix decoder and a synthesis filter, which together decode Lt and Rt and reconstruct the multi-channel output. Neo:6 computes L/R and C/S dominance vector for each subband and averages them using both a slow and fast average. Neo:6 uses the dominance vector to map the Lt, Rt subband signals into an
15 expanded 9-point sound field. Neo:6 computes gain coefficients for the vector in each subband based on the values of the gain coefficients in the sound field. This allows the subbands to be steered independently in a sound field that observes the motion picture channel configuration.
20
Matrix Decoder as a Correlator
As shown in Figure 6, a 2:4 matrix decoder 90 is designed to deconstruct Lt and Rt to reconstruct the L, R, C and S channels as encoded in equations 10 and 11. An analysis of
25 these equations shows that the L and R channels are independent in Lt and Rt, the C channel is perfectly correlated and the S channel is 180° out-of-phase.
Therefore, as shown in Figure 6, if Lt and Rt are simply two audio channels, and not matrix encoded channels, then the
30 reconstructed C channel will represent any in-phase correlated audio signals in Lt and Rt, the reconstructed S channel will represent any out-of-phase correlated audio signals and the

WO 2006/026463

PCT/US2005/030471

11
reconstructed L and R channels will represent independent audio signals from the two input audio channels. Note, a 2:3
matrix decoder in which the S channel is mixed into the L and R channels can be used if only the in-phase correlated signal is required.
The specific algorithm used to calculate the gain factors Hi will determine the degree of correlation, phase shift or independence captured in each of these channels. To illustrate, consider the following idealized cases:
10
Case 1: Lt, Rt highly correlated (Lt = Rt)
L HI and H2 = 0.354, -0.354,
C HI and H2 = 0.707, 0.707,
R HI and H2 = -0.354, 0.354, 15 S HI and H2 = 0.707, -0.707,
In this case, L, R and S will be 0 and C will contain equal amounts of both L and R. As expected, in-phase contribution will be large and the other components will be zero. . Depending on where the steering vector ends up new
20 coefficients are calculated from a grid of optimal ones using interpolation
Case 2: Lt, Rt complete out of phase (Lt •= -1.0*Rt)
L Gl and G2 = 0.354, 0.354,
25 C Gl and G2 = 0.5, 0.5,
R Gl and G2 = 0.354, 0.354,
S HI and H2 = 0.707, -0.707,
In this case, all of the outputs will be zero.
30 Case 3: Lt is dominate (Rt = 0)
L HI and H2 = 1.0, 0.0,

12

WO 2006/026463

PCT/US2005/030471

12
C HI and H2 = 0.0, 0.5,
R HI and H2 - 0.0, 0.707,
S HI and H2 = 0.0, -1,
In this case, all of the outputs are zero except for the 5 left channel which contains the left input.
Multi-Channel Automotive Audio System
As discussed above the motivation for the present invention was to improve the surround sound experience
10 provided by multi-channel audio such as provided by Dolby AC3 or DTS Coherent Acoustics. By mixing correlated audio signals, the multi-channel mixer provides the desired rebalanced of the multi-channel audio without producing unwanted artifacts or softening the discrete presentation of the audio.
15 As shown in Figures 7 and 8, a typical automotive sound system 100 a plurality of speakers 102 including at least L front and R front in the passenger cabin 104 of the car. In this example, speaker system also includes C front, R and L side and R and L rear and may include a C rear. A multi-
20 channel decoder 106 decodes multi-channel encoded audio from a disk 108 (or broadcast) into multiple discrete audio input channels including at least L front, C front and R front. In this 5.1 channel format right Rs and left Ls surround channels are also provided. The .1 or low frequency channel is not
25 shown.
A multi-channel mixer 110 mixes the discrete R,C,L channels using correlated outputs into the R,C,L channels for the respective speakers. Each channel is passed through a delay 112. The R and C and L and C channels are input to
30 correlators 114 and 116, respectively, which generate correlated audio signals 118 and 120. These correlated audio
13

WO 2006/026463

PCT/US2005/030471

13
signals 118 and 120 are mixed (multiplied by gain coefficients
Gi 122 and summed 124) with the adjacent channels. The mixed
channels are passed through equalizers 126 to the R,C, L output channels for playback on the R,C,L channel speakers.
5 In this particular application 5.1 audio is being mixed into a 7 speaker system, which is not uncommon. Because of typical home speaker configurations, 5.1 content is more common but many cars use 7 speaker systems. In this case the Rs and Ls discrete channels are mixed to the R side and R read
10 and L side and L rear, respectively. The Rs (Ls) channel is passed through a delay 130, split and multiplied by mixing coefficients 132. One branch is passed through an equalizer 134 and provided to the R read (L rear). The other branch is mixed with the mixed R (L) channel (delay 136, mixing
15 coefficient 138, and summing node 140), passed through an equalizer 142 and provided to the R side (L side).
If the content were provided in a 7.1 format, the R, R side and R rear discrete audio channels could be mixed using correlated outputs in a manner similar to that described for
20 the R,C,L. The left side channels could be similarly mixed. Furthermore, if the audio was available in an 8.1 format and the speaker system included a C rear speaker, all of the rear speakers could be so mixed.
As shown in Figure 9, the speaker system in the car is
25 not provided with a C front speaker. The 3 front channels (R,C,L) must be downmixed into only 2 channels (R,L). This is a common occurrence in non-automotive applications where the C channel speaker does not exist. The C channel is simply mixed into both the L and R speakers. In the automotive setting,
30 the same approach can be taken. However, the ideal coefficients for mixing the C channel may not be the same as

WO 2006/026463

PCT/US2005/030471

14
the desired coefficients for rebalancing and further may
create unwanted artifacts do to the out-of-phase correlated signals between the input channels.
Instead, the correlators 150 and 152 generate the in-
5 phase, out-of-phase, and pair of independent audio signals. The mixer now has the flexibility to mix the in-phase components as needed to rebalance the signal, discard the out-of-phase components to avoid phase distortion and mix the independent C channel to preserve the audio signals in that
10 channel.
The capability to flexibly downmix N channels into M where N>M in this manner will have applicability outside automotive applications. For example, content is being generated for new exhibition venues with more discrete
15 channels, e.g. 10.2. However, many of the commercial and consumer venues will have 5.1, 6.1 or 7.1 speaker configurations that will require downmixing.
While several illustrative embodiments of the invention have been shown and described, numerous variations and
20 alternate embodiments will occur to those skilled in the art. Such variations and alternate embodiments are contemplated, and can be made without departing from the spirit and scope of the invention as defined in the appended claims.

WE CLAIM;
1. A method of mixing audio channels, comprising:
Providing first and second audio input channels;
Correlating the first and second audio input channels to provide an in-phase correlated audio signal between the first and second audio input channels;
Multiplying the in-phase correlated audio signal by a first gain coefficient;
and
Mixing the in-phase correlated audio signal with the first audio input channel into a first audio output channel.
2. The method of claim 1, wherein the first and second audio input channels are correlated in a plurality of subbands to provide a like plurality of in-phase correlated audio signals in the respective subbands, each subband having its own first gain coefficient.
3. The method of claim 1, wherein the in-phase correlated signal represents the same or similar audio signals with little or no time or phase delay in the first and second audio input channels.
4. The method of claim 2, wherein correlating the first and second audio input channels further provides a separate independent signal representing audio signals present in the second input audio channel but not present in the first input audio channel, further comprising:
Multiplying the independent signal by a second gain coefficient; and Mixing the independent and in-phase correlated audio signals with the first audio input channel into the first audio output channel.
5. The method of claim 4, wherein the first and second audio input channels are
correlated in a plurality of subbands to provide a like plurality of in-phase
correlated audio signals and first independent signals in the respective
subbands, each subband having its own first gain coefficient.
16

6. The method of claim 4, wherein correlating the first and second audio input channels further provides a separate out-of-phase correlated signal.
7. The method of claim 6, wherein the out-of-phase correlated signal is discarded.
8. The method of claim 1, wherein the correlation is performed using one of neural networks, ICA, adaptive prediction or matrix decoding.
9. The method of claim 1, wherein the correlation of the first and second input channels is performed with a 2:3 matrix decoding to produce the in-phase correlated audio signal and separate first and second matrix signals that include independent audio signals for the first and second input channels, respectively, and out-of-phase correlated signals, wherein said in-phase audio signal is multiplied by the first gain coefficient arid mixed with said first input channel and said separate first and second matrix signals are discarded.
10. The method of claim 1, wherein the correlation of the first and second input
channels is performed by a 2:4 matrix decoding to produce the in-phase
correlated signal, a separate out-of-phase correlated signal and separate first
and second independent signals, further comprising:
Multiplying the first and second independent signals and said out-of-phase correlated signal by second, third and fourth gain coefficient, respectively; and
Mixing the first and second independent audio signals and out-of-phase correlated signal with the first audio input channel into the first audio output channel.
11. The method of claim 10, wherein the fourth gain coefficient is set to zero to
discard said out-of-phase signal.
17

12. The method of claim 1, wherein said first and second input channels are discrete channels of a multi-channel discrete audio signal.
13. A method of mixing audio channels, comprising:
Providing right CR), center (C) and left CL) audio input channels;
Correlating the R and C audio channels to provide a C-R in-phase correlated audio signal between the R and C channels and a C-R independent audio signal representing audio signals present in the C audio input channel but not present in the R audio input channel in respective audio channels;
Correlating the C and L audio channels to provide a C-L in-phase correlated audio signal between the L and C channels and a C-L independent audio signal representing audio signals present in the C audio input channel but not present in the L audio input channel in respective audio channels;
Multiplying the C-R in-phase correlated and C-R independent audio signals by respective gain coefficients and mixing them with the R input channel into a R output channel; and
Multiplying the C-L in-phase correlated and C-L independent audio signals by respective gain coefficients and mixing them with the L input channel into a L output channel.
14. The method of claim 13, wherein R and C and C and L input channels are correlated in a plurality of subbands to provide a like plurality of first and second in-phase correlated audio signals in the respective subbands, each subband having its own gain coefficient.
15. The method of claim 13, wherein correlating the R and C and L and C audio input channels further provides R-C and L-C independent signals that represent audio signals present in the R and L channels but not the C channel in respective audio channels further comprising:
Multiplying the C-R and C-L in-phase correlated audio signals and the R-C
and L-C independent signals by respective gain coefficients and mixing them
with the C input channel into a C output channel
18

16. The method of claim 13, wherein correlating the R and C audio input
channels further provides a C-R out-of phase correlated signal in an audio
channel and correlating the L and C audio input channels further provides a C-L out-of-phase correlated signal in an audio channel, further comprising:
Multiplying the C-R out-of-phase correlated signal by a negative gain coefficient to bring it in-phase and mixing it with the R audio input channel into the R output channel; and
Multiplying the C-L out-of-phase correlated signal by a negative gain coefficient to bring it in-phase and mixing it with the L audio input channel into the L output channel.
17. A method of mixing audio channels, comprising:
Providing first, second and third audio input channels;
Processing the first and second channels to provide a first in-phase correlated signal, a first out-of-phase correlated signal, and first and second independent signals;
Processing the second and third channels to provide a second in-phase correlated signal, a second out-of- phase correlated signal, and second and third independent signals;
Mixing the first in-phase correlated signal, a first out-of-phase correlated signal, and the first and second independent signals with the first input channel into a first output channel; and
Mixing the second in-phase correlated signal, a second out-of-phase correlated signal, and the second and third independent signals with the third input channel into a third output channel.
18. The method of claim 17, wherein the first and second out-of-phase correlated signals are discarded.
19. The method of claim 17, wherein said first and second channels and said second and third channels are each 2:4 matrix decoded to produce the signals.
19

20. An audio mixer, comprising:
A correlator that correlates first and second audio input channels to provide a an in-phase correlated audio signal between the first and second audio
input channels; and
A mixer that multiplies the in-phase correlated audio signal by a gain coefficient and mixes it with the first input channel into a first output channel.
21. The audio mixer of claim 20, wherein the first and second audio input channels are correlated in a plurality of subbands to provide a like plurality of in-phase correlated audio signals in the respective subbands, each subband having its own gain coefficient.
22. The audio mixer of claim 20, wherein the correlator further provides a separate independent signal representing audio signals present in said second audio input channel but not the first audio input channel, said mixer multiplying the independent signal by a gain coefficient and mixing it with the first input channel into the first output channel.
23. An audio mixer, comprising:
a decoder that receives multi-channel encoded audio data and outputs multiple discrete audio input channels including at least left (L) , center (C) and right CR) channels,
a first matrix decoder that matrix decodes the R and C channels to produce a first in-phase correlated audio signal;
a first mixer that mixes the first in-phase correlated audio signal with the R input channel into a R output channel;
a second matrix decoder that matrix decodes the L and C channels to produce a second in-phase correlated audio signal; and
a second mixer that mixes the second in-phase correlated audio signal with the L input channel into a 1 output channel.
20

24. The audio mixer of claim 23, wherein said first and second matrix decoders comprise 2:3 decoders that output left and right channels that are discarded and a center channel that provides the in-phase correlated audio signal.
25. The audio mixer of claim 23, wherein said first and second matrix decoders comprise 2:4 decoders that output left and right channels that provide R and C and L and C independent audio signals, respectively, output a center channel that provides the in-phase correlated audio signal, and output a surround channel that provides an out-of-phase correlated audio signal that is discarded.
26. An audio system, comprising:
an automobile having a passenger cabin;
a plurality of speakers including at least L front and R front in the passenger cabin;
A multi-channel decoder for decoding multi-channel encoded audio into multiple discrete audio input channels including at least L front, C front and R front; and
A multi-channel mixer that
Correlates the R and C audio channels and C and L audio channels to provide C-R and C-L in-phase correlated audio signals and C-R and C-L independent audio signals representing audio signals in the C audio input channel not present in the R and L channels, respectively;
Multiplies the C-R in-phase correlated audio signal and C-R independent audio signal by respective gain coefficients and mixes them with the R input channel into a R output channel that is directed to the P. front speaker; and
Multiplies the C-L in-phase correlated audio signal and C-L independent audio signal by respective gain coefficients and mixes them with the L input channel into a L output channel that is directed to the L front speaker.
21

27. The audio system of claim 26, wherein the P. and C and C and L audio channels are correlated in a plurality of subbands to provide a like plurality of first and second in-phase correlated audio signals in the respective subbands, each subband having its own gain coefficient.
28. The audio system of any of the preceding claims, wherein correlating the P. and C audio channels and C and L audio channels further provides C-R and C-L out-of-phase correlated signals that are inverted and multiplied by respective gain coefficients to bring them in-phase and mixed with the P. and L input audio channels, respectively.
29. The audio system of claim 26, wherein correlating the P. and C audio channels and C and L audio channels further provides R-C and L-C independent signals including audio signals present in the R and L audio channels but not present in the C audio channel, respectively, said mixer multiplying the C-R and C-L inphase correlated signals and R-C and L-C independent signals by respective gain coefficients and mixing them with the C input channel into a C output channel that is directed to a C front speaker.

Dated this 23rd February, 2007

22

■

ABSTRACT
METHOD OF MIXING AUDIO CHANNELS USING CORRELATED OUTPUTS
A method of mixing audio channels (R, C, L) is effective at rebalancing the audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels (R, C, L) by processing the audio channels to generate one or more 'correlated' audio signals for each pair of input channels. The in-phase correlated signal (150, 152) representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels. The present approach may also generate an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that may be mixed with the input channels.
23

Documents:

http://ipindiaonline.gov.in/patentsearch/GrantedSearch/viewdoc.aspx?id=4dNj2liX+KOiOuF6GxUnow==&loc=vsnutRQWHdTHa1EUofPtPQ==

« Previous Patent

Next Patent »

Patent Number

270500

Indian Patent Application Number

280/MUMNP/2007

PG Journal Number

01/2016

Publication Date

01-Jan-2016

Grant Date

28-Dec-2015

Date of Filing

23-Feb-2007

Name of Patentee

DTS, INC.

Applicant Address

5520 LAS VIRGENES RD.,CALABASAS, CALIFORNIA 91302,UNITED STATES OF AMERICA

Inventors:

#	Inventor's Name	Inventor's Address
1	SMITH WILLIAM PAUL	6 RAGLAN ROAD, BANGOR.CO.DOWN, N.IRELAND,BT203TL

PCT International Classification Number

H04B1/00

PCT International Application Number

PCT/US2005/030471

PCT International Filing date

2005-08-26

PCT Conventions:

#	PCT Application Number	Date of Convention	Priority Country
1	10/930,659	2004-08-31	U.S.A.