|
|
| (One intermediate revision by one other user not shown) |
| Line 1: |
Line 1: |
| The '''circular convolution''', also known as '''cyclic convolution''', of two aperiodic functions (i.e. [[Schwartz functions]]) occurs when one of them is [[convolution|convolved in the normal way]] with a [[periodic summation]] of the other function. That situation arises in the context of the [[Discrete_Fourier_transform#Circular_convolution_theorem_and_cross-correlation_theorem|Circular convolution theorem]]. The identical operation can also be expressed in terms of the periodic summations of <u>both</u> functions, if the infinite integration interval is reduced to just one period. That situation arises in the context of the [[discrete-time Fourier transform]] (DTFT) and is also called '''periodic convolution'''. In particular, the DTFT of the product of two discrete sequences is the periodic convolution of the DTFTs of the individual sequences.<ref>If a sequence, ''x''[''n''], represents samples of a continuous function, ''x''(''t''), with Fourier transform ''X''(ƒ), its DTFT is a periodic summation of ''X''(ƒ). (see [[Discrete-time_Fourier_transform#Relationship_to_sampling]])</ref>
| | Alyson is the title people use to call me and I believe it sounds quite good when you say it. For years free online tarot card readings - [https://www.machlitim.org.il/subdomain/megila/end/node/12300 www.machlitim.org.il], he's been residing in Mississippi and he doesn't plan on altering it. To play lacross is some thing I really enjoy performing. My day occupation is [http://brazil.amor-amore.com/irboothe free psychic readings] an invoicing officer but I've already utilized for an additional 1.<br><br>Here is my site :: live psychic reading; [http://Findyourflirt.net/index.php?m=member_profile&p=profile&id=117823 http://Findyourflirt.net], |
| | |
| Let ''x'' be a function with a well-defined periodic summation, ''x''<sub>''T''</sub>, where:
| |
| | |
| :<math> x_T(t) \ \stackrel{\mathrm{def}}{=} \ \sum_{k=-\infty}^\infty x(t - kT) = \sum_{k=-\infty}^\infty x(t + kT).</math>
| |
| | |
| If ''h'' is any other function for which the convolution ''x''<sub>''T''</sub> ∗ ''h'' exists, then the convolution ''x''<sub>''T''</sub> ∗ ''h'' is periodic and identical to''':'''
| |
| | |
| :<math>
| |
| \begin{align}
| |
| (x_T * h)(t)\quad &\stackrel{\mathrm{def}}{=} \ \int_{-\infty}^\infty h(\tau)\cdot x_T(t - \tau)\,d\tau \\
| |
| &\equiv \int_{t_o}^{t_o+T} h_T(\tau)\cdot x_T(t - \tau)\,d\tau,
| |
| \end{align}
| |
| </math><ref>Proof''':'''
| |
| | |
| :<math>\int_{-\infty}^\infty h(\tau)\cdot x_T(t - \tau)\,d\tau</math>
| |
| :::<math>
| |
| \begin{align}
| |
| &= \sum_{k=-\infty}^\infty \left[\int_{t_o+kT}^{t_o+(k+1)T} h(\tau)\cdot x_T(t - \tau)\ d\tau\right] \\
| |
| &\stackrel{\tau \rightarrow \tau+kT}{=}\ \sum_{k=-\infty}^\infty \left[\int_{t_o}^{t_o+T} h(\tau+kT)\cdot x_T(t - \tau -kT)\ d\tau\right] \\
| |
| &= \int_{t_o}^{t_o+T} \left[\sum_{k=-\infty}^\infty h(\tau+kT)\cdot \underbrace{x_T(t - \tau-kT)}_{X_T(t - \tau), \text{ by periodicity}}\right]\ d\tau\\
| |
| &= \int_{t_o}^{t_o+T} \underbrace{\left[\sum_{k=-\infty}^\infty h(\tau+kT)\right]}_{\stackrel{\mathrm{def}}{=} \ h_T(\tau)}\cdot x_T(t - \tau)\ d\tau \quad \quad \scriptstyle{(QED)}
| |
| \end{align}
| |
| </math>
| |
| </ref>
| |
| | |
| where ''t''<sub>o</sub> is an arbitrary parameter and ''h''<sub>''T''</sub> is a [[periodic summation]] of ''h''.
| |
| | |
| The second integral is called the '''periodic convolution'''<ref>Jeruchim 2000, pp 73-74.</ref><ref name="Uday">Udayashankara 2010, p 189.</ref> of functions ''x''<sub>''T''</sub> and ''h''<sub>''T''</sub> and is sometimes normalized by 1/''T''.<ref>Oppenheim, pp 388-389</ref> When ''x''<sub>''T''</sub> is expressed as the [[periodic summation]] of another function, ''x'', the same operation may also be referred to as a '''circular convolution'''<ref name="Uday"/><ref>Priemer 1991, pp 286-289.</ref> of functions ''h'' and ''x''.
| |
| | |
| == Discrete sequences ==
| |
| Similarly, for discrete sequences and period '''N''', we can write the '''circular convolution''' of functions ''h'' and ''x'' as''':'''
| |
| | |
| :<math>
| |
| \begin{align}
| |
| (x_N * h)[n] \ &\stackrel{\mathrm{def}}{=} \ \sum_{m=-\infty}^\infty h[m] \cdot x_N[n-m] \\
| |
| &= \sum_{m=-\infty}^\infty \left( h[m] \cdot \sum_{k=-\infty}^\infty x[n -m -kN] \right).
| |
| \end{align}
| |
| </math>
| |
| | |
| For the special case that the non-zero extent of both x and h are ≤ N, this is reducible to [[matrix multiplication]] where the kernel of the integral transform is a [[circulant matrix]].
| |
| | |
| == Example ==
| |
| [[Image:Circular convolution example.png|right|frame|488x516px]]
| |
| A case of great practical interest is illustrated in the figure. The duration of the '''x''' sequence is '''N''' (or less), and the duration of the '''h''' sequence is significantly less. Then many of the values of the circular convolution are identical to values of '''x∗h''', which is actually the desired result when the '''h''' sequence is a [[finite impulse response]] (FIR) filter. Furthermore, the circular convolution is very efficient to compute, using a [[fast Fourier transform]] (FFT) algorithm and the [[Discrete_Fourier_transform#Circular_convolution_theorem_and_cross-correlation_theorem|circular convolution theorem]].
| |
| | |
| There are also methods for dealing with an '''x''' sequence that is longer than a practical value for '''N'''. The sequence is divided into segments (''blocks'') and processed piecewise. Then the filtered segments are carefully pieced back together. Edge effects are eliminated by <u>overlapping</u> either the input blocks or the output blocks. To help explain and compare the methods, we discuss them both in the context of an '''h''' sequence of length 201 and an FFT size of ''N'' = 1024.
| |
| | |
| '''Overlapping input blocks'''
| |
| | |
| This method uses a block size equal to the FFT size (1024). We describe it first in terms of normal or ''linear'' convolution. When a normal convolution is performed on each block, there are start-up and decay transients at the block edges, due to the filter ''latency'' (200-samples). Only 824 of the convolution outputs are unaffected by edge effects. The others are discarded, or simply not computed. That would cause gaps in the output if the input blocks are contiguous. The gaps are avoided by overlapping the input blocks by 200 samples. In a sense, 200 elements from each input block are "saved" and carried over to the next block. This method is referred to as '''[[Overlap-save method|overlap-save]]''',<ref>Rabiner 1975, pp 65–67.</ref> although the method we describe next requires a similar "save" with the output samples.
| |
| | |
| When the DFT or FFT is used, we don't have the option of not computing the affected samples, but the leading and trailing edge-effects are overlapped and added because of circular convolution. Consequently, the 1024-point inverse FFT (IFFT) output contains only 200 samples of edge effects (which are discarded) and the 824 unaffected samples (which are kept). To illustrate this, the fourth frame of the figure at right depicts a block that has been periodically (or "circularly") extended, and the fifth frame depicts the individual components of a linear convolution performed on the entire sequence. The edge effects are where the contributions from the extended blocks overlap the contributions from the original block. The last frame is the composite output, and the section colored green represents the unaffected portion.
| |
| | |
| '''Overlapping output blocks'''
| |
| | |
| This method is known as '''[[Overlap-add method|overlap-add]]'''.<ref>Rabiner 1975, pp 63–65.</ref> In our example, it uses contiguous input blocks of size 824 and pads each one with 200 zero-valued samples. Then it overlaps and adds the 1024-element output blocks. Nothing is discarded, but 200 values of each output block must be "saved" for the addition with the next block. Both methods advance only 824 samples per 1024-point IFFT, but overlap-save avoids the initial zero-padding and final addition.
| |
| | |
| == See also ==
| |
| *[[Hilbert_transform#Discrete_Hilbert_transform|Discrete Hilbert transform]]
| |
| *[[Circulant matrix]]
| |
| | |
| == Notes ==
| |
| {{Reflist}}
| |
| | |
| == References ==
| |
| *Rabiner, Lawrence R.; Gold, Bernard (1975). ''Theory and application of digital signal processing''. Englewood Cliffs, N.J.: Prentice-Hall. pp 63–67. [http://isbndb.com/d/book/theory_and_application_of_digital_signal_processing.html ISBN 0139141014]
| |
| *Oppenheim, Alan V.; Schafer, Ronald W.; Buck, John A. (1999). ''Discrete-time signal processing''. Upper Saddle River, N.J.: Prentice Hall. [http://isbndb.com/d/book/discrete_time_signal_processing_a02.html ISBN 0137549202].
| |
| *Priemer, Roland (July 1991). ''Introductory Signal Processing (Advanced Series in Electrical and Computer Engineering) (v. 6)''. Teaneck, N.J.: World Scientific Pub Co Inc. [http://books.google.com/books?id=QBT7nP7zTLgC&printsec=frontcover&dq=Priemer,+Roland&hl=en&sa=X&ei=J2owUZzANIb_ygGex4HAAg&ved=0CC8Q6AEwAA ISBN 9971509199].
| |
| *Jeruchim, Michel C.; Philip Balaban, K. Sam Shanmugan (October 2000). ''Simulation of Communication Systems: Modeling, Methodology and Techniques'' (2nd ed.). New York: Kluwer Academic Publishers. [http://isbndb.com/d/book/simulation_of_communication_systems_a01.html ISBN 0306462672].
| |
| *Udayashankara, V. (June 2010). ''Real Time Digital Signal Processing''. India: Prentice-Hall. [http://isbndb.com/d/book/real_time_digital_signal_processing_a05.html ISBN 8120340493].
| |
| *{{cite book | author=Oppenheim, Alan V.; Willsky, with S. Hamid | title=Signals and Systems | publisher=Pearson Education | year=1998 | isbn=0-13-814757-4}}.
| |
| | |
| [[Category:Functional analysis]]
| |
| [[Category:Image processing]]
| |
| [[Category:Binary operations]]
| |
Alyson is the title people use to call me and I believe it sounds quite good when you say it. For years free online tarot card readings - www.machlitim.org.il, he's been residing in Mississippi and he doesn't plan on altering it. To play lacross is some thing I really enjoy performing. My day occupation is free psychic readings an invoicing officer but I've already utilized for an additional 1.
Here is my site :: live psychic reading; http://Findyourflirt.net,