Fast Algorithms for Multidimensional Signals

Similar to 1-D Digital signal processing in case of the Multidimensional signal processing[1] we have Efficient algorithms. The efficiency of an Algorithm can be evaluated by the amount of computational resources it takes to compute output or the quantity of interest. In this page, two of the very efficient algorithms for multidimensional signals are explained. For the sake of simplicity and description it is explained for 2-D Signals. However, same theory holds good for M-D signals. The exact computational savings for each algorithm is also mentioned.

## Contents

* 1 Motivation and applications
* 2 Problem Statement and Basics
* 3 Fast Algorithms for Multidimensional signals
* 3.1 Row Column Decomposition approach for the evaluation of DFT
* 3.2 Vector Radix Fast Fourier Transform
* 4 See also
* 5 References

## Motivation and applications

In the case of digital systems, a mathematical expressions can be used to describe the input-output relationship and an algorithm can be used to implement this relationship. Similarly, algorithms can be developed to implement different transforms such as Digital filter, Fourier transform, Histogram, Image Enhancements, etc. Direct implementation [2] of these input-output relationships and transforms is not necessarily the most efficient way to implement those.

When people began to compute such outputs from input through direct implementation, they began to look for more efficient ways. This wiki page aims at showcasing such efficient and fast algorithms for multidimensional signals and systems. A multidimensional (M-D) signal can be modeled as a function of M independent variables, where M is greater than or equal to 2. These signals may be categorized as continuous, discrete, or mixed. A continuous signal can be modeled as a function of independent variables which range over a continuum of values, example – an audio wave travelling in space, 3-D space waves measured at different times. A discrete signal, on the other hand, can be modeled as a function defined only on a set of points, such as the set of integers. An image is the simplest example of a 2-D discrete domain signal that is spatial in nature.

In the context of Fast Algorithms, consider the example below:

We need to compute A which is given by

A = αγ + αδ + βγ + βδ where α,β,γ and δ are complex variables.

To compute A, we need 4 complex multiplications and 3 complex additions. The above equation can be written in its simplified form as

A = (α + β)(γ + δ)

This form requires only 1 complex multiplication and 2 complex additions.

Thus the second way of computing A is much more efficient and fast compared to the first method of computing A. This is the motivation for the evolution of the fast algorithms in the digital signal processing Field. Consequently, many of the real-world applications make use of these efficient Algorithms for fast computations.

## Problem Statement and Basics

The simplest form of representing a Linear Shift Invariant system(LSI) is through its Impulse response. The output of such LSI discrete domain system is given by the convolution of its input signal and system's impulse response. This is mathematically represented as follows:

y(n1,n2)=∑l1=−∞+∞∑l2=∞+∞x(l1,l2)h(n1−l1,n2−l2)

where h(n1,n2) is the impulse response of the system.

According to the equation above to obtain the Output value at a particular point ( say y(0,0)) we need to multiply several values of the input x(l1,l2) and Impulse Response h(−l1,−l2). Of course this is dependent on the Region of Support of the input as well as the impulse response. The key point here to be noted is that we need to perform so many complex multiplications and additions to obtain 1 output value.

Assuming a 2-D input signal is of length M×M and the system's impulse response is of length N×N we need to perform M2N2 number of multiplications to obtain all output values. The output can be computed efficiently if one can exploit some characteristics of the system.

We encounter a similar scenario when we have to compute the discrete Fourier Transforms of a signal of interest.

The Direct Calculation of the 2-D DFT is simply the evaluation of the double Sum [3]

X(k1,k2)=∑n1=0N1−1∑n2=0N2−1x(n1,n2)WN1n1k1WN2n2k2 for 0≤k1≤N1−1 and 0≤k2≤N2−1

where WN≡exp(−j2πN)

The total number of complex multiplications and complex additions needed to evaluate this 2-D DFT by direct calculation is N12N22. This is a naive approach, however, we already know that an N-point 1-D DFT can be computed with far fewer than N2 multiplications by using the Fast Fourier Transform (FFT) algorithm. As described in the next section we can develop Fast Fourier transforms for calculating 2-D or higher dimensional DFTs as well [3]

## Fast Algorithms for Multidimensional signals

### Row Column Decomposition approach for the evaluation of DFT

Source:[3]

The DFT sum X(k1,k2) in the previous equation can also be written in the following form

X(k1,k2)=∑n1=0N1−1[∑n2=0N2−1x(n1,n2)WN2n2k2]WN1n1k1

Let G(n1,k2) denote the quantity inside the brackets and is given by:

G(n1,k2)=∑n2=0N2−1x(n1,n2)WN2n2k2

X(k1,k2)=∑n1=0N1−1G(n1,k2)WN1n1k2

Employing this method the DFT X can be computed as multiple 1-D DFTs. That is, each column of G can be considered as a 1-D DFT of the corresponding column of x(n1 = constant). And each row of X is the 1-DFT of the corresponding row of the G(n2 = constant). Hence we are computing the 2-D DFT by decomposing it into Row and Column DFTs.

The same principle is employed for evaluating the M-D DFT of a M - dimensional signal.

Now let's talk about the computational savings we get using this approach. It is observed that we require N1N2(N1+N2) complex additions and multiplications. Further, if each of these 1-D DFT is computed using a 1-D FFT, the number of complex multiplications can be further reduced to N1N2log2N1N22

### Vector Radix Fast Fourier Transform

Source:[3]

Just like the 1-D FFT, decimation in time can be achieved in the case of 2-D Signals. The 1-D DFT of a signal whose length is a power of 2, can be expressed in terms of two half-length DFTs, each of these can again be expressed as a combination of quarter length DFTs and so on.

In the case of 2-D signals we can express the (N1 x N2) DFT in terms of four N12 x N22 DFTs (assuming N1 and N2 are powers of 2). For the sake of simplicity let us assume that N1=N2=N. The DFT double sum can be decomposed into four separate summations, one over those samples of x for which both n1 and n2 are even, one for which n1 is even and n2 is odd, one for which n1 is odd and n2 is even and the last one for which n1 and n2 are odd.

This is written as :

X(k1,k2)=S00(k1,k2)+S01(k1,k2)WNk2+S10(k1,k2)WNk1+S11(k1,k2)WNk1+k2

where

S00(k1,k2)≡∑m1=0N/2−1∑m2=0N/2−1x(2m1,2m2)WN2m1k1+2m2k2

S01(k1,k2)≡∑m1=0N/2−1∑m2=0N/2−1x(2m1,2m2+1)WN2m1k1+2m2k2

S10(k1,k2)≡∑m1=0N/2−1∑m2=0N/2−1x(2m1+1,2m2)WN2m1k1+2m2k2

S11(k1,k2)≡∑m1=0N/2−1∑m2=0N/2−1x(2m1+1,2m2+1)WN2m1k1+2m2k2

All the arrays S00S01S10 and S11 are each periodic in (k1,k2) with horizontal and vertical periods N2. Using this fact and also the fact that WNN/2=−1, we can obtain the following identities :

X(k1,k2)=S00(k1,k2)+S01(k1,k2)WNk2+S10(k1,k2)WNk1+S11(k1,k2)WNk1+k2

X(k1+N2,k2)=S00(k1,k2)+S01(k1,k2)WNk2−S10(k1,k2)WNk1−S11(k1,k2)WNk1+k2

X(k1,k2+N2)=S00(k1,k2)−S01(k1,k2)WNk2+S10(k1,k2)WNk1−S11(k1,k2)WNk1+k2

X(k1+N2,k2+N2)=S00(k1,k2)−S01(k1,k2)WNk2−S10(k1,k2)WNk1+S11(k1,k2)WNk1+k2

The above equation tell us how to compute the four DFT points X(k1,k2)X(k1+N2,k2)X(k1,k2+N2) and X(k1+N2,k2+N2) for a particular value of (k1,k2) from the four points S00(k1,k2)S01(k1,k2)S10(k1,k2) and S11(k1,k2). S00(k1,k2) can be obtained by evaluating a (N2×N2) -point DFT (similarly other Sij can be obtained).

Thus we see that the N×N DFT can be expressed in terms of four N2×N2 DFTs.

By analogy from the 1-D case, the computation depicted in the below figure is called a butterfly or more precisely radix−(2×2) butterfly .

Each butterfly requires three complex multiplications and eight complex additions for the calculation of outputs from the inputs. And to compute all the samples of X from S00(k1,k2),S01(k1,k2),S10(k1,k2) and S11(k1,k2) it requires calculations of N24 butterflies.

This decimation procedure is performed log2N times when N is a power of 2. Each stage of decimation consists of N24 butterflies, and each butterfly involves three complex multiplications and eight complex additions and hence the number of complex multiplications that needs to be performed during the computation of an (N×N) -point radix (2×2) FFT is given by

CvectorRadix(2×2)=3N24log2N

## See also

* Fast Fourier transform
* Multidimensional transform
* Multidimensional sampling
* Multidimensional discrete convolution
* Multidimensional filter design and Implementation

## References

1. ↑ Bose, N.K., ed (1985). Multidimensional Systems Theory, Progress, Directions and Open Problems in Multidimensional Systems. Dordrecht, Holland: D. Reidel Publishing Company.
2. ↑ Fast Algorithms for Signal Processing by Richard E. Blahut, Cambridge University Press 2010
3. ↑ 3.0 3.1 3.2 3.3 Dan E. Dudgeon, Russell M. Mersereau, “Multidimensional Digital Signal Processing”, Prentice-Hall Signal Processing Series, ISBN 0136049591, 1983.

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Fast Algorithms for Multidimensional Signals. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Fast_Algorithms_for_Multidimensional_Signals&oldid=210020"