Motions in the time-frequency distribution

Modification of frequency and time distributions of signals, as used in computer graphics

Several techniques can be used to move signals in the time-frequency distribution. Similar to computer graphic techniques, signals can be subjected to horizontal shifting, vertical shifting, dilation (scaling), shearing, rotation, and twisting. These techniques can help to save the bandwidth with proper motions apply on the signals. Moreover, filters with proper motion transformation can save the hardware cost without additional filters.

The following examples assume time in the horizontal axis versus frequency in the vertical axis. As a coincident, the following transformations happen to have the motion properties in the time-frequency distribution.

## Shifting[edit]

Shifting on time axis is like horizontal shifting in time-frequency distribution. On another hand, shifting on the frequency axis would be vertical shifting in time-frequency distribution.

### Horizontal shifting[edit]

If t0 is greater than 0, we would be shifting the signal to the right on time axis. (negative would be left)

STFT, Gabor:

x ( t − t 0 ) -> S x ( t − t 0 , f ) e − j 2 π f t 0 {\displaystyle x(t-t_{0})\rightarrow S_{x}(t-t_{0},f)e^{-j2\pi ft_{0}}}

WDF:

x ( t − t 0 ) -> W x ( t − t 0 , f ) {\displaystyle x(t-t_{0})\rightarrow W_{x}(t-t_{0},f)\,}

### Vertical shifting[edit]

If f0 is greater than 0, we would be shifting the signal to the upward on frequency axis. (negative would be downward)

STFT, Gabor:

e j 2 π f 0 t x ( t ) -> S x ( t , f − f 0 ) {\displaystyle e^{j2\pi f_{0}t}x(t)\rightarrow S_{x}(t,f-f_{0})}

WDF:

e j 2 π f 0 t x ( t ) -> W x ( t , f − f 0 ) {\displaystyle e^{j2\pi f_{0}t}x(t)\rightarrow W_{x}(t,f-f_{0})}

This results in an amplitude modulation signal. This sort of shift is also used in a frequency extender. This sort of shift is also used in most bat detectors.

Such an effect is typically implemented using heterodyning

## Dilation[edit]

Dilation is like doing scaling on one of the axis and area is the same after the process. When a > 1, it's expanding on time axis, and narrowing on frequency axis ;vice versa when a < 1\.

STFT, Gabor:

1 | a | x ( t a ) ->≈ S x ( t a , a f ) {\displaystyle {\frac {1}{\sqrt {|a|}}}x({\frac {t}{a}})\rightarrow \approx S_{x}({\frac {t}{a}},af)}

WDF:

1 | a | x ( t a ) -> W x ( t a , a f ) {\displaystyle {\frac {1}{\sqrt {|a|}}}x({\frac {t}{a}})\rightarrow W_{x}({\frac {t}{a}},af)}

When this kind of dilation is applied to audio, it causes a chipmunk effect.

## Time stretching[edit]

Main article: Audio time stretching and pitch scaling

Time stretching is doing scaling only on the time axis, leaving frequencies the same. When  a < 1 {\displaystyle a<1} (the most common case), it's narrowing on the time axis, reducing the area.

STFT, Gabor:

≈ S x ( a t , f ) {\displaystyle \approx S_{x}(at,f)}

WDF:

≈ W x ( a t , f ) {\displaystyle \approx W_{x}(at,f)}

## Shearing[edit]

Shearing by definition is moving the side of the signal on one direction. Vertical and Horizontal shearing is introduced here.

### On Vertical axis only (frequency)[edit]

It's shearing on frequency axis, since this only changes the phase.

x ( t ) = e j π a t 2 y ( t ) {\displaystyle x(t)=e^{j\pi at^{2}}y(t)\,}

STFT, Gabor:

S x ( t , f ) ≈ S y ( t , f − a t ) {\displaystyle S_{x}(t,f)\approx S_{y}(t,f-at)\,}

WDF:

W x ( t , f ) = W y ( t , f − a t ) {\displaystyle W_{x}(t,f)=W_{y}(t,f-at)\,}

### On Horizontal axis only (time)[edit]

It's shearing on time axis, since this only changes the time.

x ( t ) = e j π t 2 a y ( t ) {\displaystyle x(t)=e^{j\pi {\frac {t^{2}}{a}}}y(t)\,}

STFT, Gabor:

S x ( t , f ) ≈ S y ( t − a f , f ) {\displaystyle S_{x}(t,f)\approx S_{y}(t-af,f)\,}

WDF:

W x ( t , f ) = W y ( t − a f , f ) {\displaystyle W_{x}(t,f)=W_{y}(t-af,f)\,}

## Generalized Shearing[edit]

Transforming the time-frequency distribution from a band-like pattern to a curved shape requires the use of polynomials of order three or higher with respect to  ϕ ( t ) {\displaystyle \phi (t)} . It is beneficial for implementing higher-order modulation, and furthermore, it reduces bandwidth, allowing for lower sampling rates and decreased white noise through filtering.

### On Vertical axis only (frequency)[edit]

It's shearing on frequency axis, since this only changes the phase.

x ( t ) = e j ϕ ( t ) y ( t ) {\displaystyle x(t)=e^{j\phi (t)}y(t)\,}

ϕ ( t ) = ∑ k = 0 n a k t k {\displaystyle \phi (t)=\sum \limits _{k=0}^{n}a_{k}t^{k}\,}

STFT, Gabor:

S x ( t , f ) ≈ S y ( t , f − ∑ k = 1 n k a k 2 π t k − 1 ) {\displaystyle S_{x}(t,f)\approx S_{y}(t,f-\sum \limits _{k=1}^{n}{\frac {ka_{k}}{2\pi }}t^{k-1})\,}

WDF:

W x ( t , f ) ≈ W y ( t , f − ∑ k = 1 n k a k 2 π t k − 1 ) {\displaystyle W_{x}(t,f)\approx W_{y}(t,f-\sum \limits _{k=1}^{n}{\frac {ka_{k}}{2\pi }}t^{k-1})\,}

### On Horizontal axis only (time)[edit]

It's shearing on time axis, since this only changes the time.

x ( t ) = h ( t ) ∗ y ( t ) {\displaystyle x(t)=h(t)*y(t)\,}

h ( t ) = I F T ( e x p ( j ∑ k = 0 n a k f k ) ) {\displaystyle h(t)=IFT(exp(j\sum \limits _{k=0}^{n}a_{k}f^{k}))\,}

STFT, Gabor:

S x ( t , f ) ≈ S y ( t + ∑ k = 1 n k a k 2 π f k − 1 , f ) {\displaystyle S_{x}(t,f)\approx S_{y}(t+\sum \limits _{k=1}^{n}{\frac {ka_{k}}{2\pi }}f^{k-1},f)\,}

WDF:

W x ( t , f ) ≈ W y ( t + ∑ k = 1 n k a k 2 π f k − 1 , f ) {\displaystyle W_{x}(t,f)\approx W_{y}(t+\sum \limits _{k=1}^{n}{\frac {ka_{k}}{2\pi }}f^{k-1},f)\,}

## Rotation[edit]

Many transforms has the property of rotations, like Gabor-Wigner, Ambiguity function (counterclockwise), modified Wigner, Cohen's class distribution.

STFT, Gabor, and WDF is introduced in here.

### Clockwise rotation by 90 degrees[edit]

By switching the time and negative frequency to frequency and time would act like rotating 90 degrees clockwise.

X ( f ) = F T ( x ( t ) ) {\displaystyle X(f)=FT(x(t))\,}

STFT:

| S X ( t , f ) | ≈ | S x ( − f , t ) | {\displaystyle |S_{X}(t,f)|\approx |S_{x}(-f,t)|\,}

Gabor:

G X ( t , f ) = G x ( − f , t ) e − j 2 π f t {\displaystyle G_{X}(t,f)=G_{x}(-f,t)e^{-j2\pi ft}\,}

WDF:

W X ( t , f ) = W x ( − f , t ) {\displaystyle W_{X}(t,f)=W_{x}(-f,t)\,}

### Counterclockwise rotation by 90 degrees[edit]

By switching the negative time and frequency to frequency and time would act like rotating 90 degrees counterclockwise.

If  X ( f ) = I F T [ x ( t ) ] = ∫ − ∞ ∞ x ( t ) e j 2 π f t d t {\displaystyle X(f)=IFT[x(t)]=\int _{-\infty }^{\infty }x(t)e^{j2\pi ft}\,dt} , then

W X ( t , f ) = W x ( f , − t ) {\displaystyle W_{X}(t,f)=W_{x}(f,-t)\,}

G X ( t , f ) = G x ( f , − t ) e j 2 π t f {\displaystyle G_{X}(t,f)=G_{x}(f,-t)e^{j2\pi tf}\,}

### Rotation by 180 degrees[edit]

Changing the sign of both time and frequency would be like flipping twice on both axis, and it ends up like doing 180 degrees rotation.

If  X ( f ) = x ( − t ) {\displaystyle X(f)=x(-t)\,} , then

W X ( t , f ) = W x ( − t , − f ) {\displaystyle W_{X}(t,f)=W_{x}(-t,-f)\,}

G X ( t , f ) = G x ( − t , − f ) {\displaystyle G_{X}(t,f)=G_{x}(-t,-f)\,}

## Rotation: Fractional Fourier Transform (FRFTs)[edit]

Rotating the time-frequency distribution by the angle other than  π / 2 , π , 3 π / 2 {\displaystyle \pi /2,\pi ,3\pi /2} and  2 π {\displaystyle 2\pi } . Compared to Fourier Transform, it transform signal from time domain to fractional domain, domain between time and frequency.

X ϕ ( u ) = 1 − j c o t ϕ e j π c o t ϕ u 2 ∫ − ∞ ∞ e − j 2 π c s c ϕ u t e j π c o t ϕ t 2 x ( t ) d t , ϕ = 0.5 a π {\displaystyle X_{\phi }(u)={\sqrt {1-jcot\phi }}e^{j\pi cot\phi u^{2}}\int _{-\infty }^{\infty }e^{-j2\pi csc\phi ut}e^{j\pi cot\phi \ t^{2}}x(t)dt,\quad \phi =0.5a\pi }

For Fourier Transform,  a = 1 , ϕ = 0.5 π {\displaystyle a=1,\,\phi =0.5\pi } and  c s c ϕ = 1 , c o t ϕ = 0 {\displaystyle csc\phi =1,\,cot\phi =0}

It is equivalent to the clockwise rotation operation with angle  ϕ {\displaystyle \phi } . for Wigner distribution funciton and Gabor transform.

Gabor:

| G X ϕ ( u , v ) | = | G x ( u c o s ϕ − v s i n ϕ , u s i n ϕ + v c o s ϕ ) | {\displaystyle |G_{X_{\phi }}(u,v)|=|G_{x}(ucos\phi -vsin\phi ,usin\phi +vcos\phi )|\,}

WDF:

W X ϕ ( u , v ) = W x ( u c o s ϕ − v s i n ϕ , u s i n ϕ + v c o s ϕ ) {\displaystyle W_{X_{\phi }}(u,v)=W_{x}(ucos\phi -vsin\phi ,usin\phi +vcos\phi )\,}

## Twisting: Linear Canonical Transform (LCT)[edit]

The Linear Canonical Transform makes arbitrary linear and integral transformation of a time-frequency distribution.

F ( a , b , c , d ) ( u ) = 1 j b e j π d b u 2 ∫ − ∞ ∞ e − j 2 π 1 b u t e − j π a b t 2 x ( t ) d t , b ≠ 0 {\displaystyle F_{(a,b,c,d)}(u)={\sqrt {\frac {1}{jb}}}e^{j\pi {\frac {d}{b}}u^{2}}\int _{-\infty }^{\infty }e^{-j2\pi {\frac {1}{b}}ut}e^{-j\pi {\frac {a}{b}}t^{2}}x(t)dt,\quad b\neq 0}

F ( a , 0 , c , d ) ( u ) = d e j π c d u 2 x ( d u ) , b = 0 {\displaystyle F_{(a,0,c,d)}(u)={\sqrt {d}}e^{j\pi cdu^{2}}x(du),\quad b=0}

Constraint:

a b − b c = 1 {\displaystyle ab-bc=1}

### Transformation Type[edit]

a. fractional Fourier transform

[ a b c d ] = [ c o s ϕ s i n ϕ − s i n ϕ c o s ϕ ] {\displaystyle {\begin{bmatrix}a&b\\\c&d\end{bmatrix}}={\begin{bmatrix}cos\phi &sin\phi \\\\-sin\phi &cos\phi \end{bmatrix}}}

* Fourier transform:  ϕ = π / 2 {\displaystyle \phi =\pi /2}
* identity operation:  ϕ = 0 {\displaystyle \phi =0}
* inverse Fourier transform:  ϕ = − π / 2 {\displaystyle \phi =-\pi /2}

b. Fresnel transform (convolution with a chirp)

[ a b c d ] = [ 1 λ z 0 1 ] {\displaystyle {\begin{bmatrix}a&b\\\c&d\end{bmatrix}}={\begin{bmatrix}1&\lambda z\\\0&1\end{bmatrix}}}

c. chirp multiplication

[ a b c d ] = [ 1 0 τ 1 ] {\displaystyle {\begin{bmatrix}a&b\\\c&d\end{bmatrix}}={\begin{bmatrix}1&0\\\\\tau &1\end{bmatrix}}}

d. scaling

[ a b c d ] = [ 1 σ 0 0 σ ] {\displaystyle {\begin{bmatrix}a&b\\\c&d\end{bmatrix}}={\begin{bmatrix}{\frac {1}{\sigma }}&0\\\0&\sigma \end{bmatrix}}}

## Example[edit]

If we want the left image to become the right image, we can use the techniques from above to achieve the requirement.

There are several ways to solve this problem, this is one of the possible solutions.

First, we apply clockwise rotation of 90 degree by using one of the transform.

STFT:

| S X ( t , f ) | ≈ | S x ( − f , t ) | {\displaystyle |S_{X}(t,f)|\approx |S_{x}(-f,t)|\,}

Gabor:

G X ( t , f ) = G x ( − f , t ) e − j 2 π f t {\displaystyle G_{X}(t,f)=G_{x}(-f,t)e^{-j2\pi ft}\,}

WDF:

W X ( t , f ) = W x ( − f , t ) {\displaystyle W_{X}(t,f)=W_{x}(-f,t)\,}

Second, we set a = 1/3, and perform a horizontal shearing on t-axis.

STFT, Gabor:

S x ( t , f ) ≈ S y ( t − 1 3 f , f ) {\displaystyle S_{x}(t,f)\approx S_{y}(t-{\frac {1}{3}}f,f)\,}

WDF:

W x ( t , f ) = W y ( t − 1 3 f , f ) {\displaystyle W_{x}(t,f)=W_{y}(t-{\frac {1}{3}}f,f)\,}

Third, we shift the signal 2 to the right on t-axis by setting t0 = 2

STFT, Gabor:

x ( t − t 0 ) -> S x ( t − 2 , f ) e − j 2 π f t 0 {\displaystyle x(t-t_{0})\rightarrow S_{x}(t-2,f)e^{-j2\pi ft_{0}}}

WDF:

x ( t − t 0 ) -> W x ( t − 2 , f ) {\displaystyle x(t-t_{0})\rightarrow W_{x}(t-2,f)\,}

Finally, we shift the signal 1 to the left on f-axis by setting f0 = -1

STFT, Gabor:

e j 2 π f 0 t x ( t ) -> S x ( t , f + 1 ) {\displaystyle e^{j2\pi f_{0}t}x(t)\rightarrow S_{x}(t,f+1)}

WDF:

e j 2 π f 0 t x ( t ) -> W x ( t , f + 1 ) {\displaystyle e^{j2\pi f_{0}t}x(t)\rightarrow W_{x}(t,f+1)}

## Applications[edit]

### Efficient Sampling[edit]

As mentioned in the introduction, the above techniques can be used to save the bandwidth or the filter cost.

Assume the signal look like this.

The dashed box is the filter, and the area of the dashed box would be the bandwidth required.

After some operations like the above example, the signal turn into the position like this.

As a result, the bandwidth was saved, since the area became smaller. Moreover, only a lowpass filter is required to recover the signal, instead of a bandpass filter.

### Signal Decomposition and Filter Design[edit]

Signal is decomposed into several components and filter removes the undesired component of a signal. The Fourier transform is suitable to filter out the noise that is a combination of sinusoid functions. If signal are not separable in both time and frequency domains, using the fractional Fourier transform (FRFTs) is suitable to filter out the noise that is a combination of higher order exponential functions.

Fiter designed by the fractional Fourier transform:

x o ( t ) = O F − ϕ O F ϕ [ x i t ] H ( u ) {\displaystyle x_{o}(t)=O_{F}^{-\phi }{O_{F}^{\phi }[x_{i}{t}]H(u)}}
O F ϕ ( x ( t ) ) = 1 − j c o t ϕ e j π c o t ϕ u 2 ∫ − ∞ ∞ e − j 2 π c s c ϕ u t e j π c o t ϕ t 2 x ( t ) d t ( F R F T s ) {\displaystyle O_{F}^{\phi }(x(t))={\sqrt {1-jcot\phi }}e^{j\pi cot\phi u^{2}}\int _{-\infty }^{\infty }e^{-j2\pi csc\phi ut}e^{j\pi cot\phi \ t^{2}}x(t)dt\quad (FRFTs)}

(1) If  H ( u ) = S ( − u + u 0 ) , H ( u ) = { 1 u < u 0 0 u > u 0 {\displaystyle H(u)=S(-u+u_{0}),\quad H(u)={\begin{cases}1\ \ \ u<u_{0}\\\0\ \ \ u>u_{0}\ \ \ \end{cases}}}

S ( u ) {\displaystyle S(u)} : Step function

(2)  ϕ {\displaystyle \phi } is determined by the angle of cutoff line and f-axis.

(3)  u 0 {\displaystyle u_{0}} equals the distance from origin to cutoff line.

## See also[edit]

Other time-frequency transforms:

* Short-time Fourier transform
* Wigner distribution function
* Ambiguity function
* Cohen's class distribution function

## References[edit]

* J.J. Ding, "time-frequency analysis and wavelet transform course note," the Department of Electrical Engineering, National Taiwan University (NTU), Taipei, Taiwan, 2007.
* J.J. Ding, "time-frequency analysis and wavelet transform homework 3," the Department of Electrical Engineering, National Taiwan University (NTU), Taipei, Taiwan, 2007.