Algebraic signal processing

Algebraic signal processing (ASP) is an emerging area of theoretical signal processing (SP). In the algebraic theory of signal processing, a set of filters is treated as an (abstract) algebra, a set of signals is treated as a module or vector space, and convolution is treated as an algebra representation. The advantage of algebraic signal processing is its generality and portability.

## Contents

* 1 History
* 2 Definitions
* 3 Examples
* 3.1 Discrete Signal Processing
* 3.2 Graph Signal Processing
* 3.3 Other Examples
* 4 Intertwining Maps
* 5 Algebraic Neural Networks
* 6 References
* 7 External links

## History

In the original formulation of algebraic signal processing by Puschel and Moura, the signals are collected in an 𝒜-module for some algebra 𝒜 of filters, and filtering is given by the action of 𝒜 on the 𝒜-module.[1]

## Definitions

Let K be a field, for instance the complex numbers, and 𝒜 be a K-algebra (i.e. a vector space over K with a binary operation ∗:𝒜⊗𝒜->𝒜 that is linear in both arguments) treated as a set of filters. Suppose ℳ is a vector space representing a set signals. A representation of 𝒜 consists of an algebra homomorphism ρ:𝒜->End(ℳ) where End(ℳ) is the algebra of linear transformations T:ℳ->ℳ with composition (equivalent, in the finite-dimensional case, to matrix multiplication). For convenience, we write ρa for the endomorphism ρ(a). To be an algebra homomorphism, ρ must not only be a linear transformation, but also satisfy the propertyρa∗b=ρb∘ρa∀a,b∈𝒜Given a signal x∈ℳ, convolution of the signal by a filter a∈𝒜 yields a new signal ρa(x). Some additional terminology is needed from the representation theory of algebras. A subset 𝒢⊆𝒜 is said to generate the algebra if every element of 𝒜 can be represented as polynomials in the elements of 𝒜. The image of a generator g∈𝒢 is called a shift operator. In all practically all examples, convolutions are formed as polynomials in End(ℳ) generated by shift operators. However, this is not necessarily the case for a representation of an arbitrary algebra.

## Examples

### Discrete Signal Processing

In discrete signal processing (DSP), the signal space is the set of complex-valued functions ℳ=ℒ2(ℤ) with bounded energy (i.e. square-integrable functions). This means the infinite series ∑n=−∞∞|(x)n|<∞ where |⋅| is the modulus of a complex number. The shift operator is given by the linear endomorphism (Sx)n=(x)n−1. The filter space is the algebra of polynomials with complex coefficients 𝒜=ℂ[z−1,z] and convolution is given by ρh=∑k=−∞∞hkSk where h(t)=∑k=−∞∞hkzk is an element of the algebra. Filtering a signal by h, then yields (y)n=∑k=−∞∞hkxn−k because (Skx)n=(x)n−k.

### Graph Signal Processing

A weighted graph is an undirected graph 𝒢=(𝒱,ℰ) with pseudometric on the node set 𝒱 written aij. A graph signal is simply a real-valued function on the set of nodes of the graph. In graph neural networks, graph signals are sometimes called features. The signal space is the set of all graph signals ℳ=ℝ𝒱 where 𝒱 is a set of n=|𝒱| nodes in 𝒢=(𝒱,ℰ). The filter algebra is the algebra of polynomials in one indeterminate 𝒜=ℝ[t]. There a few possible choices for a graph shift operator (GSO). The (un)normalized weighted adjacency matrix of [A]ij=aij is a popular choice, as well as the (un)normalized graph Laplacian [L]ij={∑j=1naiji=j−aiji≠j. The choice is dependent on performance and design considerations. If S is the GSO, then a graph convolution is the linear transformation ρh=∑k=0∞hkSk for some h(t)=∑k=0∞hkzk, and convolution of a graph signal 𝐱:𝒱->ℝ by a filter h(t) yields a new graph signal 𝐲=(∑k=0∞hkSk)⋅𝐱.

### Other Examples

Other mathematical objects with their own proposed signal-processing frameworks are algebraic signal models. These objects include including quivers,[2] graphons,[3] semilattices,[4] finite groups, and Lie groups,[5] and others.

## Intertwining Maps

In the framework of representation theory, relationships between two representations of the same algebra are described with intertwining maps which in the context of signal processing translates to transformations of signals that respect the algebra structure. Suppose ρ:𝒜->End(ℳ) and ρ′:𝒜->End(ℳ′) are two different representations of 𝒜. An intertwining map is a linear transformation α:ℳ->ℳ′ such that

α∘ρa=ρ'a∘α∀a∈𝒜

Intuitively, this means that filtering a signal by a then transforming it with α is equivalent to first transforming a signal with α, then filtering by a. The z transform[1] is a prototypical example of an intertwining map.

## Algebraic Neural Networks

Inspired by a recent perspective that popular graph neural networks (GNNs) architectures are in fact convolutional neural networks (CNNs),[6] recent work has been focused on developing novel neural network architectures from the algebraic point-of-view.[7][8] An algebraic neural network is a composition of algebraic convolutions, possibly with multiple features and feature aggregations, and nonlinearities.

## References

1. ↑ 1.0 1.1 Puschel, M.; Moura, J. (2008). "Algebraic Signal Processing Theory: Foundation and 1-D Time". IEEE Transactions on Signal Processing 56 (8): 3572–3585. doi:10.1109/TSP.2008.925261. ISSN 1053-587X. Bibcode: 2008ITSP...56.3572P. https://ieeexplore.ieee.org/document/4520147.
2. ↑ Parada-Mayorga, Alejandro; Riess, Hans; Ribeiro, Alejandro; Ghrist, Robert (2020-10-22). "Quiver Signal Processing (QSP)". arXiv:2010.11525 [eess.SP].
3. ↑ Ruiz, Luana; Chamon, Luiz F. O.; Ribeiro, Alejandro (2021). "Graphon Signal Processing". IEEE Transactions on Signal Processing 69: 4961–4976. doi:10.1109/TSP.2021.3106857. ISSN 1053-587X. Bibcode: 2021ITSP...69.4961R. https://ieeexplore.ieee.org/document/9521757.
4. ↑ Puschel, Markus; Seifert, Bastian; Wendler, Chris (2021). "Discrete Signal Processing on Meet/Join Lattices". IEEE Transactions on Signal Processing 69: 3571–3584. doi:10.1109/TSP.2021.3081036. ISSN 1053-587X. Bibcode: 2021ITSP...69.3571P. https://ieeexplore.ieee.org/document/9435014.
5. ↑ Bernardini, Riccardo; Rinaldo, Roberto (2021). "Demystifying Lie Group Methods for Signal Processing: A Tutorial". IEEE Signal Processing Magazine 38 (2): 45–64. doi:10.1109/MSP.2020.3023540. ISSN 1053-5888. Bibcode: 2021ISPM...38b..45B. https://ieeexplore.ieee.org/document/9363498.
6. ↑ Gama, Fernando; Isufi, Elvin; Leus, Geert; Ribeiro, Alejandro (2020). "Graphs, Convolutions, and Neural Networks: From Graph Filters to Graph Neural Networks". IEEE Signal Processing Magazine 37 (6): 128–138. doi:10.1109/MSP.2020.3016143. ISSN 1053-5888. Bibcode: 2020ISPM...37f.128G. https://ieeexplore.ieee.org/document/9244191.
7. ↑ Parada-Mayorga, Alejandro; Ribeiro, Alejandro (2021). "Algebraic Neural Networks: Stability to Deformations". IEEE Transactions on Signal Processing 69: 3351–3366. doi:10.1109/TSP.2021.3084537. ISSN 1053-587X. Bibcode: 2021ITSP...69.3351P. https://ieeexplore.ieee.org/document/9442929.
8. ↑ Parada-Mayorga, Alejandro; Butler, Landon; Ribeiro, Alejandro (2022). "Convolutional Filtering and Neural Networks with Non Commutative Algebras". arXiv:2108.09923 [cs.LG].

## External links

* Smart Project: Algebraic Theory of Signal Processing at the Department of Electrical and Computer Engineering at Carnegie Mellon University.
* Lecture 12: "Algebraic Neural Networks," University of Pennsylvania (ESE 514).

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Algebraic signal processing. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Algebraic_signal_processing&oldid=16452"