Automata theory

Study of abstract machines and automata

Classes of automata

(Clicking on each layer gets an article on that subject)

The automaton described by this state diagram starts in state S1, and changes states following the arrows marked 0 or 1 according to the input symbols as they arrive. The double circle marks S1 as an accepting state. Since all paths from S1 to itself contain an even number of arrows marked 0, this automaton accepts strings containing even numbers of 0s.

Automata theory is the study of abstract machines and automata, as well as the computational problems that can be solved using them. It is a theory in theoretical computer science. The word automata comes from the Greek word αὐτόματος, which means "self-acting, self-willed, self-moving". An automaton (automata in plural) is an abstract self-propelled computing device which follows a predetermined sequence of operations automatically. An automaton with a finite number of states is called a Finite Automaton (FA) or Finite-State Machine (FSM). The figure on the right illustrates a finite-state machine, which is a well-known type of automaton. This automaton consists of states (represented in the figure by circles) and transitions (represented by arrows). As the automaton sees a symbol of input, it makes a transition (or jump) to another state, according to its transition function, which takes the previous state and current input symbol as its arguments.

Automata theory is closely related to formal language theory. In this context, automata are used as finite representations of formal languages that may be infinite. Automata are often classified by the class of formal languages they can recognize, as in the Chomsky hierarchy, which describes a nesting relationship between major classes of automata. Automata play a major role in the theory of computation, compiler construction, artificial intelligence, parsing and formal verification.

## Contents

* 1 History
* 2 Automata
* 2.1 Informal description
* 2.2 Formal definition
* 3 Variant definitions of automata
* 4 Types of automata
* 4.1 Discrete, continuous, and hybrid automata
* 5 Hierarchy in terms of powers
* 6 Applications
* 7 Automata simulators
* 8 Connection to category theory
* 9 See also
* 10 References
* 11 Further reading
* 12 External links

## History[edit | edit source]

The theory of abstract automata was developed in the mid-20th century in connection with finite automata.[1] Automata theory was initially considered a branch of mathematical systems theory, studying the behavior of discrete-parameter systems. Early work in automata theory differed from previous work on systems by using abstract algebra to describe information systems rather than differential calculus to describe material systems.[2] The theory of the finite-state transducer was developed under different names by different research communities.[3] The earlier concept of Turing machine was also included in the discipline along with new forms of infinite-state automata, such as pushdown automata.

1956 saw the publication of Automata Studies, which collected work by scientists including Claude Shannon, W. Ross Ashby, John von Neumann, Marvin Minsky, Edward F. Moore, and Stephen Cole Kleene.[4] With the publication of this volume, "automata theory emerged as a relatively autonomous discipline".[5] The book included Kleene's description of the set of regular events, or regular languages, and a relatively stable measure of complexity in Turing machine programs by Shannon.[6] In the same year, Noam Chomsky described the Chomsky hierarchy, a correspondence between automata and formal grammars,[7] and Ross Ashby published An Introduction to Cybernetics, an accessible textbook explaining automata and information using basic set theory.

The study of linear bounded automata led to the Myhill–Nerode theorem,[8] which gives a necessary and sufficient condition for a formal language to be regular, and an exact count of the number of states in a minimal machine for the language. The pumping lemma for regular languages, also useful in regularity proofs, was proven in this period by Michael O. Rabin and Dana Scott, along with the computational equivalence of deterministic and nondeterministic finite automata.[9]

In the 1960s, a body of algebraic results known as "structure theory" or "algebraic decomposition theory" emerged, which dealt with the realization of sequential machines from smaller machines by interconnection.[10] While any finite automaton can be simulated using a  universal gate set, this requires that the simulating circuit contain loops of arbitrary complexity. Structure theory deals with the "loop-free" realizability of machines.[5] The theory of computational complexity also took shape in the 1960s.[11][12] By the end of the decade, automata theory came to be seen as "the pure mathematics of computer science".[5]

## Automata[edit | edit source]

What follows is a general definition of an automaton, which restricts a broader definition of a system to one viewed as acting in discrete time-steps, with its state behavior and outputs defined at each step by unchanging functions of only its state and input.[5]

### Informal description[edit | edit source]

An automaton runs when it is given some sequence of inputs in discrete (individual) time steps (or just steps). An automaton processes one input picked from a set of symbols or letters, which is called an input alphabet. The symbols received by the automaton as input at any step are a sequence of symbols called words. An automaton has a set of states. At each moment during a run of the automaton, the automaton is in one of its states. When the automaton receives new input it moves to another state (or transitions) based on a transition function that takes the previous state and current input symbol as parameters. At the same time, another function called the output function produces symbols from the output alphabet, also according to the previous state and current input symbol. The automaton reads the symbols of the input word and transitions between states until the word is read completely, if it is finite in length, at which point the automaton halts. A state at which the automaton halts is called the final state.

To investigate the possible state/input/output sequences in an automaton using formal language theory, a machine can be assigned a starting state and a set of accepting states. Then, depending on whether a run starting from the starting state ends in an accepting state, the automaton can be said to accept or reject an input sequence. The set of all the words accepted by an automaton is called the language recognized by the automaton. A familiar example of a machine recognizing a language is an electronic lock, which accepts or rejects attempts to enter the correct code.

### Formal definition[edit | edit source]

Automaton

An automaton can be represented formally by a 5-tuple M = ⟨ Σ , Γ , Q , δ , λ ⟩ {\displaystyle M=\langle \Sigma ,\Gamma ,Q,\delta ,\lambda \rangle } , where:

* Σ {\displaystyle \Sigma } is a finite set of symbols, called the input alphabet of the automaton,
* Γ {\displaystyle \Gamma } is another finite set of symbols, called the output alphabet of the automaton,
* Q {\displaystyle Q} is a set of states,
* δ {\displaystyle \delta } is the next-state function or transition function δ : Q × Σ -> Q {\displaystyle \delta :Q\times \Sigma \to Q} mapping state-input pairs to successor states,
* λ {\displaystyle \lambda } is the next-output function λ : Q × Σ -> Γ {\displaystyle \lambda :Q\times \Sigma \to \Gamma } mapping state-input pairs to outputs.

If  Q {\displaystyle Q} is finite, then  M {\displaystyle M} is a finite automaton.[5]

Input word
An automaton reads a finite string of symbols  a 1 a 2 . . . a n {\displaystyle a_{1}a_{2}...a_{n}} , where  a i ∈ Σ {\displaystyle a_{i}\in \Sigma } , which is called an input word. The set of all words is denoted by  Σ ∗ {\displaystyle \Sigma ^{*}} .

Run
A sequence of states  q 0 , q 1 , . . . , q n {\displaystyle q_{0},q_{1},...,q_{n}} , where  q i ∈ Q {\displaystyle q_{i}\in Q} such that  q i = δ ( q i − 1 , a i ) {\displaystyle q_{i}=\delta (q_{i-1},a_{i})} for  0 < i ≤ n {\displaystyle 0<i\leq n} , is a run of the automaton on an input  a 1 a 2 . . . a n ∈ Σ ∗ {\displaystyle a_{1}a_{2}...a_{n}\in \Sigma ^{*}} starting from state  q 0 {\displaystyle q_{0}} . In other words, at first the automaton is at the start state  q 0 {\displaystyle q_{0}} , and receives input  a 1 {\displaystyle a_{1}} . For  a 1 {\displaystyle a_{1}} and every following  a i {\displaystyle a_{i}} in the input string, the automaton picks the next state  q i {\displaystyle q_{i}} according to the transition function  δ ( q i − 1 , a i ) {\displaystyle \delta (q_{i-1},a_{i})} , until the last symbol  a n {\displaystyle a_{n}} has been read, leaving the machine in the final state of the run,  q n {\displaystyle q_{n}} . Similarly, at each step, the automaton emits an output symbol according to the output function  λ ( q i − 1 , a i ) {\displaystyle \lambda (q_{i-1},a_{i})} .

The transition function  δ {\displaystyle \delta } is extended inductively into  δ ¯ : Q × Σ ∗ -> Q {\displaystyle {\overline {\delta }}:Q\times \Sigma ^{*}\to Q} to describe the machine's behavior when fed whole input words. For the empty string  ε {\displaystyle \varepsilon } ,  δ ¯ ( q , ε ) = q {\displaystyle {\overline {\delta }}(q,\varepsilon )=q} for all states  q {\displaystyle q} , and for strings  w a {\displaystyle wa} where  a {\displaystyle a} is the last symbol and  w {\displaystyle w} is the (possibly empty) rest of the string,  δ ¯ ( q , w a ) = δ ( δ ¯ ( q , w ) , a ) {\displaystyle {\overline {\delta }}(q,wa)=\delta ({\overline {\delta }}(q,w),a)} .[10] The output function  λ {\displaystyle \lambda } may be extended similarly into  λ ¯ ( q , w ) {\displaystyle {\overline {\lambda }}(q,w)} , which gives the complete output of the machine when run on word  w {\displaystyle w} from state  q {\displaystyle q} .
Acceptor

In order to study an automaton with the theory of formal languages, an automaton may be considered as an acceptor, replacing the output alphabet and function  Γ {\displaystyle \Gamma } and  λ {\displaystyle \lambda } with

* q 0 ∈ Q {\displaystyle q_{0}\in Q} , a designated start state, and
* F {\displaystyle F} , a set of states of  Q {\displaystyle Q} (i.e.  F ⊆ Q {\displaystyle F\subseteq Q} ) called accept states.

This allows the following to be defined:

Accepting word
A word  w = a 1 a 2 . . . a n ∈ Σ ∗ {\displaystyle w=a_{1}a_{2}...a_{n}\in \Sigma ^{*}} is an accepting word for the automaton if  δ ¯ ( q 0 , w ) ∈ F {\displaystyle {\overline {\delta }}(q_{0},w)\in F} , that is, if after consuming the whole string  w {\displaystyle w} the machine is in an accept state.

Recognized language
The language  L ⊆ Σ ∗ {\displaystyle L\subseteq \Sigma ^{*}} recognized by an automaton is the set of all the words that are accepted by the automaton,  L = { w ∈ Σ ∗ | δ ¯ ( q 0 , w ) ∈ F } {\displaystyle L=\\{w\in \Sigma ^{*}\ |\ {\overline {\delta }}(q_{0},w)\in F\\}} .[13]

Recognizable languages
The recognizable languages are the set of languages that are recognized by some automaton. For finite automata the recognizable languages are regular languages. For different types of automata, the recognizable languages are different.

## Variant definitions of automata[edit | edit source]

Automata are defined to study useful machines under mathematical formalism. So the definition of an automaton is open to variations according to the "real world machine" that we want to model using the automaton. People have studied many variations of automata. The following are some popular variations in the definition of different components of automata.

Input

* Finite input: An automaton that accepts only finite sequences of symbols. The above introductory definition only encompasses finite words.
* Infinite input: An automaton that accepts infinite words (ω-words). Such automata are called ω-automata.
* Tree input: The input may be a tree of symbols instead of sequence of symbols. In this case after reading each symbol, the automaton reads all the successor symbols in the input tree. It is said that the automaton makes one copy of itself for each successor and each such copy starts running on one of the successor symbols from the state according to the transition relation of the automaton. Such an automaton is called a tree automaton.
* Infinite tree input : The two extensions above can be combined, so the automaton reads a tree structure with (in)finite branches. Such an automaton is called an infinite tree automaton.

States

* Single state: An automaton with one state, also called a combinational circuit, performs a transformation which may implement combinational logic.[10]
* Finite states: An automaton that contains only a finite number of states.
* Infinite states: An automaton that may not have a finite number of states, or even a countable number of states. Different kinds of abstract memory may be used to give such machines finite descriptions.
* Stack memory: An automaton may also contain some extra memory in the form of a stack in which symbols can be pushed and popped. This kind of automaton is called a pushdown automaton.
* Queue memory: An automaton may have memory in the form of a queue. Such a machine is called queue machine and is Turing-complete.
* Tape memory: The inputs and outputs of automata are often described as input and output tapes. Some machines have additional working tapes, including the Turing machine, linear bounded automaton, and log-space transducer.

Transition function

* Deterministic: For a given current state and an input symbol, if an automaton can only jump to one and only one state then it is a deterministic automaton.
* Nondeterministic: An automaton that, after reading an input symbol, may jump into any of a number of states, as licensed by its transition relation. Notice that the term transition function is replaced by transition relation: The automaton non-deterministically decides to jump into one of the allowed choices. Such automata are called nondeterministic automata.
* Alternation: This idea is quite similar to tree automata but orthogonal. The automaton may run its multiple copies on the same next read symbol. Such automata are called alternating automata. The acceptance condition must be satisfied on all runs of such copies to accept the input.

Acceptance condition

* Acceptance of finite words: Same as described in the informal definition above.
* Acceptance of infinite words: an ω-automaton cannot have final states, as infinite words never terminate. Rather, acceptance of the word is decided by looking at the infinite sequence of visited states during the run.
* Probabilistic acceptance: An automaton need not strictly accept or reject an input. It may accept the input with some probability between zero and one. For example, quantum finite automata, geometric automata and metric automata have probabilistic acceptance.

Different combinations of the above variations produce many classes of automata.

Automata theory is a subject matter that studies properties of various types of automata. For example, the following questions are studied about a given type of automata.

* Which class of formal languages is recognizable by some type of automata? (Recognizable languages)
* Are certain automata closed under union, intersection, or complementation of formal languages? (Closure properties)
* How expressive is a type of automata in terms of recognizing a class of formal languages? And, their relative expressive power? (Language hierarchy)

Automata theory also studies the existence or nonexistence of any effective algorithms to solve problems similar to the following list:

* Does an automaton accept at least one input word? (Emptiness checking)
* Is it possible to transform a given non-deterministic automaton into a deterministic automaton without changing the language recognized? (Determinization)
* For a given formal language, what is the smallest automaton that recognizes it? (Minimization)

## Types of automata[edit | edit source]

The following is an incomplete list of types of automata.

Automaton  | Recognizable languages

|

Nondeterministic/Deterministic finite-state machine (FSM)  | regular languages
Deterministic pushdown automaton (DPDA)  | deterministic context-free languages
Pushdown automaton (PDA)  | context-free languages
Linear bounded automaton (LBA)  | context-sensitive languages
Turing machine | recursively enumerable languages
Deterministic Büchi automaton | ω-limit languages
Nondeterministic Büchi automaton  | ω-regular languages
Rabin automaton, Streett automaton, Parity automaton, Muller automaton
Weighted automaton |

### Discrete, continuous, and hybrid automata[edit | edit source]

Normally automata theory describes the states of abstract machines but there are discrete automata, analog automata or continuous automata, or hybrid discrete-continuous automata, which use digital data, analog data or continuous time, or digital and analog data, respectively.

## Hierarchy in terms of powers[edit | edit source]

The following is an incomplete hierarchy in terms of powers of different types of virtual machines. The hierarchy reflects the nested categories of languages the machines are able to accept.[14]

Automaton

Deterministic Finite Automaton (DFA) -- Lowest Power

(same power)  | | {\displaystyle ||} (same power)
Nondeterministic Finite Automaton (NFA)
(above is weaker)  ∩ {\displaystyle \cap } (below is stronger)
Deterministic Push Down Automaton (DPDA-I)
with 1 push-down store
∩ {\displaystyle \cap }
Nondeterministic Push Down Automaton (NPDA-I)
with 1 push-down store
∩ {\displaystyle \cap }
Linear Bounded Automaton (LBA)
∩ {\displaystyle \cap }
Deterministic Push Down Automaton (DPDA-II)
with 2 push-down stores
| | {\displaystyle ||}
Nondeterministic Push Down Automaton (NPDA-II)
with 2 push-down stores
| | {\displaystyle ||}
Deterministic Turing Machine (DTM)
| | {\displaystyle ||}
Nondeterministic Turing Machine (NTM)
| | {\displaystyle ||}
Probabilistic Turing Machine (PTM)
| | {\displaystyle ||}
Multitape Turing Machine (MTM)
| | {\displaystyle ||}
Multidimensional Turing Machine

## Applications[edit | edit source]

Each model in automata theory plays important roles in several applied areas. Finite automata are used in text processing, compilers, and hardware design. Context-free grammar (CFGs) are used in programming languages and artificial intelligence. Originally, CFGs were used in the study of human languages. Cellular automata are used in the field of artificial life, the most famous example being John Conway's Game of Life. Some other examples which could be explained using automata theory in biology include mollusk and pine cone growth and pigmentation patterns. Going further, a theory suggesting that the whole universe is computed by some sort of a discrete automaton, is advocated by some scientists. The idea originated in the work of Konrad Zuse, and was popularized in America by Edward Fredkin. Automata also appear in the theory of finite fields: the set of irreducible polynomials that can be written as composition of degree two polynomials is in fact a regular language.[15] Another problem for which automata can be used is the induction of regular languages.

## Automata simulators[edit | edit source]

Automata simulators are pedagogical tools used to teach, learn and research automata theory. An automata simulator takes as input the description of an automaton and then simulates its working for an arbitrary input string. The description of the automaton can be entered in several ways. An automaton can be defined in a symbolic language or its specification may be entered in a predesigned form or its transition diagram may be drawn by clicking and dragging the mouse. Well known automata simulators include Turing's World, JFLAP, VAS, TAGS and SimStudio.[16]

## Connection to category theory[edit | edit source]

One can define several distinct categories of automata[17] following the automata classification into different types described in the previous section. The mathematical category of deterministic automata, sequential machines or sequential automata, and Turing machines with automata homomorphisms defining the arrows between automata is a Cartesian closed category,[18][19] it has both categorical limits and colimits. An automata homomorphism maps a quintuple of an automaton Ai onto the quintuple of another automaton  Aj.[20] Automata homomorphisms can also be considered as automata transformations or as semigroup homomorphisms, when the state space, S, of the automaton is defined as a semigroup Sg. Monoids are also considered as a suitable setting for automata in monoidal categories.[21][22][23]

Categories of variable automata

One could also define a variable automaton, in the sense of Norbert Wiener in his book on The Human Use of Human Beings via the endomorphisms  A i -> A i {\displaystyle A_{i}\to A_{i}} . Then one can show that such variable automata homomorphisms form a mathematical group. In the case of non-deterministic, or other complex kinds of automata, the latter set of endomorphisms may become, however, a variable automaton groupoid. Therefore, in the most general case, categories of variable automata of any kind are categories of groupoids or groupoid categories. Moreover, the category of reversible automata is then a 2-category, and also a subcategory of the 2-category of groupoids, or the groupoid category.

## See also[edit | edit source]

* Boolean differential calculus

## References[edit | edit source]

1. ^ Mahoney, Michael S. "The Structures of Computation and the Mathematical Structure of Nature". The Rutherford Journal. Retrieved 2020-06-07.
2. ^ Booth, Taylor (1967). Sequential Machines and Automata Theory. New York: John Wiley & Sons. p. 1-13. ISBN 0-471-08848-X.
3. ^ Ashby, William Ross (1967-01-15). "The Place of the Brain in the Natural World" (PDF). Currents in Modern Biology. 1 (2): 95–104. doi:10.1016/0303-2647(67)90021-4. PMID 6060865.: "The theories, now well developed, of the "finite-state machine" (Gill, 1962), of the "noiseless transducer" (Shannon and Weaver, 1949), of the "state-determined system" (Ashby, 1952), and of the "sequential circuit", are essentially homologous."
4. ^ Ashby, W. R.; et al. (1956). C.E. Shannon; J. McCarthy (eds.). Automata Studies. Princeton, N.J.: Princeton University Press.
5. ^ a b c d e Arbib, Michael (1969). Theories of Abstract Automata. Englewood Cliffs, N.J.: Prentice-Hall.
6. ^ Li, Ming; Paul, Vitanyi (1997). An Introduction to Kolmogorov Complexity and its Applications. New York: Springer-Verlag. p. 84.
7. ^ Chomsky, Noam (1956). "Three models for the description of language" (PDF). IRE Transactions on Information Theory. 2 (3): 113–124. doi:10.1109/TIT.1956.1056813.
8. ^ Nerode, A. (1958). "Linear Automaton Transformations". Proceedings of the American Mathematical Society. 9 (4): 541. doi:10.1090/S0002-9939-1958-0135681-9.
9. ^ Rabin, Michael; Scott, Dana (Apr 1959). "Finite Automata and Their Decision Problems" (PDF). IBM Journal of Research and Development. 3 (2): 114–125. doi:10.1147/rd.32.0114. Archived from the original on 2010-12-14.`{{cite journal}}`: CS1 maint: unfit URL (link)
10. ^ a b c Hartmanis, J.; Stearns, R.E. (1966). Algebraic Structure Theory of Sequential Machines. Englewood Cliffs, N.J.: Prentice-Hall.
11. ^ Hartmanis, J.; Stearns, R. E. (1964). "Computational complexity of recursive sequences" (PDF).
12. ^ Fortnow, Lance; Homer, Steve (2002). "A Short History of Computational Complexity" (PDF).
13. ^ Moore, Cristopher (2019-07-31). "Automata, languages, and grammars". arXiv:1907.12713 [cs.CC].
14. ^ Yan, Song Y. (1998). An Introduction to Formal Languages and Machine Computation. Singapore: World Scientific Publishing Co. Pte. Ltd. pp. 155–156. ISBN 9789810234225.
15. ^ Ferraguti, A.; Micheli, G.; Schnyder, R. (2018), Irreducible compositions of degree two polynomials over finite fields have regular structure, The Quarterly Journal of Mathematics, vol. 69, Oxford University Press, pp. 1089–1099, arXiv:1701.06040, doi:10.1093/qmath/hay015, S2CID 3962424
16. ^ Chakraborty, P.; Saxena, P. C.; Katti, C. P. (2011). "Fifty Years of Automata Simulation: A Review". ACM Inroads. 2 (4): 59–70. doi:10.1145/2038876.2038893. S2CID 6446749.
17. ^ Jirí Adámek and Věra Trnková. 1990. Automata and Algebras in Categories. Kluwer Academic Publishers:Dordrecht and Prague
18. ^ Mac Lane, Saunders (1971). Categories for the Working Mathematician. New York: Springer. ISBN 9780387900360.
19. ^ Cartesian closed category Archived 16 November 2011 at the Wayback Machine
20. ^ The Category of Automata Archived 15 September 2011 at the Wayback Machine
21. ^ http://www.math.cornell.edu/~worthing/asl2010.pdf James Worthington.2010.Determinizing, Forgetting, and Automata in Monoidal Categories. ASL North American Annual Meeting, 17 March 2010
22. ^ Aguiar, M. and Mahajan, S.2010. "Monoidal Functors, Species, and Hopf Algebras".
23. ^ Meseguer, J., Montanari, U.: 1990 Petri nets are monoids. Information and Computation 88:105–155

## Further reading[edit | edit source]

* John E. Hopcroft, Rajeev Motwani, Jeffrey D. Ullman (2000). Introduction to Automata Theory, Languages, and Computation (2nd ed.). Pearson Education. ISBN 978-0-201-44124-6.`{{cite book}}`: CS1 maint: uses authors parameter (link)
* Michael Sipser (1997). Introduction to the Theory of Computation. PWS Publishing. ISBN 978-0-534-94728-6. Part One: Automata and Languages, chapters 1–2, pp. 29–122. Section 4.1: Decidable Languages, pp. 152–159. Section 5.1: Undecidable Problems from Language Theory, pp. 172–183.
* Elaine Rich (2008). Automata, Computability and Complexity: Theory and Applications. Pearson. ISBN 978-0-13-228806-4.
* Salomaa, Arto (1985). Computation and automata. Encyclopedia of Mathematics and Its Applications. Vol. 25\. Cambridge University Press. ISBN 978-0-521-30245-6. Zbl 0565.68046.
* Anderson, James A. (2006). Automata theory with modern applications. With contributions by Tom Head. Cambridge: Cambridge University Press. ISBN 978-0-521-61324-8. Zbl 1127.68049.
* Conway, J.H. (1971). Regular algebra and finite machines. Chapman and Hall Mathematics Series. London: Chapman & Hall. Zbl 0231.94041.
* John M. Howie (1991) Automata and Languages, Clarendon Press ISBN 0-19-853424-8 MR1254435
* Sakarovitch, Jacques (2009). Elements of automata theory. Translated from the French by Reuben Thomas. Cambridge University Press. ISBN 978-0-521-84425-3. Zbl 1188.68177.
* James P. Schmeiser, David T. Barnard (1995). Producing a top-down parse order with bottom-up parsing. Elsevier North-Holland.`{{cite book}}`: CS1 maint: uses authors parameter (link)
* Igor Aleksander, F.Keith Hanna (1975). Automata Theory : An Engineering Approach. New York: Crane Russak. ISBN 978-0-8448-0657-0.`{{cite book}}`: CS1 maint: uses authors parameter (link)
* Marvin Minsky (1967). Computation : Finite and infinite machines. Princeton, N.J.: Prentice Hall.
* John C. Martin (2011). Introduction to Languages and The Theory of Computation. New York: McGraw Hill. ISBN 978-0-07-319146-1.

## External links[edit | edit source]

* dk.brics.automaton
* libfa

* v
* t
* e

Automata theory: formal languages and formal grammars

| Chomsky hierarchy| Grammars| Languages| Abstract machines

|
|
|

* Type-0
* —
* Type-1
* —
* —
* —
* —
* —
* Type-2
* —
* —
* Type-3
* —
* —

* Unrestricted
* (no common name)
* Context-sensitive
* Positive range concatenation
* Indexed
* —
* Linear context-free rewriting systems
* Tree-adjoining
* Context-free
* Deterministic context-free
* Visibly pushdown
* Regular
* —
* Non-recursive

* Recursively enumerable
* Decidable
* Context-sensitive
* Positive range concatenation*
* Indexed*
* —
* Linear context-free rewriting language
* Tree-adjoining
* Context-free
* Deterministic context-free
* Visibly pushdown
* Regular
* Star-free
* Finite

* Turing machine
* Decider
* Linear-bounded
* PTIME Turing Machine
* Nested stack
* Thread automaton
* restricted Tree stack automaton
* Embedded pushdown
* Nondeterministic pushdown
* Deterministic pushdown
* Visibly pushdown
* Finite
* Counter-free (with aperiodic finite monoid)
* Acyclic finite

Each category of languages, except those marked by a *, is a proper subset of the category directly above it. Any language in each category is generated by a grammar and by an automaton in the category in the same line.

* v
* t
* e

Computer science

Note: This template roughly follows the 2012 ACM Computing Classification System.

Hardware|

* Printed circuit board
* Peripheral
* Integrated circuit
* Very Large Scale Integration
* Systems on Chip (SoCs)
* Energy consumption (Green computing)
* Electronic design automation
* Hardware acceleration

Computer systems organization|

* Computer architecture
* Embedded system
* Real-time computing
* Dependability

Networks|

* Network architecture
* Network protocol
* Network components
* Network scheduler
* Network performance evaluation
* Network service

Software organization|

* Interpreter
* Middleware
* Virtual machine
* Operating system
* Software quality

Software notations and tools|

* Programming paradigm
* Programming language
* Compiler
* Domain-specific language
* Modeling language
* Software framework
* Integrated development environment
* Software configuration management
* Software library
* Software repository

Software development|

* Control variable
* Software development process
* Requirements analysis
* Software design
* Software construction
* Software deployment
* Software engineering
* Software maintenance
* Programming team
* Open-source model

Theory of computation|

* Model of computation
* Formal language
* Automata theory
* Computability theory
* Computational complexity theory
* Logic
* Semantics

Algorithms|

* Algorithm design
* Analysis of algorithms
* Algorithmic efficiency
* Randomized algorithm
* Computational geometry

Mathematics of computing|

* Discrete mathematics
* Probability
* Statistics
* Mathematical software
* Information theory
* Mathematical analysis
* Numerical analysis
* Theoretical computer science

Information systems|

* Database management system
* Information storage systems
* Enterprise information system
* Social information systems
* Geographic information system
* Decision support system
* Process control system
* Multimedia information system
* Data mining
* Digital library
* Computing platform
* Digital marketing
* World Wide Web
* Information retrieval

Security|

* Cryptography
* Formal methods
* Security services
* Intrusion detection system
* Hardware security
* Network security
* Information security
* Application security

Human–computer interaction|

* Interaction design
* Social computing
* Ubiquitous computing
* Visualization
* Accessibility

Concurrency|

* Concurrent computing
* Parallel computing
* Distributed computing
* Multithreading
* Multiprocessing

Artificial intelligence|

* Natural language processing
* Knowledge representation and reasoning
* Computer vision
* Automated planning and scheduling
* Search methodology
* Control method
* Philosophy of artificial intelligence
* Distributed artificial intelligence

Machine learning|

* Supervised learning
* Unsupervised learning
* Reinforcement learning
* Multi-task learning
* Cross-validation

Graphics|

* Animation
* Rendering
* Image manipulation
* Graphics processing unit
* Mixed reality
* Virtual reality
* Image compression
* Solid modeling

Applied computing|

* E-commerce
* Enterprise software
* Computational mathematics
* Computational physics
* Computational chemistry
* Computational biology
* Computational social science
* Computational engineering
* Computational healthcare
* Digital art
* Electronic publishing
* Cyberwarfare
* Electronic voting
* Video games
* Word processing
* Operations research
* Educational technology
* Document management

* Category
* Outline
* Project
* Commons

* v
* t
* e

Industrial and applied mathematics

Computational|

* Algorithms
* design
* analysis
* Automata theory
* Coding theory
* Computational logic
* Cryptography
* Information theory

Discrete|

* Computer algebra
* Computational number theory
* Combinatorics
* Graph theory
* Discrete geometry

Analysis|

* Approximation theory
* Clifford analysis
* Clifford algebra
* Differential equations
* Ordinary differential equations
* Partial differential equations
* Stochastic differential equations
* Differential geometry
* Differential forms
* Gauge theory
* Geometric analysis
* Dynamical systems
* Chaos theory
* Control theory
* Functional analysis
* Operator algebra
* Operator theory
* Harmonic analysis
* Fourier analysis
* Multilinear algebra
* Exterior
* Geometric
* Tensor
* Vector
* Multivariable calculus
* Exterior
* Geometric
* Tensor
* Vector
* Numerical analysis
* Numerical linear algebra
* Numerical methods for ordinary differential equations
* Numerical methods for partial differential equations
* Validated numerics
* Variational calculus

Probability theory|

* Distributions (random variables)
* Stochastic processes / analysis
* Path integral
* Stochastic variational calculus

Mathematical
physics|

* Analytical mechanics
* Lagrangian
* Hamiltonian
* Field theory
* Classical
* Conformal
* Effective
* Gauge
* Quantum
* Statistical
* Topological
* Perturbation theory
* in quantum mechanics
* Potential theory
* String theory
* Bosonic
* Topological
* Supersymmetry
* Supersymmetric quantum mechanics
* Supersymmetric theory of stochastic dynamics

| Algebraic structures|

* Algebra of physical space
* Feynman integral
* Poisson algebra
* Quantum group
* Renormalization group
* Representation theory
* Spacetime algebra
* Superalgebra
* Supersymmetry algebra

|

Decision sciences|

* Game theory
* Operations research
* Optimization
* Social choice theory
* Statistics
* Mathematical economics
* Mathematical finance

Other applications|

* Biology
* Chemistry
* Psychology
* Sociology
* "The Unreasonable Effectiveness of Mathematics in the Natural Sciences"

Related|

* Mathematics

Organizations|

* Society for Industrial and Applied Mathematics
* Japan Society for Industrial and Applied Mathematics
* Société de Mathématiques Appliquées et Industrielles
* International Council for Industrial and Applied Mathematics

* Category
* Mathematics portal / outline / topics list

*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template