Speech recognition

Short description: Automatic conversion of spoken language into text

For the human linguistic concept, see Philosophy:Speech perception.

This article may be too technical for most readers to understand. Please help improve it to make it understandable to non-experts, without removing the technical details. (July 2025) (Learn how and when to remove this template message)

|

Speech recognition (automatic speech recognition (ASR), computer speech recognition, or speech-to-text (STT)) is a sub-field of computational linguistics concerned with methods and technologies that translate spoken language into text or other interpretable forms.[1]

Speech recognition applications include voice user interfaces, where the user speaks to a device, which "listens" and processes the audio. Common voice applications include interpreting commands for calling, call routing, home automation, and aircraft control. These applications are called direct voice input. Productivity applications include searching audio recordings, creating transcripts, and dictation.

Speech recognition can be used to analyse speaker characteristics, such as identifying native language using pronunciation assessment.[2]

Voice recognition[3][4][5] (speaker identification)[6][7][8] refers to identifying the speaker, rather than speech contents. Recognizing the speaker can simplify the task of translating speech in systems trained on a specific person's voice. It can also be used to authenticate the speaker as part of a security process.

## Contents

* 1 History
* 1.1 Pre-1970
* 1.2 1970–1990
* 1.3 Practical speech recognition
* 1.3.1 2000s
* 1.3.2 2010s
* 2 Models, methods, and algorithms
* 2.1 Hidden Markov models
* 2.2 Dynamic time warping (DTW)-based speech recognition
* 2.3 Neural networks
* 2.3.1 Deep feedforward and recurrent neural networks
* 2.4 End-to-end learning
* 2.4.1 Attention-based models
* 3 Applications
* 3.1 In-car systems
* 3.2 Education
* 3.3 Health care
* 3.3.1 Medical documentation
* 3.3.2 Therapeutic use
* 3.4 Military
* 3.4.1 Aircraft
* 3.4.2 Helicopters
* 3.4.3 Air traffic control
* 3.5 People with disabilities
* 3.6 Other domains
* 4 Performance
* 4.1 Accuracy
* 4.2 Security
* 5 Further information
* 5.1 Conferences
* 5.2 Journal
* 5.3 Books
* 5.4 Projects
* 5.5 Software
* 6 See also
* 7 References
* 8 Further reading

## History

Applications for speech recognition developed over many decades, with progress accelerated due to advances in deep learning and the use of big data. These advances are reflected in an increase in academic papers,[9] and greater system adoption.[10]

Key areas of growth include vocabulary size, more accurate recognition for unfamiliar speakers (speaker independence), and faster processing speed.

### Pre-1970

* 1952 – Bell Labs researchers, Stephen Balashek,[11] R. Biddulph, and K. H. Davis, built Audrey[12] for single-speaker digit recognition. Their system located the formants in the power spectrum of each utterance.[13]
* 1960 – Gunnar Fant developed and published the source-filter model of speech production.[14]
* 1962 – IBM's 16-word "Shoebox" machine's speech recognition debuted at the 1962 World's Fair.[15]
* 1966 – Linear predictive coding, a speech coding method, was proposed by Fumitada Itakura of Nagoya University and Shuzo Saito of Nippon Telegraph and Telephone.[16]
* 1969 – Funding at Bell Labs came to a halt for several years after the company's head engineer, John R. Pierce, wrote an open letter criticizing speech recognition research.[17] This defunding lasted until Pierce retired and James L. Flanagan took over.

Raj Reddy was the first person to work on continuous speech recognition,[18] as a graduate student at Stanford University in the late 1960s. Previous systems required users to pause after each word. Reddy's system issued spoken commands for playing chess.

Around this time, Soviet researchers invented the dynamic time warping (DTW) algorithm[19] and used it to create a recognizer capable of operating on a 200-word vocabulary.[20] DTW processed speech by dividing it into short frames (e.g. 10 ms segments) and treating each frame as a unit. Speaker independence, however, remained unsolved.

### 1970–1990

* 1971 – DARPA funded a five-year speech recognition research project, Speech Understanding Research, seeking a minimum vocabulary size of 1,000 words. The project considered speech understanding a key to achieving progress in speech recognition, which was later disproved.[21] BBN, IBM, Carnegie Mellon (CMU), and Stanford Research Institute participated.[22][23]
* 1972 – The IEEE Acoustics, Speech, and Signal Processing group held a conference in Newton, Massachusetts.
* 1976 – The first ICASSP was held in Philadelphia, which became a major venue for publishing on speech recognition.[24]

During the late 1960s, Leonard Baum developed the mathematics of Markov chains at the Institute for Defense Analysis. A decade later, at CMU, Raj Reddy's students James Baker and Janet M. Baker began using the hidden Markov model (HMM) for speech recognition.[25] James Baker had learned about HMMs while at the Institute for Defense Analysis.[26] HMMs enabled researchers to combine sources of knowledge, such as acoustics, language, and syntax, in a unified probabilistic model.

By the mid-1980s, Fred Jelinek's team at IBM created a voice-activated typewriter called Tangora, which could handle a 20,000-word vocabulary.[27] Jelinek's statistical approach placed less emphasis on emulating human brain processes in favor of statistical modelling. (Jelinek's group independently discovered the application of HMMs to speech.[26]) This was controversial among linguists since HMMs are too simplistic to account for many features of human languages.[28] However, the HMM proved to be a highly useful way for modelling speech and replaced dynamic time warping as the dominant speech recognition algorithm in the 1980s.[29][30]

* 1982 – Dragon Systems, founded by James and Janet M. Baker,[31] was one of IBM's few competitors.

### Practical speech recognition

The 1980s also saw the introduction of the n-gram language model.

* 1987 – The back-off model enabled language models to use multiple-length n-grams, and CSELT[32] used HMM to recognize languages (in software and hardware, e.g. RIPAC).

At the end of the DARPA program in 1976, the best computer available to researchers was the PDP-10 with 4 MB of RAM.[33] It could take up to 100 minutes to decode 30 seconds of speech.[34]

Practical products included:

* 1984 – the Apricot Portable was released with up to 4096 words support, of which only 64 could be held in RAM at a time.[35]
* 1987 – a recognizer from Kurzweil Applied Intelligence
* 1990 – Dragon Dictate, a consumer product released in 1990.[36][37] AT&T deployed the Voice Recognition Call Processing service in 1992 to route telephone calls without a human operator.[38] The technology was developed by Lawrence Rabiner and others at Bell Labs.

By the early 1990s, the vocabulary of the typical commercial speech recognition system had exceeded the average human vocabulary.[33] Reddy's former student, Xuedong Huang, developed the Sphinx-II system at CMU. Sphinx-II was the first to do speaker-independent, large vocabulary, continuous speech recognition, and it won DARPA's 1992 evaluation. Handling continuous speech with a large vocabulary was a major milestone. Huang later founded the speech recognition group at Microsoft in 1993. Reddy's student Kai-Fu Lee joined Apple, where, in 1992, he helped develop the Casper speech interface prototype.

Lernout & Hauspie, a Belgium-based speech recognition company, acquired other companies, including Kurzweil Applied Intelligence in 1997 and Dragon Systems in 2000. L&H was used in Windows XP. L&H was an industry leader until an accounting scandal destroyed it in 2001. L&H speech technology was bought by ScanSoft, which became Nuance in 2005. Apple licensed Nuance software for its digital assistant Siri.[39]

#### 2000s

In the 2000s, DARPA sponsored two speech recognition programs: Effective Affordable Reusable Speech-to-Text (EARS) in 2002, followed by Global Autonomous Language Exploitation (GALE) in 2005. Four teams participated in EARS: IBM; a team led by BBN with LIMSI and the University of Pittsburgh; Cambridge University; and a team composed of ICSI, SRI, and the University of Washington. EARS funded the collection of the Switchboard telephone speech corpus, which contained 260 hours of recorded conversations from over 500 speakers.[40] The GALE program focused on Arabic and Mandarin broadcast news. Google's first effort at speech recognition came in 2007 after recruiting Nuance researchers.[41] Its first product, GOOG-411, was a telephone-based directory service.

Since at least 2006, the U.S. National Security Agency has employed keyword spotting, allowing analysts to index large volumes of recorded conversations and identify speech containing "interesting" keywords.[42] Other government research programs focused on intelligence applications, such as DARPA's EARS program and IARPA's Babel program.

In the early 2000s, speech recognition was dominated by hidden Markov models combined with feed-forward artificial neural networks (ANN).[43] Later, speech recognition was taken over by long short-term memory (LSTM), a recurrent neural network (RNN) published by Sepp Hochreiter & Jürgen Schmidhuber in 1997.[44] LSTM RNNs avoid the vanishing gradient problem and can learn "Very Deep Learning" tasks[45] that require memories of events that happened thousands of discrete time steps earlier, which is important for speech.

Around 2007, LSTMs trained with Connectionist Temporal Classification (CTC)[46] began to outperform.[47] In 2015, Google reported a 49 percent error‑rate reduction in its speech recognition via CTC‑trained LSTM.[48] Transformers, a type of neural network based solely on attention, were adopted in computer vision[49][50] and language modelling,[51][52] and then to speech recognition.[53][54][55] Deep feed-forward (non-recurrent) networks for acoustic modelling were introduced in 2009 by Geoffrey Hinton and his students at the University of Toronto, and by Li Deng[56] and colleagues at Microsoft Research.[57][58][59][60] In contrast to the prioer incremental improvements, deep learning decreased error rates by 30%.[60]

Both shallow and deep forms (e.g., recurrent nets) of ANNs had been explored since the 1980s.[61][62][63] However, these methods never defeated non-uniform internal-handcrafting Gaussian mixture model/hidden Markov model (GMM-HMM) technology.[64] Difficulties analyzed in the 1990s, included gradient diminishing[65] and weak temporal correlation structure.[66][67] All these difficulties combined with insufficient training data and computing power. Most speech recognition pursued generative modelling approaches until deep learning won the day. Hinton et al. and Deng et al.[58][59][68][69]

#### 2010s

By early the 2010s, speech recognition[70][71][72] was differentiated from speaker recognition, and speaker independence was considered a major breakthrough. Until then, systems required a "training" period for each voice.[15]

In 2017, Microsoft researchers reached the human parity milestone of transcribing conversational speech on the widely benchmarked Switchboard task. Multiple deep learning models were used to improve accuracy. The error rate was reported to be as low as 4 professional human transcribers working together on the same benchmark.[73]

## Models, methods, and algorithms

Both acoustic modeling and language modeling are important parts of statistically-based speech recognition algorithms. Hidden Markov models (HMMs) are widely used in many systems. Language modelling is also used in many other natural language processing applications, such as document classification or statistical machine translation.

### Hidden Markov models

Main article: Hidden Markov model

Speech recognition systems are based on HMMs. These are statistical models that output a sequence of symbols or quantities. HMMs are used in speech recognition because a speech signal can be viewed as a piecewise stationary signal or a short-time stationary signal. In a short time scale (e.g. 10 milliseconds), speech can be approximated as a stationary process. Speech can be thought of as a Markov model for many stochastic purposes.

HMMs are popular because they can be trained automatically and are simple and computationally feasible. An HMM outputs a sequence of n-dimensional real-valued vectors (where n is an integer such as 10), outputting one every 10 milliseconds. The vectors consist of cepstral coefficients, obtained by a Fourier transform of a short window of speech and decorrelating the spectrum using a cosine transform, then taking the first (most significant) coefficients. The HMM tends to have, in each state, a statistical distribution that is a mixture of diagonal covariance Gaussians, which give a likelihood for each observed vector. Each word, or (for more general speech recognition systems), each phoneme, has a different output distribution; an HMM for a sequence of words or phonemes is made by concatenating the individual trained HMMs for the separate words and phonemes.

Speech recognition systems use combinations of standard techniques to improve results. A typical large-vocabulary system applies context dependency for the phonemes (so that phonemes with different left and right context have different realizations as HMM states). It uses cepstral normalization to handle speaker and recording conditions. It might use vocal tract length normalization (VTLN) for male-female normalization and maximum likelihood linear regression (MLLR) for more general adaptation. The features use delta and delta-delta coefficients to capture speech dynamics, and in addition might use heteroscedastic linear discriminant analysis (HLDA); or might use splicing and LDA-based projection, followed by HLDA or a global semi-tied covariance transform (also known as maximum likelihood linear transform (MLLT)). Many systems use discriminative training techniques that dispense with a purely statistical approach to HMM parameter estimation and instead optimize some classification-related measure of the training data. Examples are maximum mutual information (MMI), minimum classification error (MCE), and minimum phone error (MPE).

### Dynamic time warping (DTW)-based speech recognition

Main article: Dynamic time warping

Dynamic time warping was historically used for speech recognition, but was later displaced by HMM.

Dynamic time warping measures similarity between two sequences that may vary in time or speed. For instance, similarities in walking patterns could be detected, even if in one video a person was walking slowly and in another was walking more quickly, or even if accelerations and decelerations came during one observation. DTW has been applied to video, audio, and graphics – any data that can be turned into a linear representation can be analyzed with DTW.

This could handle speech at different speaking speeds. In general, it allows an optimal match between two sequences (e.g., time series) with certain restrictions. The sequences are "warped" non-linearly to match each other. This sequence alignment method is often used in the context of HMMs.

### Neural networks

Main article: Artificial neural network

Neural networks became interesting in the late 1980s before beginning to dominate in the 2010s. Neural networks have been used in many aspects of speech recognition, such as phoneme classification,[74] phoneme classification through multi-objective evolutionary algorithms,[75] isolated word recognition,[76] audiovisual speech recognition, audiovisual speaker recognition, and speaker adaptation.

Neural networks make fewer explicit assumptions about feature statistical properties than HMMs. When used to estimate the probabilities of a speech segment, neural networks allow natural and efficient discriminative training. However, in spite of their effectiveness in classifying short-time units such as individual phonemes and isolated words,[77] early neural networks were rarely successful for continuous recognition because of their limited ability to model temporal dependencies.

One approach was to use neural networks for feature transformation, or dimensionality reduction.[78] However, more recently, LSTM and related recurrent neural networks (RNNs),[44][48][79][80] Time Delay Neural Networks (TDNN's),[81] and transformers[53][54][55] demonstrated improved performance.

#### Deep feedforward and recurrent neural networks

Main article: Deep learning

Researchers are exploring deep neural networks (DNNs) and denoising autoencoders[82] .A DNN is a type of artificial neural network that includes multiple hidden layers between the input and output.[58] Like simpler neural networks, DNNs can model complex, non-linear relationships. However, their deeper architecture allows them to build more sophisticated representations that combine features from earlier layers. This gives them a powerful ability to learn and recognize complex patterns in speech data.[83]

A major breakthrough in using DNNs for large vocabulary speech recognition came in 2010. In a collaboration between industry and academia, researchers used DNNs with large output layers based on context-dependent HMM states that were created using decision trees.[84][85][86] This approach significantly improved performanc.[87][88][89]

A core idea behind deep learning is to eliminate the need for manually designed features and instead learn directly from input data. This was first demonstrated using deep autoencoders trained on raw spectrograms or linear filter-bank features.[90] These models outperformed traditional Mel-Cepstral features, which rely on fixed transformations. More recently, researchers showed that waveforms can achieve excellent results in large-scale speech recognition.[91]

### End-to-end learning

Since 2014, much research has considered "end-to-end" ASR. Traditional phonetic-based (i.e., all HMM-based model) approaches required separate components and training for pronunciation, acoustic, and language. End-to-end models learn from all the components at once. This simplifies the training and deployment processes. For example, an n-gram language model is required for all HMM-based systems, and a typical 2025-era n-gram language model often takes gigabytes in memory, making them impractical to deploy on mobile devices.[92] Consequently, ASR systems from Google and Apple (as of 2017[update]) deploy on servers and required a network connection to operate.[citation needed]

The first attempt at end-to-end ASR was the Connectionist Temporal Classification (CTC)-based system introduced by Alex Graves of Google DeepMind and Navdeep Jaitly of the University of Toronto in 2014.[93] The model consisted of RNNs and a CTC layer. Jointly, the RNN-CTC model learns the pronunciation and acoustic model together, however, it is incapable of learning the language model due to conditional independence assumptions, similar to an HMM. Consequently, CTC models can directly learn to map speech acoustics to English characters, but the models make many common spelling mistakes and must rely on a separate language model to finalize transcripts. Later, Baidu expanded on the work with extremely large datasets and demonstrated some commercial success in Mandarin and English.[94]

In 2016, the University of Oxford presented LipNet,[95] the first end-to-end sentence-level lipreading model, using spatiotemporal convolutions coupled with an RNN-CTC architecture, surpassing human-level performance in a restricted dataset.[96] A large-scale convolutional-RNN-CTC architecture was presented in 2018 by Google DeepMind, achieving 6 times better performance than human experts.[97] In 2019, Nvidia launched two CNN-CTC ASR models, Jasper and QuarzNet, with an overall performance word error rate (WER) of 3%.[98][99] Similar to other deep learning applications, transfer learning and domain adaptation are important strategies for reusing and extending the capabilities of deep learning models, particularly due to the small size of available corpora in many languages and/or specific domains.[100][101][102]

In 2018, researchers at MIT Media Lab announced preliminary work on AlterEgo, a device that uses electrodes to read the neuromuscular signals users make as they subvocalize.[103] They trained a convolutional neural network to translate the electrode signals into words.[104]

#### Attention-based models

Attention-based ASR models were introduced by Chan et al. of Carnegie Mellon University and Google Brain, and Bahdanau et al. of the University of Montreal in 2016.[105][106] The model named "Listen, Attend and Spell" (LAS), literally "listens" to the acoustic signal, pays "attention" to all parts of the signal and "spells" out the transcript one character at a time. Unlike CTC-based models, attention-based models require conditional-independence assumptions and can learn all the components of a speech recognizer directly. This means that during deployment, no a priori language model is required, making it less demanding for applications with limited memory.

Attention-based models immediately outperformed CTC models (with or without an external language model) and continued improving.[107] Latent Sequence Decomposition (LSD) was proposed by Carnegie Mellon University, MIT, and Google Brain to directly emit sub-word units that are more natural than English characters.[108] The University of Oxford and Google DeepMind extended LAS to "Watch, Listen, Attend and Spell" (WLAS) to handle lip reading and surpassed human-level performance.[109]

## Applications

### In-car systems

Voice commands may be used to initiate phone calls, select radio stations, or play music. Voice recognition capabilities vary across car make and model. Some models offer natural-language speech recognition, allowing the driver to use full sentences and common phrases in a conversational style. With such systems, fixed commands are not required.[110]

### Education

Main article: Pronunciation assessment

Automatic pronunciation assessment is the use of speech recognition to verify the correctness of speech,[111] as distinguished from assessment by a person.[112] Also called speech verification, pronunciation evaluation, and pronunciation scoring, the main application of this technology is computer-aided pronunciation teaching (CAPT) when combined with computer-aided instruction for computer-assisted language learning (CALL), speech remediation, or accent reduction. Pronunciation assessment does not determine unknown speech (as in dictation or automatic transcription) but instead, compares speech to a reference model for the words spoken,[113][114] sometimes with inconsequential prosody such as intonation, pitch, tempo, rhythm, and stress.[115] Pronunciation assessment is also used in reading tutoring, for example in products such as Microsoft Teams[116] and Amira Learning.[117] Pronunciation assessment can also be used to help diagnose and treat speech disorders such as apraxia.[118]

Assessing intelligibility is essential for avoiding inaccuracies from accent bias, especially in high-stakes assessments,[119][120][121] from words with multiple correct pronunciations,[122] and from phoneme coding errors in digital pronunciation dictionaries.[123] In 2022, researchers found that some newer speech to text systems, based on end-to-end reinforcement learning to map audio signals directly into words, produce word and phrase confidence scores closely correlated with listener intelligibility.[124] In the Common European Framework of Reference for Languages (CEFR) assessment criteria for "overall phonological control", intelligibility outweighs formally correct pronunciation at all levels.[125]

### Health care

#### Medical documentation

In the health care sector, speech recognition can be implemented in front-end or back-end medical documentation processes. In front-end speech recognition, the provider dictates into a speech-recognition engine, words are displayed as they are recognized, and the speaker is responsible for editing and signing off on the document. In back-end or deferred speech recognition the provider speaks into a digital dictation system, the voice is routed through a speech-recognition machine, and a draft document is routed along with the voice file to an editor, who edits/finalizes the draft and final report.[citation needed]

More recently, speech recognition has been combined with artificial intelligence in so-called ambient medical scribe systems. These systems are designed to automatically capture, transcribe, and summarize clinician–patient conversations during clinical encounters to support clinical documentation. Such approaches have been discussed in the medical literature, including reports in The BMJ examining the use of AI medical scribes in primary care, with examples including commercial systems such as Heidi Health.[126]

A major issue is that the American Recovery and Reinvestment Act of 2009 (ARRA) provides substantial financial benefits to physicians who utilize an Electronic Health Record (EHR) that complies with "Meaningful Use" standards. These standards require that substantial data be maintained by the EHR. The use of speech recognition is more naturally suited to the generation of narrative text, as part of a radiology/pathology interpretation, progress note or discharge summary; the ergonomic gains of using speech recognition to enter structured discrete data (e.g., numeric values or codes from a list or a controlled vocabulary) are relatively minimal for people who are sighted and who can operate a keyboard and mouse.

A more significant issue is that most EHRs have not been expressly tailored to take advantage of voice-recognition capabilities. A large part of a clinician's interaction with EHR involves navigation through the user interface that is heavily dependent on keyboard and mouse; voice-based navigation provides only modest ergonomic benefits. By contrast, many highly customized systems for radiology or pathology dictation implement voice "macros", where the use of certain phrases – e.g., "normal report", will automatically fill in a large number of default values and/or generate boilerplate, which vary with the type of exam – e.g., a chest X-ray vs. a gastrointestinal contrast series for a radiology system.

#### Therapeutic use

Prolonged use of speech recognition software in conjunction with word processors has shown benefits to short-term-memory restrengthening in brain AVM patients who have been treated with resection. Further research needs to be conducted to determine cognitive benefits for individuals whose AVMs have been treated using radiologic techniques.[127]

### Military

#### Aircraft

Substantial efforts have been devoted to the test and evaluation of speech recognition in fighter aircraft. Of particular note have been the US programme in speech recognition for the Advanced Fighter Technology Integration (AFTI)/F-16 aircraft (F-16 VISTA), the programme in France for Mirage aircraft, and UK programmes dealing with a variety of aircraft platforms. In these programmes, speech recognizers have been operated successfully, with applications including setting radio frequencies, commanding an autopilot system, setting steer-point coordinates and weapons release parameters, and controlling flight display.

Working with Swedish pilots flying the JAS-39 Gripen, Englund (2004) reported that recognition deteriorated with increasing g-loads. The study concluded that adaptation greatly improved the results in all cases and that the introduction of models for breathing was shown to improve recognition scores significantly. Contrary to what might have been expected, no effects of the broken English of the speakers were found. Spontaneous speech caused problems for the recognizer, as might have been expected. A restricted vocabulary, and above all, a proper syntax, could thus be expected to improve recognition accuracy substantially.[128]

The Eurofighter Typhoon employs a speaker-dependent system, requiring each pilot to create a template. The system is not used for safety-critical or weapon-critical tasks, such as weapon release or lowering of the undercarriage, but is used for many cockpit functions. Voice commands are confirmed by visual and/or aural feedback. The system is seen as a major benefit in the reduction of pilot workload,[129] and allows the pilot to assign targets with two voice commands or to a wingman with only five commands.[130]

Speaker-independent systems are under test for the F-35 Lightning II (JSF) and the Alenia Aermacchi M-346 Master lead-in fighter trainer. These systems have produced word accuracy scores in excess of 98%.[131][132]

#### Helicopters

The problems of achieving high recognition accuracy under stress and noise are particularly relevant in the helicopter environment as well as in the fighter environment. The acoustic noise problem is actually more severe in the helicopter environment, because of the high noise levels, and because helicopter pilots, in general, do not wear a facemask, which would reduce acoustic noise in the microphone. Substantial test and evaluation programmes, notably by the U.S. Army Avionics Research and Development Activity (AVRADA) and by the Royal Aerospace Establishment (RAE) in the UK. Work in France included speech recognition in the Puma helicopter. Voice applications include control of communication radios, navigation systems, and an automated target handover system.

The overriding issue for voice is the impact on pilot effectiveness. Encouraging results are reported for the AVRADA tests, although these represent only a feasibility demonstration in a test environment. Much remains to be done both in speech recognition and in overall speech technology in order to consistently achieve performance improvements in operational settings.

#### Air traffic control

Training for air traffic controllers (ATC) represents an excellent application for speech recognition systems. Many ATC training systems currently require a trainer to act as a "pseudo-pilot", engaging in a voice dialog with the trainee controller, which simulates the dialog that the controller would have with real pilots. Speech recognition and synthesis techniques offer the potential to eliminate the need for a person to act as a pseudo-pilot, thus reducing training and support personnel.

In theory, air controller tasks are characterized by highly structured speech as the primary output, reducing the difficulty of the speech recognition task. In practice, this is rarely the case. FAA document 7110.65 details the phrases that should be used by air traffic controllers. While this document gives less than 150 examples of such phrases, the number of phrases supported by one of the simulation vendors speech recognition systems is in excess of 500,000.

The USAF, USMC, US Army, US Navy, and FAA as well as international ATC training organizations such as the Royal Australian Air Force and Civil Aviation Authorities in Italy, Brazil, and Canada use ATC simulators with speech recognition.[133]

### People with disabilities

Speech recognition programs can provide many benefit to those with disabilities. For individuals who are deaf or hard of hearing, speech recognition software can be used to generate captions of conversations.[134] Additionally, individuals who are blind (see blindness and education) or have poor vision can benefit from listening to textual content, as well as garner more functionality from a computer by issuing commands with their voice.[135]

Speech recognition has proven very useful for those who have difficulty using their hands due to causes ranging from mild repetitive stress injuries to disabilities that preclude the use of conventional computer input devices. Individuals with physical disabilities can use voice commands and transcription to navigate electronics hands-free.[135] In fact, people who developed RSI from keyboard use became an early and urgent market for speech recognition.[136][137] Speech recognition is used in deaf telephony, such as voicemail to text, relay services, and captioned telephone. Individuals with learning disabilities who struggle with thought-to-paper communication may benefit from the software, but the product's fallibility remains a significant consideration for many.[138] In addition, speech to text technology is only an effective aid for those with intellectual disabilities if the proper training and resources are provided (e.g. in the classroom setting).[139]

This type of technology can help those with dyslexia, but the potential benefits regarding other disabilities are still in question. Mistakes made by the software hinder its effectiveness, since misheard words take more time to fix.[140]

### Other domains

ASR is now commonplace in the field of telephony. In telephony systems, ASR is predominantly used in contact centers by integrating it with IVR systems.

It is becoming more widespread in computer gaming and simulation.

Despite the high level of integration with word processing in general personal computing, in the field of document production, ASR has not seen the expected increases in use.

The improvement of mobile processor speeds has made speech recognition practical in smartphones. Speech is used mostly as a part of a user interface, for creating predefined or custom speech commands.

* Aerospace, e.g., NASA's Mars Polar Lander used speech recognition technology from Sensory, Inc. in the Mars microphone on the lander[141]
* Automatic subtitling with speech recognition
* Automatic emotion recognition[142]
* Automatic shot listing in audiovisual production
* Automatic translation
* E-discovery
* Hands-free computing
* Home automation
* Interactive voice response
* Mobile telephony, including mobile email
* Multimodal interaction[69]
* Real-time captioning[143]
* Robotics
* Security, including usage with other biometric scanners for multi-factor authentication[144]
* Speech to text
* Telematics, e.g., vehicle navigation systems
* Transcription
* Video games like Tom Clancy's EndWar and Lifeline
* Virtual assistant such as Siri

## Performance

The performance of speech recognition systems is usually evaluated in terms of accuracy and speed.[145][146] Accuracy is usually rated with word error rate (WER), whereas speed is measured in elapsed time. Other measures of accuracy include Single Word Error Rate (SWER) and Command Success Rate (CSR).

Speech recognition is complicated by many properties of speech. Vocalizations vary in terms of accent, pronunciation, articulation, roughness, dialect, nasality, pitch, volume, and speed. Speech is distorted by background noise, echoes, and recording characteristics. Accuracy of speech recognition may vary with the following:[147][148]

* Vocabulary size and confusability
* Speaker dependence versus independence
* Isolated, discontinuous, or continuous speech
* Task and language constraints
* Read versus spontaneous speech
* Adverse conditions

### Accuracy

The accuracy of speech recognition may vary depending on the following factors:

* Error rates increase as the vocabulary size grows:

e.g. the 10 digits "zero" to "nine" can be recognized essentially perfectly, but vocabulary sizes of 200, 5000, or 100000 may have error rates of 3%, 7%, or 45% respectively.

* Vocabulary is hard to recognize if it contains confusing letters:

e.g. the 26 letters of the English alphabet are difficult to discriminate because they are confusing words (most notoriously, the E-set: "B, C, D, E, G, P, T, V, Z (when "Z" is pronounced "zee" rather than "zed", depending on region); an 8% error rate is considered good for this vocabulary.[149]

* Speaker dependence vs. independence:
* A speaker-dependent system is intended for use by a single speaker.
* A speaker-independent system is intended for use by any speaker (more difficult).[150]
* Isolated, discontinuous or continuous speech
* With isolated speech, single words are used, which is easier to recognize.
* With discontinuous speech, full sentences separated by silence are used. The silence is easier to recognize similar to isolated speech.
* With continuous speech naturally spoken sentences are used, which are harder to recognize.
* Task and language constraints can inform the recognition
* The requesting application may dismiss the hypothesis "The apple is red."
* Constraints may be semantic; rejecting "The apple is angry."
* Syntactic; rejecting "Red is apple the."
* Constraints are often represented by grammar.
* Read vs. spontaneous speech
* When a person reads it's usually in a context that has been previously prepared.
* When a person speaks spontaneously, recognition must deal with disfluencies such as "uh" and "um", false starts, incomplete sentences, stuttering, coughing, and laughter) and limited vocabulary.
* Adverse conditions
* environmental noise (e.g., in a car or factory).
* Acoustic distortions (e.g. echoes, room acoustics)

Speech recognition is a multi-level pattern recognition task.

* Acoustic signals are structured into a hierarchy of units, e.g. phonemes, words, phrases, and sentences;
* Each level provides additional constraints; e.g., known word pronunciations or legal word sequences, which can compensate for errors or uncertainties at a lower level;

This hierarchy of constraints improves accuracy. By combining decisions probabilistically at all lower levels, and making ultimate decisions only at the highest level, speech recognition is broken into several phases. Computationally, it is a problem in which a sound pattern has to be recognized or classified into a category that represents a meaning to a human. Every acoustic signal can be broken into smaller sub-signals. As the more complex sound signal is divided, different levels are created, where at the top level are complex sounds made of simpler sounds on the lower level, etc. At the lowest level, simple and more probabilistic rules apply. These sounds are put together into more complex sounds on upper level, a new set of more deterministic rules predicts what the complex sound represents. The upper level of a deterministic rule should figure out the meaning of complex expressions. In order to expand our knowledge about speech recognition, we need to take into consideration neural networks. Neural network approaches use the following steps:

* Digitize the speech – for telephone speech, 8000 samples per second are captured;[151]

* Compute features of spectral-domain of the speech (with Fourier transform); computed every 10ms, with one 10ms section called a frame;

Sound is produced by air (or some other medium) vibration. Sound creates a wave that has two measures: amplitude (strength), and frequency (vibrations per second).[152] Accuracy can be computed with the help of WER, which is calculated by aligning the recognized word and referenced word using dynamic string alignment. The problem may occur while computing the WER due to the difference between the sequence lengths of the recognized word and referenced word.

The formula to compute the word error rate (WER) is:

WER=(s+d+i)n

where s is the number of substitutions, d is the number of deletions, i is the number of insertions, and n is the number of word references.[153]

While computing, the word recognition rate (WRR) is used. The formula is:

WRR=1−WER=(n−s−d−i)n=h−in

where h is the number of correctly recognized words:

h=n−(s+d).

### Security

Speech recognition can become a means of attack, theft, or accidental operation. For example, activation words like "Alexa" spoken in an audio or video broadcast can cause devices in homes and offices to start listening for input inappropriately, or possibly take an unwanted action.[154] Voice-controlled devices may be accessible to unauthorized users. Attackers may be able to gain access to personal information, like calendars, address book contents, private messages, and documents. They may also be able to impersonate the user to send messages or make online purchases.

Two attacks have been demonstrated that use artificial sounds. One transmits ultrasound and attempts to send commands without people noticing.[155] The other adds small, inaudible distortions to other speech or music that are specially crafted to confuse the specific speech recognition system into recognizing music as speech, or to make what sounds like one command to a human sound like a different command to the system.[156]

## Further information

### Conferences

Regular conferences include SpeechTEK and SpeechTEK Europe, ICASSP, Interspeech/Eurospeech, and the IEEE ASRU. Conferences in the field of natural language processing, such as ACL, NAACL, EMNLP, and HLT, include papers on speech processing.

### Journal

The main journal is IEEE/ACM Transactions on Audio, Speech and Language Processing.

### Books

* Fundamentals of Speech Recognition by Lawrence Rabiner (1993)
* Statistical Methods for Speech Recognition by Frederick Jelinek
* Spoken Language Processing by Xuedong Huang et al. (2001)
* Computer Speech by Manfred R. Schroeder (2004)
* Speech Processing: A Dynamic and Optimization-Oriented Approach by Li Deng and Doug O'Shaughnessey (2003).
* Speech and Language Processing by Jurafsky and Martin (2008)
* Fundamentals of Speaker Recognition – in depth source for up to date details on the theory and practice.[157]
* The Voice in the Machine. Building Computers That Understand Speech by Roberto Pieraccini (2012) – Introduction
* Automatic Speech Recognition: A Deep Learning Approach by Microsoft researchers D. Yu and L. Deng (2014) – mathematically-oriented treatment of deep learning methods are[87]
* Deep Learning: Methods and Applications by L. Deng and D. Yu (2014) – methodology-focused overview of DNN-based speech recognition[83]

### Projects

The largest speech recognition-related project ongoing as of 2007 was the GALE project, which involves both speech recognition and translation components.

### Software

* Sphinx toolkit is one starting point for experimenting with speech recognition.
* HTK book and accompanying toolkit
* Kaldi toolkit can be used.[158]
* Common Voice[159][160] (uses TensorFlow).[161]
* Coqui STT[162] (derived from Common Voice, using the same open-source license)[163][164]
* Gboard supports speech recognition on all Android applications.[165]
* Speech recognition is available in Microsoft Windows operating systems.[166]
* Commercial cloud based speech recognition APIs are broadly available.

## See also

* AI effect
* ALPAC
* Application Language Tags for speech recognition
* Articulatory speech recognition
* Audio mining
* Audio-visual speech recognition
* Automatic Language Translator
* Automotive head unit
* Braina
* Cache language model
* Dragon NaturallySpeaking
* Fluency Voice Technology
* Google Voice Search
* IBM ViaVoice
* Keyword spotting
* Kinect
* Mondegreen
* Multimedia information retrieval
* Origin of speech
* Phonetic search technology
* Speaker diarisation
* Speaker recognition
* Speech analytics
* Speech interface guideline
* Speech recognition software for Linux
* Speech synthesis
* Speech verification
* Subtitle (captioning)
* VoiceXML
* VoxForge
* Windows Speech Recognition

Lists

* List of speech recognition software
* List of emerging technologies
* Outline of artificial intelligence
* Timeline of speech and voice recognition

## References

1. ↑ "What Is Speech Recognition? | IBM" (in en). 2021-09-28. https://www.ibm.com/think/topics/speech-recognition.
2. ↑ P. Nguyen (2010). "Automatic classification of speaker characteristics". International Conference on Communications and Electronics 2010. pp. 147–152. doi:10.1109/ICCE.2010.5670700. ISBN 978-1-4244-7055-6.
3. ↑ "British English definition of voice recognition". Macmillan Publishers Limited.. http://www.macmillandictionary.com/dictionary/british/voice-recognition.
4. ↑ "voice recognition, definition of". WebFinance, Inc. http://www.businessdictionary.com/definition/voice-recognition.html.
5. ↑ "The Mailbag LG #114". Linuxgazette.net. http://linuxgazette.net/114/lg_mail.html#mailbag.3.
6. ↑ Sarangi, Susanta; Sahidullah, Md; Saha, Goutam (September 2020). "Optimization of data-driven filterbank for automatic speaker verification". Digital Signal Processing 104. doi:10.1016/j.dsp.2020.102795. Bibcode: 2020DSP...10402795S.
7. ↑ Reynolds, Douglas; Rose, Richard (January 1995). "Robust text-independent speaker identification using Gaussian mixture speaker models". IEEE Transactions on Speech and Audio Processing 3 (1): 72–83. doi:10.1109/89.365379. ISSN 1063-6676. OCLC 26108901. Bibcode: 1995ITSAP...3...72R. http://www.cs.toronto.edu/~frank/csc401/readings/ReynoldsRose.pdf. Retrieved 21 February 2014.
8. ↑ "Speaker Identification (WhisperID)". Microsoft. http://research.microsoft.com/en-us/projects/whisperid/. "When you speak to someone, they don't just recognize what you say: they recognize who you are. WhisperID will let computers do that, too, figuring out who you are by the way you sound."
9. ↑ Alharbi, Sadeen; Alrazgan, Muna; Alrashed, Alanoud; Alnomasi, Turkiayh; Almojel, Raghad; Alharbi, Rimah; Alharbi, Saja; Alturki, Sahar et al. (2021). "Automatic Speech Recognition: Systematic Literature Review". IEEE Access 9: 131858–131876. doi:10.1109/ACCESS.2021.3112535. ISSN 2169-3536. Bibcode: 2021IEEEA...9m1858A.
10. ↑ Li, Suo; You, Jinchi; Zhang, Xin (August 2022). "Overview and Analysis of Speech Recognition". 2022 IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA). pp. 391–395. doi:10.1109/AEECA55500.2022.9919050. ISBN 978-1-6654-8090-1.
11. ↑ "Obituaries: Stephen Balashek". The Star-Ledger. 22 July 2012. https://obits.nj.com/obituaries/starledger/obituary.aspx?page=lifestory&pid=158702138.
12. ↑ "IBM-Shoebox-front.jpg". androidauthority.net. https://cdn57.androidauthority.net/wp-content/uploads/2012/04/IBM-Shoebox-front.jpg.
13. ↑ Juang, B. H.; Rabiner, Lawrence R.. "Automatic speech recognition–a brief history of the technology development". p. 6. http://www.ece.ucsb.edu/faculty/Rabiner/ece259/Reprints/354_LALI-ASRHistory-final-10-8.pdf.
14. ↑ GUNNAR, FANT. "ACOUSTIC THEORY OF SPEECH PRODUCTION". https://api.pageplace.de/preview/DT0400.9783110873429_A20720807/preview-9783110873429_A20720807.pdf.
15. ↑ 15.0 15.1 Melanie Pinola (2 November 2011). "Speech Recognition Through the Decades: How We Ended Up With Siri". PC World. https://www.pcworld.com/article/243060/speech_recognition_through_the_decades_how_we_ended_up_with_siri.html. Retrieved 22 October 2018.
16. ↑ Gray, Robert M. (2010). "A History of Realtime Digital Speech on Packet Networks: Part II of Linear Predictive Coding and the Internet Protocol". Found. Trends Signal Process. 3 (4): 203–303. doi:10.1561/2000000036. ISSN 1932-8346. https://ee.stanford.edu/~gray/lpcip.pdf. Retrieved 9 September 2024.
17. ↑ John R. Pierce (1969). "Whither speech recognition?". Journal of the Acoustical Society of America 46 (48): 1049–1051. doi:10.1121/1.1911801. Bibcode: 1969ASAJ...46.1049P.
18. ↑ Raj, Reddy (1937-06-17). "ACM Turing Award". https://amturing.acm.org/award_winners/reddy_6247682.cfm.
19. ↑ T. K., Vintsyuk (1968-01-01). "Speech discrimination by dynamic programming". Cybernetics 4: 52–57. doi:10.1007/BF01074755. https://link.springer.com/article/10.1007/BF01074755. Retrieved 2025-10-20.
20. ↑ Benesty, Jacob; Sondhi, M. M.; Huang, Yiteng (2008). Springer Handbook of Speech Processing. Springer Science & Business Media. ISBN 978-3-540-49125-5.
21. ↑ John Makhoul. "ISCA Medalist: For leadership and extensive contributions to speech and language processing". https://www.superlectures.com/interspeech2016/isca-medalist-for-leadership-and-extensive-contributions-to-speech-and-language-processing.
22. ↑ Blechman, R. O.; Blechman, Nicholas (23 June 2008). "Hello, Hal". The New Yorker. https://www.newyorker.com/magazine/2008/06/23/hello-hal. Retrieved 17 January 2015.
23. ↑ Klatt, Dennis H. (1977). "Review of the ARPA speech understanding project". The Journal of the Acoustical Society of America 62 (6): 1345–1366. doi:10.1121/1.381666. Bibcode: 1977ASAJ...62.1345K.
24. ↑ Rabiner (1984). "The Acoustics, Speech, and Signal Processing Society. A Historical Perspective". http://www.ece.ucsb.edu/Faculty/Rabiner/ece259/Reprints/216_historical perspective.pdf.
25. ↑ "First-Hand:The Hidden Markov Model – Engineering and Technology History Wiki". 12 January 2015. http://ethw.org/First-Hand:The_Hidden_Markov_Model.
26. ↑ 26.0 26.1 "James Baker interview". http://www.sarasinstitute.org/Audio/JimBaker(2006).mp3.
27. ↑ "Pioneering Speech Recognition". 2012-03-07. http://www-03.ibm.com/ibm/history/ibm100/us/en/icons/speechreco/.
28. ↑ Huang, Xuedong; Baker, James; Reddy, Raj (January 2014). "A historical perspective of speech recognition" (in en). Communications of the ACM 57 (1): 94–103. doi:10.1145/2500887. ISSN 0001-0782. https://dl.acm.org/doi/fullHtml/10.1145/2500887.
29. ↑ Juang, B. H.; Rabiner, Lawrence R.. ﻿Automatic speech recognition–a brief history of the technology development﻿ (Report). p. 10. http://www.ece.ucsb.edu/faculty/Rabiner/ece259/Reprints/354_LALI-ASRHistory-final-10-8.pdf. Retrieved 17 January 2015.
30. ↑ Li, Xiaochang (2023-07-01). ""There's No Data Like More Data": Automatic Speech Recognition and the Making of Algorithmic Culture" (in en). Osiris 38: 165–182. doi:10.1086/725132. ISSN 0369-7827. https://www.journals.uchicago.edu/doi/10.1086/725132.
31. ↑ "History of Speech Recognition". http://www.dragon-medical-transcription.com/history_speech_recognition.html.
32. ↑ Billi, Roberto; Canavesio, Franco; Ciaramella, Alberto; Nebbia, Luciano (1 November 1995). "Interactive voice technology at work: The CSELT experience". Speech Communication 17 (3): 263–271. doi:10.1016/0167-6393(95)00030-R. https://www.sciencedirect.com/science/article/abs/pii/016763939500030R.
33. ↑ 33.0 33.1 Xuedong Huang; James Baker; Raj Reddy (January 2014). "A Historical Perspective of Speech Recognition". Communications of the ACM. http://cacm.acm.org/magazines/2014/1/170863-a-historical-perspective-of-speech-recognition/fulltext#R5.
34. ↑ Kevin McKean (8 April 1980). "When Cole talks, computers listen". AP. Sarasota Journal. https://news.google.com/newspapers?nid=1798&dat=19800408&id=xgsdAAAAIBAJ&pg=6057,1141823.
35. ↑ "ACT/Apricot - Apricot history". http://actapricot.org/history/apricot_review_1.html.
36. ↑ Melanie Pinola (2011-11-02). "Speech Recognition Through the Decades: How We Ended Up With Siri". http://www.pcworld.com/article/243060/speech_recognition_through_the_decades_how_we_ended_up_with_siri.html?page=2.
37. ↑ "Ray Kurzweil biography". KurzweilAINetwork. http://www.kurzweilai.net/ray-kurzweil-bio.
38. ↑ Juang, B.H.; Rabiner, Lawrence. ﻿Automatic Speech Recognition – A Brief History of the Technology Development﻿ (Report). http://www.ece.ucsb.edu/Faculty/Rabiner/ece259/Reprints/354_LALI-ASRHistory-final-10-8.pdf. Retrieved 28 July 2017.
39. ↑ "Nuance Exec on iPhone 4S, Siri, and the Future of Speech". Tech.pinions. 10 October 2011. http://techpinions.com/nuance-exec-on-iphone-4s-siri-and-the-future-of-speech/3307.
40. ↑ "Switchboard-1 Release 2". https://catalog.ldc.upenn.edu/LDC97S62.
41. ↑ Jason Kincaid (13 February 2011). "The Power of Voice: A Conversation With The Head Of Google's Speech Technology". https://techcrunch.com/2011/02/13/the-power-of-voice-a-conversation-with-the-head-of-googles-speech-technology/.
42. ↑ Froomkin, Dan (2015-05-05). "THE COMPUTERS ARE LISTENING". https://firstlook.org/theintercept/2015/05/05/nsa-speech-recognition-snowden-searchable-text/.
43. ↑ Herve Bourlard and Nelson Morgan, Connectionist Speech Recognition: A Hybrid Approach, The Kluwer International Series in Engineering and Computer Science; v. 247, Boston: Kluwer Academic Publishers, 1994.
44. ↑ 44.0 44.1 Sepp Hochreiter; J. Schmidhuber (1997). "Long Short-Term Memory". Neural Computation 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276.
45. ↑ Schmidhuber, Jürgen (2015). "Deep learning in neural networks: An overview". Neural Networks 61: 85–117. doi:10.1016/j.neunet.2014.09.003. PMID 25462637. Bibcode: 2015NN.....61...85S.
46. ↑ Alex Graves, Santiago Fernandez, Faustino Gomez, and Jürgen Schmidhuber (2006). Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural nets . Proceedings of ICML'06, pp. 369–376.
47. ↑ Santiago Fernandez, Alex Graves, and Jürgen Schmidhuber (2007). An application of recurrent neural networks to discriminative keyword spotting . Proceedings of ICANN (2), pp. 220–229.
48. ↑ 48.0 48.1 Haşim Sak, Andrew Senior, Kanishka Rao, Françoise Beaufays and Johan Schalkwyk (September 2015): ""Google voice search: faster and more accurate". http://googleresearch.blogspot.ch/2015/09/google-voice-search-faster-and-more.html. ."
49. ↑ Dosovitskiy, Alexey; Beyer, Lucas; Kolesnikov, Alexander; Weissenborn, Dirk; Zhai, Xiaohua; Unterthiner, Thomas; Dehghani, Mostafa; Minderer, Matthias; Heigold, Georg; Gelly, Sylvain; Uszkoreit, Jakob; Houlsby, Neil (2021-06-03). "An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale". arXiv:2010.11929 [cs.CV].
50. ↑ Wu, Haiping; Xiao, Bin; Codella, Noel; Liu, Mengchen; Dai, Xiyang; Yuan, Lu; Zhang, Lei (2021-03-29). "CvT: Introducing Convolutions to Vision Transformers". arXiv:2103.15808 [cs.CV].
51. ↑ Vaswani, Ashish; Shazeer, Noam; Parmar, Niki; Uszkoreit, Jakob; Jones, Llion; Gomez, Aidan N; Kaiser, Łukasz; Polosukhin, Illia (2017). "Attention is All you Need". Advances in Neural Information Processing Systems (Curran Associates) 30. https://papers.nips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html. Retrieved 9 September 2024.
52. ↑ Devlin, Jacob; Chang, Ming-Wei; Lee, Kenton; Toutanova, Kristina (2019-05-24). "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding". arXiv:1810.04805 [cs.CL].
53. ↑ 53.0 53.1 Gong, Yuan; Chung, Yu-An; Glass, James (2021-07-08). "AST: Audio Spectrogram Transformer". arXiv:2104.01778 [cs.SD].
54. ↑ 54.0 54.1 Ristea, Nicolae-Catalin; Ionescu, Radu Tudor; Khan, Fahad Shahbaz (2022-06-20). "SepTr: Separable Transformer for Audio Spectrogram Processing". arXiv:2203.09581 [cs.CV].
55. ↑ 55.0 55.1 Lohrenz, Timo; Li, Zhengyang; Fingscheidt, Tim (2021-07-14). "Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognition". arXiv:2104.00120 [eess.AS].
56. ↑ "Li Deng". Li Deng Site. https://lidengsite.wordpress.com/.
57. ↑ NIPS Workshop: Deep Learning for Speech Recognition and Related Applications, Whistler, BC, Canada, Dec. 2009 (Organizers: Li Deng, Geoff Hinton, D. Yu).
58. ↑ 58.0 58.1 58.2 Hinton, Geoffrey; Deng, Li; Yu, Dong; Dahl, George; Mohamed, Abdel-Rahman; Jaitly, Navdeep; Senior, Andrew; Vanhoucke, Vincent et al. (2012). "Deep Neural Networks for Acoustic Modeling in Speech Recognition: The shared views of four research groups". IEEE Signal Processing Magazine 29 (6): 82–97. doi:10.1109/MSP.2012.2205597. Bibcode: 2012ISPM...29...82H.
59. ↑ 59.0 59.1 Deng, L.; Hinton, G.; Kingsbury, B. (2013). "New types of deep neural network learning for speech recognition and related applications: An overview". 2013 IEEE International Conference on Acoustics, Speech and Signal Processing: New types of deep neural network learning for speech recognition and related applications: An overview. p. 8599. doi:10.1109/ICASSP.2013.6639344. ISBN 978-1-4799-0356-6.
60. ↑ 60.0 60.1 Markoff, John (23 November 2012). "Scientists See Promise in Deep-Learning Programs". New York Times. https://www.nytimes.com/2012/11/24/science/scientists-see-advances-in-deep-learning-a-part-of-artificial-intelligence.html.
61. ↑ Morgan, Bourlard, Renals, Cohen, Franco (1993) "Hybrid neural network/hidden Markov model systems for continuous speech recognition. ICASSP/IJPRAI"
62. ↑ T. Robinson (1992). "A real-time recurrent error propagation network word recognition system". [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing. pp. 617–620 vol.1. doi:10.1109/ICASSP.1992.225833. ISBN 0-7803-0532-9. https://www.researchgate.net/publication/3532171.
63. ↑ Waibel, Hanazawa, Hinton, Shikano, Lang. (1989) "Phoneme recognition using time-delay neural networks . IEEE Transactions on Acoustics, Speech, and Signal Processing."
64. ↑ Baker, J.; Li Deng; Glass, J.; Khudanpur, S.; Chin-Hui Lee; Morgan, N.; O'Shaughnessy, D. (2009). "Developments and Directions in Speech Recognition and Understanding, Part 1". IEEE Signal Processing Magazine 26 (3): 75–80. doi:10.1109/MSP.2009.932166. Bibcode: 2009ISPM...26...75B.
65. ↑ Sepp Hochreiter (1991), Untersuchungen zu dynamischen neuronalen Netzen , Diploma thesis. Institut f. Informatik, Technische Univ. Munich. Advisor: J. Schmidhuber.
66. ↑ Bengio, Y. (1991). Artificial Neural Networks and their Application to Speech/Sequence Recognition (Ph.D. thesis). McGill University.
67. ↑ Deng, L.; Hassanein, K.; Elmasry, M. (1994). "Analysis of the correlation structure for a neural predictive model with application to speech recognition". Neural Networks 7 (2): 331–339. doi:10.1016/0893-6080(94)90027-2.
68. ↑ Keynote talk: Recent Developments in Deep Neural Networks. ICASSP, 2013 (by Geoff Hinton).
69. ↑ 69.0 69.1 Keynote talk: "Achievements and Challenges of Deep Learning: From Speech Analysis and Recognition To Language and Multimodal Processing ," Interspeech, September 2014 (by Li Deng).
70. ↑ "Improvements in voice recognition software increase". 27 August 2002. https://www.techrepublic.com/article/improvements-in-voice-recognition-software-increase-productivity. "Maners said IBM has worked on advancing speech recognition ... or on the floor of a noisy trade show."
71. ↑ "Voice Recognition To Ease Travel Bookings: Business Travel News". 3 March 1997. http://www.businesstravelnews.com/More-News/Voice-Recognition-To-Ease-Travel-Bookings. "The earliest applications of speech recognition software were dictation ... Four months ago, IBM introduced a 'continual dictation product' designed to ... debuted at the National Business Travel Association trade show in 1994."
72. ↑ Ellis Booker (14 March 1994). "Voice recognition enters the mainstream". Computerworld: p. 45. "Just a few years ago, speech recognition was limited to ..."
73. ↑ "Microsoft researchers achieve new conversational speech recognition milestone". 21 August 2017. https://www.microsoft.com/en-us/research/blog/microsoft-researchers-achieve-new-conversational-speech-recognition-milestone/.
74. ↑ Waibel, A.; Hanazawa, T.; Hinton, G.; Shikano, K.; Lang, K. J. (1989). "Phoneme recognition using time-delay neural networks". IEEE Transactions on Acoustics, Speech, and Signal Processing 37 (3): 328–339. doi:10.1109/29.21701. Bibcode: 1989ITASS..37..328W.
75. ↑ Bird, Jordan J.; Wanner, Elizabeth; Ekárt, Anikó; Faria, Diego R. (2020). "Optimisation of phonetic aware speech recognition through multi-objective evolutionary algorithms". Expert Systems with Applications (Elsevier BV) 153. doi:10.1016/j.eswa.2020.113402. ISSN 0957-4174. https://publications.aston.ac.uk/id/eprint/41416/1/Speech_Recog_ESWA_2_.pdf. Retrieved 9 September 2024.
76. ↑ Wu, J.; Chan, C. (1993). "Isolated Word Recognition by Neural Network Models with Cross-Correlation Coefficients for Speech Dynamics". IEEE Transactions on Pattern Analysis and Machine Intelligence 15 (11): 1174–1185. doi:10.1109/34.244678. Bibcode: 1993ITPAM..15.1174J.
77. ↑ S. A. Zahorian, A. M. Zimmer, and F. Meng, (2002) "Vowel Classification for Computer based Visual Feedback for Speech Training for the Hearing Impaired," in ICSLP 2002
78. ↑ Hu, Hongbing; Zahorian, Stephen A. (2010). "Dimensionality Reduction Methods for HMM Phonetic Recognition". ICASSP 2010. http://bingweb.binghamton.edu/~hhu1/paper/Hu2010Dimensionality.pdf.
79. ↑ Fernandez, Santiago; Graves, Alex; Schmidhuber, Jürgen (2007). "Sequence labelling in structured domains with hierarchical recurrent neural networks". Proceedings of IJCAI. http://www.aaai.org/Papers/IJCAI/2007/IJCAI07-124.pdf.
80. ↑ Graves, Alex; Mohamed, Abdel-rahman; Hinton, Geoffrey (2013). "Speech recognition with deep recurrent neural networks". arXiv:1303.5778 [cs.NE]. ICASSP 2013.
81. ↑ Waibel, Alex (1989). "Modular Construction of Time-Delay Neural Networks for Speech Recognition". Neural Computation 1 (1): 39–46. doi:10.1162/neco.1989.1.1.39. http://isl.anthropomatik.kit.edu/cmu-kit/Modular_Construction_of_Time-Delay_Neural_Networks_for_Speech_Recognition.pdf.
82. ↑ Maas, Andrew L.; Le, Quoc V.; O'Neil, Tyler M.; Vinyals, Oriol; Nguyen, Patrick; Ng, Andrew Y. (2012). "Recurrent Neural Networks for Noise Reduction in Robust ASR". Proceedings of Interspeech 2012.
83. ↑ 83.0 83.1 Deng, Li; Yu, Dong (2014). "Deep Learning: Methods and Applications". Foundations and Trends in Signal Processing 7 (3–4): 197–387. doi:10.1561/2000000039. http://research.microsoft.com/pubs/209355/DeepLearning-NowPublishing-Vol7-SIG-039.pdf.
84. ↑ Yu, D.; Deng, L.; Dahl, G. (2010). "Roles of Pre-Training and Fine-Tuning in Context-Dependent DBN-HMMs for Real-World Speech Recognition". NIPS Workshop on Deep Learning and Unsupervised Feature Learning. https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/dbn4asr-nips2010.pdf.
85. ↑ Dahl, George E.; Yu, Dong; Deng, Li; Acero, Alex (2012). "Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition". IEEE Transactions on Audio, Speech, and Language Processing 20 (1): 30–42. doi:10.1109/TASL.2011.2134090. Bibcode: 2012ITASL..20...30D.
86. ↑ Deng L., Li, J., Huang, J., Yao, K., Yu, D., Seide, F. et al. Recent Advances in Deep Learning for Speech Research at Microsoft . ICASSP, 2013.
87. ↑ 87.0 87.1 Yu, D.; Deng, L. (2014). Automatic Speech Recognition: A Deep Learning Approach (Publisher: Springer).
88. ↑ Deng, L.; Li, Xiao (2013). "Machine Learning Paradigms for Speech Recognition: An Overview". IEEE Transactions on Audio, Speech, and Language Processing 21 (5): 1060–1089. doi:10.1109/TASL.2013.2244083. Bibcode: 2013ITASL..21.1060D. http://cvsp.cs.ntua.gr/courses/patrec/slides_material2018/slides-2018/DengLi_MLParadigms-SpeechRecogn-AnOverview_TALSP13.pdf. Retrieved 9 September 2024.
89. ↑ Schmidhuber, Jürgen (2015). "Deep Learning". Scholarpedia 10 (11). doi:10.4249/scholarpedia.32832. Bibcode: 2015SchpJ..1032832S.
90. ↑ L. Deng, M. Seltzer, D. Yu, A. Acero, A. Mohamed, and G. Hinton (2010) Binary Coding of Speech Spectrograms Using a Deep Auto-encoder. Interspeech.
91. ↑ Tüske, Zoltán; Golik, Pavel; Schlüter, Ralf; Ney, Hermann (2014). "Acoustic Modeling with Deep Neural Networks Using Raw Time Signal for LVCSR". Interspeech 2014. https://www-i6.informatik.rwth-aachen.de/publications/download/937/T{u}skeZolt{a}nGolikPavelSchl{u}terRalfNeyHermann--AcousticModelingwithDeepNeuralNetworksUsingRawTimeSignalfor{LVCSR}--2014.pdf.
92. ↑ Jurafsky, Daniel (2016). Speech and Language Processing.
93. ↑ Graves, Alex (2014). "Towards End-to-End Speech Recognition with Recurrent Neural Networks". ICML. http://www.jmlr.org/proceedings/papers/v32/graves14.pdf. Retrieved 22 July 2019.
94. ↑ Amodei, Dario (2016). "Deep Speech 2: End-to-End Speech Recognition in English and Mandarin". arXiv:1512.02595 [cs.CL].
95. ↑ "LipNet: How easy do you think lipreading is?". 4 November 2016. https://www.youtube.com/watch?v=fa5QGremQf8.
96. ↑ Assael, Yannis; Shillingford, Brendan; Whiteson, Shimon; de Freitas, Nando (5 November 2016). "LipNet: End-to-End Sentence-level Lipreading". arXiv:1611.01599 [cs.CV].
97. ↑ Shillingford, Brendan; Assael, Yannis; Hoffman, Matthew W.; Paine, Thomas; Hughes, Cían; Prabhu, Utsav; Liao, Hank; Sak, Hasim; Rao, Kanishka (2018-07-13). "Large-Scale Visual Speech Recognition". arXiv:1807.05162 [cs.CV].
98. ↑ Li, Jason; Lavrukhin, Vitaly; Ginsburg, Boris; Leary, Ryan; Kuchaiev, Oleksii; Cohen, Jonathan M.; Nguyen, Huyen; Gadde, Ravi Teja (2019). "Jasper: An End-to-End Convolutional Neural Acoustic Model". Interspeech 2019. pp. 71–75. doi:10.21437/Interspeech.2019-1819. https://www.isca-archive.org/interspeech_2019/li19_interspeech.html.
99. ↑ Kriman, Samuel; Beliaev, Stanislav; Ginsburg, Boris; Huang, Jocelyn; Kuchaiev, Oleksii; Lavrukhin, Vitaly; Leary, Ryan; Li, Jason et al. (2019-10-22), QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions
100. ↑ Medeiros, Eduardo; Corado, Leonel; Rato, Luís; Quaresma, Paulo; Salgueiro, Pedro (May 2023). "Domain Adaptation Speech-to-Text for Low-Resource European Portuguese Using Deep Learning" (in en). Future Internet 15 (5): 159. doi:10.3390/fi15050159. ISSN 1999-5903.
101. ↑ Joshi, Raviraj; Singh, Anupam (May 2022). Malmasi, Shervin; Rokhlenko, Oleg; Ueffing, Nicola et al.. eds. "A Simple Baseline for Domain Adaptation in End to End ASR Systems Using Synthetic Data". Proceedings of the Fifth Workshop on E-Commerce and NLP (ECNLP 5) (Dublin, Ireland: Association for Computational Linguistics): 244–249. doi:10.18653/v1/2022.ecnlp-1.28. https://aclanthology.org/2022.ecnlp-1.28/.
102. ↑ Sukhadia, Vrunda N.; Umesh, S. (2023-01-09). "Domain Adaptation of Low-Resource Target-Domain Models Using Well-Trained ASR Conformer Models". 2022 IEEE Spoken Language Technology Workshop (SLT). IEEE. pp. 295–301. doi:10.1109/SLT54892.2023.10023233. ISBN 979-8-3503-9690-4.
103. ↑ Petrova, Magdalena (April 10, 2018). "MIT developed a headset that gives a voice to the voice inside your head". CNBC. https://www.cnbc.com/2018/04/10/mit-alterego-communicates-with-a-computer-through-subvocalization.html.
104. ↑ Kapur, Arnav; Kapur, Shreyas; Maes, Pattie (2018). "AlterEgo: A Personalized Wearable Silent Speech Interface". IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces: 43–53.
105. ↑ Chan, William; Jaitly, Navdeep; Le, Quoc; Vinyals, Oriol (2016). "Listen, Attend and Spell: A Neural Network for Large Vocabulary Conversational Speech Recognition". ICASSP. https://storage.googleapis.com/pub-tools-public-publication-data/pdf/44926.pdf. Retrieved 9 September 2024.
106. ↑ Bahdanau, Dzmitry (2016). "End-to-End Attention-based Large Vocabulary Speech Recognition". arXiv:1508.04395 [cs.CL].
107. ↑ Chorowski, Jan; Jaitly, Navdeep (8 December 2016). "Towards better decoding and language model integration in sequence to sequence models". arXiv:1612.02695 [cs.NE].
108. ↑ Chan, William; Zhang, Yu; Le, Quoc; Jaitly, Navdeep (10 October 2016). "Latent Sequence Decompositions". arXiv:1610.03035 [stat.ML].
109. ↑ Chung, Joon Son; Senior, Andrew; Vinyals, Oriol; Zisserman, Andrew (16 November 2016). "Lip Reading Sentences in the Wild". 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 3444–3453. doi:10.1109/CVPR.2017.367. ISBN 978-1-5386-0457-1.
110. ↑ Fuliang, Weng; Pongtep, Angkititrakul; Elizabeth, E. Shriberg; Larry, Heck; Stanley, Peters; John, H.L. Hansen (2016-11-04). "Conversational In-Vehicle Dialog Systems". doi:10.1109/MSP.2016.2599201. https://www.sri.com/wp-content/uploads/2021/12/conversational_in-vehicle_dialog_systems_1.pdf.
111. ↑ El Kheir, Yassine et al. (October 21, 2023), Automatic Pronunciation Assessment — A Review, Conference on Empirical Methods in Natural Language Processing
112. ↑ Isaacs, Talia; Harding, Luke (July 2017). "Pronunciation assessment" (in en). Language Teaching 50 (3): 347–366. doi:10.1017/S0261444817000118. ISSN 0261-4448.
113. ↑ Loukina, Anastassia et al. (September 6, 2015), "Pronunciation accuracy and intelligibility of non-native speech", INTERSPEECH 2015, Dresden, Germany: International Speech Communication Association, pp. 1917–1921, https://www.isca-speech.org/archive/pdfs/interspeech_2015/loukina15_interspeech.pdf, retrieved 9 September 2024, "only 16% of the variability in word-level intelligibility can be explained by the presence of obvious mispronunciations."
114. ↑ O'Brien, Mary Grantham et al. (31 December 2018). "Directions for the future of technology in pronunciation research and teaching" (in en). Journal of Second Language Pronunciation 4 (2): 182–207. doi:10.1075/jslp.17001.obr. ISSN 2215-1931. "pronunciation researchers are primarily interested in improving L2 learners' intelligibility and comprehensibility, but they have not yet collected sufficient amounts of representative and reliable data (speech recordings with corresponding annotations and judgments) indicating which errors affect these speech dimensions and which do not. These data are essential to train ASR algorithms to assess L2 learners' intelligibility.".
115. ↑ Eskenazi, Maxine (January 1999). "Using automatic speech processing for foreign language pronunciation tutoring: Some issues and a prototype" (in en). Language Learning & Technology 2 (2): 62–76. doi:10.64152/10125/25043. https://www.lltjournal.org/item/10125-25043/. Retrieved 11 February 2023.
116. ↑ Tholfsen, Mike (9 February 2023). "Reading Coach in Immersive Reader plus new features coming to Reading Progress in Microsoft Teams" (in en). Techcommunity Education Blog (Microsoft). https://techcommunity.microsoft.com/t5/education-blog/reading-coach-in-immersive-reader-plus-new-features-coming-to/ba-p/3734079.
117. ↑ Banerji, Olina (7 March 2023). "Schools Are Using Voice Technology to Teach Reading. Is It Helping?" (in en). EdSurge News. https://www.edsurge.com/news/2023-03-07-schools-are-using-voice-technology-to-teach-reading-is-it-helping.
118. ↑ Hair, Adam et al. (19 June 2018). "Apraxia world: A speech therapy game for children with speech sound disorders". Proceedings of the 17th ACM Conference on Interaction Design and Children. pp. 119–131. doi:10.1145/3202185.3202733. ISBN 978-1-4503-5152-2. https://psi.engr.tamu.edu/wp-content/uploads/2018/04/hair2018idc.pdf. Retrieved 9 September 2024.
119. ↑ "Computer says no: Irish vet fails oral English test needed to stay in Australia". The Guardian. Australian Associated Press. 8 August 2017. https://www.theguardian.com/australia-news/2017/aug/08/computer-says-no-irish-vet-fails-oral-english-test-needed-to-stay-in-australia.
120. ↑ Ferrier, Tracey (9 August 2017). "Australian ex-news reader with English degree fails robot's English test" (in en). The Sydney Morning Herald. https://www.smh.com.au/technology/australian-exnews-reader-with-english-degree-fails-robots-english-test-20170809-gxsjv2.html.
121. ↑ Main, Ed; Watson, Richard (9 February 2022). "The English test that ruined thousands of lives". BBC News. https://www.bbc.com/news/uk-60264106.
122. ↑ Joyce, Katy Spratte (January 24, 2023). "13 Words That Can Be Pronounced Two Ways". Reader's Digest. https://www.rd.com/list/words-that-can-be-pronounced-two-ways/.
123. ↑ E.g., CMUDICT, "The CMU Pronouncing Dictionary". http://www.speech.cs.cmu.edu/cgi-bin/cmudict. Compare "four" given as "F AO R" with the vowel AO as in "caught," to "row" given as "R OW" with the vowel OW as in "oat."
124. ↑ Tu, Zehai; Ma, Ning; Barker, Jon (2022). "Unsupervised Uncertainty Measures of Automatic Speech Recognition for Non-intrusive Speech Intelligibility Prediction". INTERSPEECH 2022. ISCA. pp. 3493–3497. doi:10.21437/Interspeech.2022-10408. https://www.isca-speech.org/archive/pdfs/interspeech_2022/tu22b_interspeech.pdf. Retrieved 17 December 2023.
125. ↑ Common European framework of reference for languages learning, teaching, assessment: Companion volume with new descriptors. Language Policy Programme, Education Policy Division, Education Department, Council of Europe. February 2018. p. 136. OCLC 1090351600. https://rm.coe.int/cefr-companion-volume-with-new-descriptors-2018/1680787989. Retrieved 9 September 2024.
126. ↑ [BMJ_URL_HERE "The ‘ambient scribe’ tools listening to and summarising your doctor-patient consultations"]. The BMJ. 2025. BMJ_URL_HERE. Retrieved 2026-01-30.
127. ↑ Maria, Grazia Maggio; Daniela, De Bartolo; Rocco, Salvatore Calabrò; Irene, Ciancarelli; Antonio, Cerasa; Paolo, Tonin; Fulvia, Di Iulio; Stefano, Paolucci et al. (2023-09-29). "Computer-assisted cognitive rehabilitation in neurological patients: state-of-art and future perspectives". Frontiers in Neurology 14. doi:10.3389/fneur.2023.1255319. PMID 37854065.
128. ↑ Englund, Christine (2004). Speech recognition in the JAS 39 Gripen aircraft: Adaptation to speech at different G-loads (PDF) (Masters thesis thesis). Stockholm Royal Institute of Technology. Archived (PDF) from the original on 2 October 2008.
129. ↑ "The Cockpit". https://www.eurofighter.com/the-aircraft#cockpit.
130. ↑ "Eurofighter Typhoon – The world's most advanced fighter aircraft". http://www.eurofighter.com/capabilities/technology/voice-throttle-stick/direct-voice-input.html.
131. ↑ Schutte, John (15 October 2007). "Researchers fine-tune F-35 pilot-aircraft speech system". United States Air Force. https://www.af.mil/News/story/id/123071861/.
132. ↑ John, Schutte (2007-10-17). "Researchers fine-tune F-35 pilot-aircraft speech system". https://www.afmc.af.mil/News/Article-Display/Article/154961/researchers-fine-tune-f-35-pilot-aircraft-speech-system.
133. ↑ Trenten, Walters (2022-06-27). "ATC brings simulations to the dorms". https://www.learningprofessionals.af.mil/News/Article-Display/Article/3076576/atc-brings-simulations-to-the-dorms.
134. ↑ "Overcoming Communication Barriers in the Classroom". MassMATCH. 18 March 2010. http://www.massmatch.org/aboutus/listserv/2010/2010-03-31.html.
135. ↑ 135.0 135.1 "Speech Recognition for Learning". National Center for Technology Innovation. 2010. http://www.brainline.org/content/2010/12/speech-recognition-for-learning_pageall.html.
136. ↑ "Speech recognition for disabled people". http://www.businessweek.com/1998/08/b3566022.htm.
137. ↑ Friends International Support Group
138. ↑ Garrett, Jennifer Tumlin (2011). "Using Speech Recognition Software to Increase Writing Fluency for Individuals with Physical Disabilities". Journal of Special Education Technology 26 (1): 25–41. doi:10.1177/016264341102600104. https://scholarworks.gsu.edu/epse_diss/46. Retrieved 9 September 2024.
139. ↑ Forgrave, Karen E. "Assistive Technology: Empowering Students with Disabilities." Clearing House 75.3 (2002): 122–6. Web.
140. ↑ Tang, K. W.; Kamoua, Ridha; Sutan, Victor (2004). "Speech Recognition Technology for Disabilities Education". Journal of Educational Technology Systems 33 (2): 173–84. doi:10.2190/K6K8-78K2-59Y7-R9R2.
141. ↑ "Projects: Planetary Microphones". The Planetary Society. http://www.planetary.org/programs/projects/planetary_microphones/mars_microphone.html.
142. ↑ Caridakis, George; Castellano, Ginevra; Kessous, Loic; Raouzaiou, Amaryllis; Malatesta, Lori; Asteriadis, Stelios; Karpouzis, Kostas (19 September 2007). "Multimodal emotion recognition from expressive faces, body gestures and speech" (in en). Artificial Intelligence and Innovations 2007: From Theory to Applications. IFIP the International Federation for Information Processing. 247. Springer US. pp. 375–388. doi:10.1007/978-0-387-74161-1_41. ISBN 978-0-387-74160-4. https://cris.maastrichtuniversity.nl/en/publications/024e514c-7669-4db2-8202-179a344e07d3.
143. ↑ "What is real-time captioning? | DO-IT". https://www.washington.edu/doit/what-real-time-captioning.
144. ↑ Zheng, Thomas Fang; Li, Lantian (2017). Robustness-Related Issues in Speaker Recognition. SpringerBriefs in Electrical and Computer Engineering. Singapore: Springer Singapore. doi:10.1007/978-981-10-3238-7. ISBN 978-981-10-3237-0. http://link.springer.com/10.1007/978-981-10-3238-7. Retrieved 9 September 2024.
145. ↑ Ciaramella, Alberto. "A prototype performance evaluation report." Sundial workpackage 8000 (1993).
146. ↑ Gerbino, E.; Baggia, P.; Ciaramella, A.; Rullent, C. (1993). "Test and evaluation of a spoken dialogue system". IEEE International Conference on Acoustics Speech and Signal Processing. pp. 135–138 vol.2. doi:10.1109/ICASSP.1993.319250. ISBN 0-7803-0946-4.
147. ↑ National Institute of Standards and Technology. "The History of Automatic Speech Recognition Evaluation at NIST ".
148. ↑ "8.3. Speech Recognition — Introduction to Speech Processing". https://speechprocessingbook.aalto.fi/Recognition/Speech_Recognition.html.
149. ↑ "Letter Names Can Cause Confusion and Other Things to Know About Letter–Sound Relationships" (in en). https://www.naeyc.org/resources/pubs/yc/mar2015/letter-sound-relationships.
150. ↑ "Speaker-Dependent vs. Speaker-Independent ASR" (in en). https://apxml.com/courses/introduction-to-speech-recognition/chapter-1-foundations-of-speech-recognition/speaker-dependent-vs-speaker-independent.
151. ↑ "Media Streams - WebSocket Messages | Twilio". https://www.twilio.com/docs/voice/media-streams/websocket-messages?.
152. ↑ "Sound | Properties, Types, & Facts | Britannica" (in en). 2025-09-13. https://www.britannica.com/science/sound-physics.
153. ↑ "Measuring Speech-to-Text Accuracy: Word Error Rate Explained" (in en). 2 November 2022. https://picovoice.ai/blog/measuring-word-error-rate/.
154. ↑ "Listen Up: Your AI Assistant Goes Crazy For NPR Too". NPR. 6 March 2016. https://www.npr.org/2016/03/06/469383361/listen-up-your-ai-assistant-goes-crazy-for-npr-too.
155. ↑ Claburn, Thomas (25 August 2017). "Is it possible to control Amazon Alexa, Google Now using inaudible commands? Absolutely". The Register. https://www.theregister.co.uk/2017/08/25/amazon_alexa_answers_inaudible_commands/?mt=1504024969000.
156. ↑ "Attack Targets Automatic Speech Recognition Systems". 31 January 2018. https://www.vice.com/en/article/attack-targets-automatic-speech-recognition-systems/.
157. ↑ Beigi, Homayoon (2011). Fundamentals of Speaker Recognition. New York: Springer. ISBN 978-0-387-77591-3. http://www.fundamentalsofspeakerrecognition.org.
158. ↑ Povey, D., Ghoshal, A., Boulianne, G., Burget, L., Glembek, O., Goel, N., ... & Vesely, K. (2011). The Kaldi speech recognition toolkit. In IEEE 2011 workshop on automatic speech recognition and understanding (No. CONF). IEEE Signal Processing Society.
159. ↑ "Common Voice by Mozilla". https://voice.mozilla.org/.
160. ↑ "A TensorFlow implementation of Baidu's DeepSpeech architecture: mozilla/DeepSpeech". 9 November 2019. https://github.com/mozilla/DeepSpeech.
161. ↑ "GitHub - tensorflow/docs: TensorFlow documentation". 9 November 2019. https://github.com/tensorflow/docs.
162. ↑ "Coqui, a startup providing open speech tech for everyone". https://github.com/coqui-ai.
163. ↑ Coffey, Donavyn (2021-04-28). "Māori are trying to save their language from Big Tech" (in en-GB). Wired UK. ISSN 1357-0978. https://www.wired.co.uk/article/maori-language-tech. Retrieved 2021-10-16.
164. ↑ "Why you should move from DeepSpeech to coqui.ai" (in en-US). 2021-07-07. https://discourse.mozilla.org/t/why-you-should-move-from-deepspeech-to-coqui-ai/82798.
165. ↑ "Type with your voice". https://support.google.com/gboard/answer/2781851?hl=en&co=GENIE.Platform=Android.
166. ↑ "Use voice recognition in Windows". https://support.microsoft.com/en-us/windows/use-voice-recognition-in-windows-83ff75bd-63eb-0b6c-18d4-6fae94050571.

## Further reading

* Cole, Ronald, ed (1997). Survey of the state of the art in human language technology. Cambridge Studies in Natural Language Processing. XII–XIII. Cambridge University Press. ISBN 978-0-521-59277-2.
* Junqua, J.-C.; Haton, J.-P. (1995). Robustness in Automatic Speech Recognition: Fundamentals and Applications. Kluwer Academic Publishers. ISBN 978-0-7923-9646-8.
* Karat, Clare-Marie; Vergo, John; Nahamoo, David (2007). "Conversational Interface Technologies". in Sears, Andrew. The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications (Human Factors and Ergonomics). Lawrence Erlbaum Associates Inc. ISBN 978-0-8058-5870-9.
* Pieraccini, Roberto (2012). The Voice in the Machine. Building Computers That Understand Speech.. The MIT Press. ISBN 978-0-262-01685-8.
* Pirani, Giancarlo, ed (2013). Advanced algorithms and architectures for speech understanding. Springer Science & Business Media. ISBN 978-3-642-84341-9.
* Signer, Beat; Hoste, Lode (December 2013). "SpeeG2: A Speech- and Gesture-based Interface for Efficient Controller-free Text Entry". 15th International Conference on Multimodal Interaction. Sydney, Australia. https://www.academia.edu/4685517.
* Woelfel, Matthias; McDonough, John (2009-05-26). Distant Speech Recognition. Wiley. ISBN 978-0-470-51704-8.

* v
* t
* e

Natural language processing

General terms|

* Natural language understanding
* Text corpus
* Speech corpus
* Stopwords
* Bag-of-words
* AI-complete
* n-gram (Bigram, Trigram)

Text analysis|

* Text segmentation
* Part-of-speech tagging
* Text chunking
* Compound term processing
* Collocation extraction
* Stemming
* Lemmatisation
* Named-entity recognition
* Coreference resolution
* Sentiment analysis
* Concept mining
* Parsing
* Word-sense disambiguation
* Ontology learning
* Terminology extraction
* Textual entailment
* Truecasing

Automatic summarization|

* Multi-document summarization
* Sentence extraction
* Text simplification

Machine translation|

* Computer-assisted
* Example-based
* Rule-based
* Neural

Automatic identification
and data capture|

* Speech recognition
* Speech synthesis
* Optical character recognition
* Natural language generation

Topic model|

* Pachinko allocation
* Latent Dirichlet allocation
* Latent semantic analysis

Computer-assisted
reviewing|

* Automated essay scoring
* Concordancer
* Grammar checker
* Predictive text
* Spell checker
* Syntax guessing

Natural language
user interface|

* Automated online assistant
* Chatbot
* Interactive fiction
* Question answering
* Voice user interface

* v
* t
* e

Artificial intelligence (AI)

* History
* timeline
* Glossary
* Companies
* Projects

Concepts|

* Parameter
* Hyperparameter
* Loss functions
* Regression
* Bias–variance tradeoff
* Double descent
* Overfitting
* Clustering
* Gradient descent
* SGD
* Quasi-Newton method
* Conjugate gradient method
* Backpropagation
* Attention
* Convolution
* Normalization
* Batchnorm
* Activation
* Softmax
* Sigmoid
* Rectifier
* Gating
* Weight initialization
* Regularization
* Datasets
* Augmentation
* Prompt engineering
* Reinforcement learning
* Q-learning
* SARSA
* Imitation
* Policy gradient
* Diffusion
* Latent diffusion model
* Autoregression
* Adversary
* RAG
* Uncanny valley
* RLHF
* Self-supervised learning
* Reflection
* Recursive self-improvement
* Hallucination
* Word embedding
* Vibe coding

Applications|

* Machine learning
* In-context learning
* Artificial neural network
* Deep learning
* Language model
* Large
* NMT
* Reasoning
* Model Context Protocol
* Intelligent agent
* Artificial human companion
* Humanity's Last Exam
* Lethal autonomous weapons (LAWs)
* Generative artificial intelligence (GenAI)
* (Hypothetical: Artificial general intelligence (AGI))
* (Hypothetical: Artificial superintelligence (ASI))
* Agent2Agent protocol

Implementations|

| Audio–visual|

* AlexNet
* WaveNet
* Human image synthesis
* HWR
* OCR
* Computer vision
* Speech synthesis
* 15.ai
* ElevenLabs
* Speech recognition
* Whisper
* Facial recognition
* AlphaFold
* Text-to-image models
* Aurora
* DALL-E
* Firefly
* Flux
* GPT Image
* Ideogram
* Imagen
* Midjourney
* Recraft
* Stable Diffusion
* Text-to-video models
* Dream Machine
* Runway Gen
* Hailuo AI
* Kling
* Sora
* Seedance
* Veo
* Music generation
* Riffusion
* Suno AI
* Udio

|

Text|

* Word2vec
* Seq2seq
* GloVe
* BERT
* T5
* Llama
* Chinchilla AI
* PaLM
* GPT
* 1
* 2
* 3
* J
* ChatGPT
* 4
* 4o
* o1
* o3
* 4.5
* 4.1
* o4-mini
* 5
* 5.1
* 5.2
* Claude
* Gemini
* Gemini (language model)
* Gemma
* Grok
* LaMDA
* BLOOM
* DBRX
* Project Debater
* IBM Watson
* IBM Watsonx
* Granite
* PanGu-Σ
* DeepSeek
* Qwen

Decisional|

* AlphaGo
* AlphaZero
* OpenAI Five
* Self-driving car
* MuZero
* Action selection
* AutoGPT
* Robot control

People|

* Alan Turing
* Warren Sturgis McCulloch
* Walter Pitts
* John von Neumann
* Christopher D. Manning
* Claude Shannon
* Shun'ichi Amari
* Kunihiko Fukushima
* Takeo Kanade
* Marvin Minsky
* John McCarthy
* Nathaniel Rochester
* Allen Newell
* Cliff Shaw
* Herbert A. Simon
* Oliver Selfridge
* Frank Rosenblatt
* Bernard Widrow
* Joseph Weizenbaum
* Seymour Papert
* Seppo Linnainmaa
* Paul Werbos
* Geoffrey Hinton
* John Hopfield
* Jürgen Schmidhuber
* Yann LeCun
* Yoshua Bengio
* Lotfi A. Zadeh
* Stephen Grossberg
* Alex Graves
* James Goodnight
* Andrew Ng
* Fei-Fei Li
* Alex Krizhevsky
* Ilya Sutskever
* Oriol Vinyals
* Quoc V. Le
* Ian Goodfellow
* Demis Hassabis
* David Silver
* Andrej Karpathy
* Ashish Vaswani
* Noam Shazeer
* Aidan Gomez
* John Schulman
* Mustafa Suleyman
* Jan Leike
* Daniel Kokotajlo
* François Chollet

Architectures|

* Neural Turing machine
* Differentiable neural computer
* Transformer
* Vision transformer (ViT)
* Recurrent neural network (RNN)
* Long short-term memory (LSTM)
* Gated recurrent unit (GRU)
* Echo state network
* Multilayer perceptron (MLP)
* Convolutional neural network (CNN)
* Residual neural network (RNN)
* Highway network
* Mamba
* Autoencoder
* Variational autoencoder (VAE)
* Generative adversarial network (GAN)
* Graph neural network (GNN)

Political|

* AI safety (Alignment)
* Ethics of AI
* EU AI Act
* Precautionary principle
* Regulation of AI
* Virtual politician

Social and economic|

* AI boom
* AI bubble
* AI literacy
* AI slop
* AI veganism
* AI winter
* Anthropomorphism
* In architecture
* In education
* In healthcare
* Chatbot psychosis
* Mental health
* In visual art

* Category

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Speech recognition. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Speech_recognition&oldid=4226099"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template