Concatenative synthesis

Short description: Method of synthesizing sounds

Concatenative synthesis is a technique for synthesising sounds by concatenating short samples of recorded sound (called units). The duration of the units is not strictly defined and may vary according to the implementation, roughly in the range of 10 milliseconds up to 1 second. It is used in speech synthesis and music sound synthesis to generate user-specified sequences of sound from a database (often called a corpus) built from recordings of other sequences.

In contrast to granular synthesis, concatenative synthesis is driven by an analysis of the source sound, in order to identify the units that best match the specified criterion.[1]

## Contents

* 1 In speech
* 2 In music
* 3 See also
* 4 References

## In speech

## In music

Concatenative synthesis for music started to develop in the 2000s in particular through the work of Schwarz[2] and Pachet[3] (so-called musaicing). The basic techniques are similar to those for speech, although with differences due to the differing nature of speech and music: for example, the segmentation is not into phonetic units but often into subunits of musical notes or events.[1][2][4]

Zero Point, the first full-length album by Rob Clouth (Mesh 2020), features self-made concatenative synthesis software called the 'Reconstructor' which "chops sampled sounds into tiny pieces and rearranges them to replicate a target sound. This allowed Clouth to use and manipulate his own beatboxing, a technique used on 'Into' and 'The Vacuum State'."[5] Clouth's concatenative synthesis algorithm was adapted from 'Let It Bee — Towards NMF-Inspired Audio Mosaicing' by Jonathan Driedger, Thomas Prätzlich, and Meinard Müller.[6][7]

Clouth's work on Zero Point was cited as an inspiration for recent innovations in concatenative synthesis as outlined in "The Concatenator: A Bayesian Approach to Real Time Concatenative Musaicing" by Chris Tralie and Ben Cantil (ISMIR 2024), which improved on the speed, accuracy, and playability of prior realtime concatenative synthesis methods.[8][9] The new algorithm serves as the engine behind the Concatenator plugin by DataMind Audio, which is currently still in beta.[10]

## See also

* Granular synthesis
* VOCALOID
* UTAU

## References

1. ↑ 1.0 1.1 Schwarz, D. (2005), "Current research in Concatenative Sound Synthesis", Proceedings of the International Computer Music Conference (ICMC), http://recherche.ircam.fr/equipes/analyse-synthese/schwarz/publications/icmc2005/Schwarz_ICMC2005_Current-Research.pdf
2. ↑ 2.0 2.1 Schwarz, Diemo (2004-01-23), Data-Driven Concatenative Sound Synthesis, http://recherche.ircam.fr/equipes/analyse-synthese/schwarz/thesis/, retrieved 2010-01-15
3. ↑ Zils, A.; Pachet, F. (2001), "Musical Mosaicing", Proceedings of the COST G-6 Conference on Digital Audio Effects (DaFx-01), University of Limerick: 39–44, http://www.csl.sony.fr/downloads/papers/2001/zils-dafx2001.pdf, retrieved 2011-04-27
4. ↑ Maestre, E. and Ramírez, R. and Kersten, S. and Serra, X. (2009), "Expressive Concatenative Synthesis by Reusing Samples from Real Performance Recordings", Computer Music Journal 33 (4): 23–42, doi:10.1162/comj.2009.33.4.23
5. ↑ "Zero Point, by Rob Clouth" (in en). https://robclouth.bandcamp.com/album/zero-point.
6. ↑ (in en) Sónar+D CCCB 2020 Talk: "Journey to the Center of the Musical Brain", 29 October 2020, https://www.youtube.com/watch?v=O7IpRDuvZJQ, retrieved 2022-07-23
7. ↑ "AudioLabs - Let it Bee - Towards NMF-inspired Audio Mosaicing". https://www.audiolabs-erlangen.de/resources/MIR/2015-ISMIR-LetItBee.
8. ↑ "Error: no `|title=` specified when using {{Cite web}}". https://www.ctralie.com/TheConcatenator/supplementary/.Error:+no+`|title=`+specified when+using+{{[[Template:Cite+web|Cite+web]]}}[[Category:Articles+with+incorrect+citation+syntax|Concatenative+synthesis]]&rft.atitle=&rft_id=https://www.ctralie.com/TheConcatenator/supplementary/&rfr_id=info:sid/en.wikibooks.org:Concatenative_synthesis">
9. ↑ LLC, Conference Catalysts (2024-09-16). "Accepted Papers" (in en). https://ismir2024.ismir.net/accepted-papers.
10. ↑ "DataMind Audio | Unparalleled Real-time Neural Synthesis" (in en-US). https://datamindaudio.ai/.

* v
* t
* e

Speech synthesis

Free software|

| Speaking|

* eSpeak]]/eSpeakNG
* Gnopernicus
* Gnuspeech
* Orca
* Festival Speech Synthesis System/Flite
* FreeTTS
* Automatik Text Reader

|

Singing|

* eCantorix
* Lyricos / Flinger
* Sinsy

Proprietary
software|

| Speaking|

* DECtalk
* Software Automatic Mouth
* Talk It!
* Microsoft Agent
* Microsoft Speech API
* Microsoft text-to-speech voices
* Readspeaker
* Voice browser
* CoolSpeech
* IVONA
* CereProc
* CeVIO Creative Studio
* Voiceroid
* LaLaVoice

|

Singing|

* Alter/Ego
* Cantor
* CeVIO Creative Studio
* Chipspeech
* Symphonic Choirs
* Vocaloid
* NIAONiao Virtual Singer
* Vocalina
* Utau
* Realivox
* PPG Phonem

Machine|

* Echo 2
* Mockingboard
* Pattern playback
* Phasor
* RIAS
* Texas Instruments LPC Speech Chips
* General Instrument SP0256
* TuVox

Applications|

* AOLbyPhone
* DialogOS
* Dr. Sbaitso
* MBROLA
* Microsoft Narrator
* Microsoft Speech Server
* PlainTalk
* Voice font

Protocols|

* Speech Synthesis Markup Language
* SABLE
* VoiceXML

Developers/
Researchers|

* Alan W. Black
* Catherine Browman
* Franklin Seaney Cooper
* Gunnar Fant
* Haskins Laboratories
* Wolfgang von Kempelen
* Ignatius Mattingly
* Philip Rubin
* Yamaha

Process|

* Articulatory synthesis
* Concatenative synthesis
* Currah
* Inverse filter
* PSOLA
* Phase vocoder
* Self-voicing

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Concatenative synthesis. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Concatenative_synthesis&oldid=4347891"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template