Sample-based synthesis

This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. Find sources: "Sample-based synthesis" – news · newspapers · books · scholar · JSTOR (February 2024) (Learn how and when to remove this message)

Sample-based synthesis is a form of audio synthesis that can be contrasted to either subtractive synthesis or additive synthesis. The principal difference with sample-based synthesis is that the seed waveforms are sampled sounds or instruments instead of fundamental waveforms such as sine and saw waves used in other types of synthesis.^[1]

Before digital recording became practical, instruments such as the Welte Lichttonorgel [de] (1930s), phonogene (1950s) and the Mellotron (1960s) used analog optical disks or analog tape decks to play back sampled sounds.

When sample-based synthesis was first developed,^{[when?][who?]} most affordable consumer synthesizers^{[clarification needed]} could not record arbitrary samples, but instead formed timbres by combining pre-recorded samples from ROM^{[citation needed]} before routing the result through analog or digital filters. These synthesizers and their more complex descendants are often referred to as ROMplers.

Sample-based instruments have been used since the Computer Music Melodian, the Fairlight CMI and the NED Synclavier. These instruments were way ahead of their time and were correspondingly expensive. The first recording using a sampling synthesizer was "Stevie Wonder's Journey Through "The Secret Life of Plants"" (1979)^{[citation needed]} which used the Computer Music Melodian to create complex melodies and rhythms^{[citation needed]} from sampled sounds from nature. The first tune Wonder recorded was "The First Garden" where he used a sampled bird chirp as the lead sound in the song. More affordable^{[peacock prose]} sample-based synthesizers available for the masses with the introduction of the Ensoniq Mirage (1984), Roland D-50 (1987) and the Korg M1 (1988), which surfaced in the late eighties. The M1 also introduced^{[citation needed]} the music workstation concept.

The concept has made it into sound cards for the multimedia PC, under the names such as wavetable card or wavetable daughterboard.^{[citation needed]} (See Wavetable synthesis#Background)

The principal advantage of sample-based synthesis over other methods of digital synthesis such as physical modelling synthesis or additive synthesis is that processing power requirements are much lower. This is because most of the nuances of the sound models are contained in the prerecorded samples rather than calculated in realtime.

In a contrast to analog synthesizers, the circuitry does not have to be duplicated to allow more voices to be played at once. Therefore the polyphony of sample-based machines is generally a lot higher. A downside is, however, that in order to include more detail, multiple samples might need to be played back at once (a trumpet might include a breath noise, a growl, and a looping soundwave used for continuous play). This reduces the polyphony again, as sample-based synthesizers rate their polyphony based on the number of multi-samples that can be played back simultaneously.

A sample-based synthesizer's ability to reproduce the nuances of natural instruments is determined primarily by its library of sampled sounds. In the earlier days of sample-based synthesis, computer memory was expensive and samples had to be as short and as few as possible. This was achieved by looping a part of the sample (often a single wave), and then using a volume envelope curve to make the sound fade away. An amplifying stage would translate key velocity into gain so that harder playing would translate into louder playback. In some cases key velocity also modulates the attack time of the instrument, leading to a faster attack for loud passages.

As memory became cheaper, it became possible to use multisampling; instead of a single recording of an instrument being played back faster or slower to reproduce other pitches, the original instrument could be sampled at regular intervals to cover regions of several adjacent notes (splits) or for every note. This provides a more natural progression from the lower to the higher registers; lower notes don't sound dull, and higher notes don't sound unnaturally bright. It is also possible to sample the same note at several different levels of intensity, reflecting the fact that both volume and timbre change with playing style. For instance, when sampling a piano, 3 samples per key can be made; soft, medium and with force. Every possible volume in between can be made by amplifying and blending the samples.

For sample-based models of instruments like the Rhodes piano, this multisampling is very important. The timbre of the Rhodes changes drastically from left to right on the keyboard, and it varies greatly depending on the force with which the key is struck. The lower registers bark, while the higher range has a more bell-like sound. The bark will be more distinct if the keys are struck with force. For the model to be sufficiently expressive, it is therefore necessary that multisamples be made across both pitch and force of playing.

A more flexible sample-based synthesis design allowing the user to record arbitrary waveforms to form a sound's basic timbre is called a sampler. Early samplers were very expensive, and typically had low sample rates and bit depth, resulting in grainy and aliased sound. Since the late-1980s, however, samplers have featured specifications at least as good as CDs. By the late 1990s, the huge increases in computer processor speed permitted the widespread development of software synthesizers and software samplers. The vast storage capacity of modern computers was ideally suited to sample-based synthesis, and many samplers have thus migrated to software implementations or been superseded by new software samplers.

• Rompler
• SoundFont