Distributed data store

Short description: A computer network with 2 or more nodes to store information

Computer memory types

Volatile
RAM

* DRAM
* SDRAM
* DDR
* GDDR
* HBM
* SRAM

Historical

* Williams–Kilburn tube (1946–47)
* Delay line memory (1947)
* Mellon optical memory (1951)
* Selectron tube (1952)
* Dekatron
* T-RAM (2009)
* Z-RAM (2002–2010)

Non-volatile
ROM

* Mask ROM
* PROM
* EPROM
* EEPROM
* Flash memory

NVRAM

* ReRAM

Early stage NVRAM

* FeRAM
* MRAM
* PCM (3D XPoint)
* FeFET memory

Magnetic

* Magnetic tape data storage (Linear Tape-Open)
* Hard disk drive

Optical

* Optical disc
* 5D optical data storage

In development

* CBRAM
* Racetrack memory
* NRAM
* Millipede memory
* FJG RAM

Historical

* Paper data storage (1725)
* Drum memory (1932)
* Magnetic-core memory (1949)
* Plated wire memory (1957)
* Core rope memory (1960s)
* Thin-film memory (1962)
* Disk pack (1962)
* Twistor memory (~1968)
* Bubble memory (~1970)
* Floppy disk (1971)

* v
* t
* e

A distributed data store is a computer network where information is stored on more than one node, often in a replicated fashion.[1] It is usually specifically used to refer to either a distributed database where users store information on a number of nodes, or a computer network in which users store information on a number of peer network nodes.[2]

## Contents

* 1 Distributed databases
* 2 Peer network node data stores
* 3 Examples
* 3.1 Distributed non-relational databases
* 3.2 Peer network node data stores
* 4 See also
* 5 References

## Distributed databases

Distributed databases are usually non-relational databases that enable a quick access to data over a large number of nodes. Some distributed databases expose rich query abilities while others are limited to a key-value store semantics. Examples of limited distributed databases are Google's Bigtable, which is much more than a distributed file system or a peer-to-peer network,[3] Amazon's Dynamo[4] and Microsoft Azure Storage.[5]

As the ability of arbitrary querying is not as important as the availability, designers of distributed data stores have increased the latter at an expense of consistency. But the high-speed read/write access results in reduced consistency, as it is not possible to guarantee both consistency and availability on a partitioned network, as stated by the CAP theorem.

## Peer network node data stores

In peer network data stores, the user can usually reciprocate and allow other users to use their computer as a storage node as well. Information may or may not be accessible to other users depending on the design of the network.

Most peer-to-peer networks do not have distributed data stores in that the user's data is only available when their node is on the network. However, this distinction is somewhat blurred in a system such as BitTorrent, where it is possible for the originating node to go offline but the content to continue to be served. Still, this is only the case for individual files requested by the redistributors, as contrasted with networks such as Freenet, Winny, Share and Perfect Dark where any node may be storing any part of the files on the network.

Distributed data stores typically use an error detection and correction technique. Some distributed data stores (such as Parchive over NNTP) use forward error correction techniques to recover the original file when parts of that file are damaged or unavailable. Others try again to download that file from a different mirror.

## Examples

### Distributed non-relational databases

Product  | License  | High availability | Notes

|
|
|

Apache Accumulo | AL2 |  |
Aerospike | AGPL |  |
Apache Cassandra | AL2 | Yes  | formerly used by Facebook
Apache Ignite | AL2 |  |
Bigtable | Proprietary |  | used by Google
Couchbase  | AL2 |  | used by LinkedIn, PayPal, and eBay
CrateDB | AL2 | Yes  |
Apache Druid | AL2 |  | used by Netflix, and Yahoo
Dynamo | Proprietary |  | used by Amazon
Hazelcast | AL2, Proprietary  |  |
HBase  | AL2 | Yes  | formerly used by Facebook
Hypertable | GPL 2  |  | Baidu
MongoDB | SSPL |  |
MySQL NDB Cluster | GPL 2  | Yes  | SQL and NoSQL APIs
Riak | AL2 | Yes  |
Redis | BSD License  | Yes  |
Scylla | AGPL |  |
Voldemort | AL2 |  | used by LinkedIn

### Peer network node data stores

* BitTorrent
* Blockchain (database)
* Chord project
* Freenet
* GNUnet
* IPFS
* Mnet
* Napster
* NNTP (the distributed data storage protocol used for Usenet news)
* Unity, of the software Perfect Dark
* Share
* Siacoin
* DeNet
* Storage@home
* Tahoe-LAFS
* Winny
* ZeroNet

## See also

* Cooperative storage cloud
* Data store
* Keyspace, the DDS schema
* Distributed hash table
* Distributed cache
* Cyber Resilience

## References

1. ↑ Yaniv Pessach, Distributed Storage (Distributed Storage: Concepts, Algorithms, and Implementations ed.)
2. ↑ "Distributed Data Storage - an overview | ScienceDirect Topics". https://www.sciencedirect.com/topics/computer-science/distributed-data-storage.
3. ↑ "Bigtable: Google's Distributed Data Store". Paper Trail. http://the-paper-trail.org/blog/?p=86. "Although GFS provides Google with reliable, scalable distributed file storage, it does not provide any facility for structuring the data contained in the files beyond a hierarchical directory structure and meaningful file names. It’s well known that more expressive solutions are required for large data sets. Google’s terabytes upon terabytes of data that they retrieve from web crawlers, amongst many other sources, need organising, so that client applications can quickly perform lookups and updates at a finer granularity than the file level. [...] The very first thing you need to know about Bigtable is that it isn’t a relational database. This should come as no surprise: one persistent theme through all of these large scale distributed data store papers is that RDBMSs are hard to do with good performance. There is no hard, fixed schema in a Bigtable, no referential integrity between tables (so no foreign keys) and therefore little support for optimised joins."
4. ↑ Sarah Pidcock (2011-01-31). "Dynamo: Amazon's Highly Available Key-value Store". WATERLOO – CHERITON SCHOOL OF COMPUTER SCIENCE. p. 2/22. http://www.cs.uwaterloo.ca/~kdaudjee/courses/cs848/slides/sarah1.pdf. "Dynamo: a highly available and scalable distributed data store"
5. ↑ "Windows Azure Storage". 2011-09-16. http://www.microsoft.com/windowsazure/features/storage/.

ja:分散ファイルシステム#分散データストア

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Distributed data store. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Distributed_data_store&oldid=175783"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template