Cloud storage gateway

Short description: Type of hybrid cloud storage device

A cloud storage gateway is a hybrid cloud storage device, implemented in hardware or software, which resides at the customer premises and translates cloud storage APIs such as SOAP or REST to block-based storage protocols such as iSCSI or Fibre Channel or file-based interfaces such as NFS or SMB.[1][2]

According to a 2011 report by Gartner Group, cloud gateways were expected to increase the use of cloud storage by lowering monthly charges and eliminating the concern of data security.[3]

## Contents

* 1 Technology
* 1.1 Features
* 1.2 Functionality
* 1.3 Extensions
* 1.4 Deployment methods
* 2 Advantages
* 3 Disadvantages
* 4 Market
* 5 See also
* 6 References

## Technology

### Features

Modern applications (aka "cloud native applications") use network attached storage by means of REST and SOAP with hypertext transfer protocol on the protocol layer. The related storage is provided from arrays that offer these as object storage. Classic applications use network attached storage by means of Network File System NFS, iSCSI or Server Message Block SMB. To make use of all the advantages of object storage, existing applications need to be rewritten, and new applications must be object storage aware, which is not the case by default. This problem is addressed by cloud storage gateways. They offer object storage via classic native storage protocols like Network File System NFS or Server Message Block SMB (and a very few offer iSCSI as well). As a rule of thumb, classic applications with cloud native object storage can now be used with cloud storage gateways.

### Functionality

In enterprise infrastructures, NFS is mainly used by Linux systems whereas Windows systems are using SMB. Object storage needs data in the form of objects rather than files.[4] For all cloud storage gateways, it is mandatory to cache the incoming files and restage them to object storage on a later step. The time of destaging is subject to the gateway and a policy engine allows functions like

* pinning = bind specific files to the cache and destage them only for mirroring purpose
* content based destaging = move only files with specific characteristics to object storage e.g. all MP3 files
* multi-cloud mirroring = mirror all files to two different object stores
* Least Recently use = fill the local cache to maximum, move all files to object storage and delete files in cache on a LRU algorithm
* encrypt prior of destage = files are encrypted on the cloud storage gateway and destaged to object storage in an encrypted form
* compress and/or deduplication prior of destage = files are deduplicated and/or compressed prior of destaging
* backup data in a native backup format

Combinations of these functions are usual.[5] Default sorting schematics spanning the retrieval interface generally rely on zero-fault content processing, which carries the obvious requirement that two or more of the above functions are synchronized.[6]

### Extensions

Nearly all object storage gateways support Amazon S3 protocol as a quasi-standard. Some offer as well Microsoft Azure Blob, Google Storage, or Openstack SWIFT. Most gateways support public cloud storage e.g. from Amazon or Microsoft as an object store and Dropbox as a file drive store, there are as well a lot of vendors that support private cloud storage as well – including off and on prem storage.[7]

### Deployment methods

There are multiple variants to deploy such gateways – and some vendors support as well different variants as of their product line:

* bare metal hardware appliance
* software appliance supporting different hypervisors
* software on top of an operating system – aka FUSE based

Software appliances as well as FUSE-based gateways can be installed on public cloud infrastructures.

## Advantages

Cloud storage gateways avoid the need to change existing applications by providing a standard interface.

Additionally, IT users are used to existing protocols – like SMB or NFS. They can make use of cloud storage with the advantage of still using their existing infrastructures (including e.g. Active Directory, LDAP integration, file share functions etc.).

While cloud storage gateways initially covered a niche only, they got more attraction as of multi-cloud technologies. As an example: It is possible to run a cloud storage gateway in the form of a software appliance on top of a public or private cloud infrastructure by offering docker volume drivers that enable containers for automatic provisioning of storage used by these containers in a consistent form. They are using the hypervisors disks as a cache only, but destage data on least recently used algorithm to the underlying cloud storage.

The de facto standard for object storage is Amazon S3 – it had the most popularity and capacity installed on object storage.[8] But every object storage vendor can (and most of them do) offer Amazon S3 storage – even there is no real "standard" S3 API: Every vendor is a little bit different in implementing S3 API (as seen from the different cloud storage gateway vendors supporting the "specific" APIs of the different object storage vendors). Since 2018, an increasing number of cloud storage gateways hide this complexity by offering S3 on northbound (as of networking technologies, southbound relates to the storage used by a gateway, whereas northbound is the storage provided by the gateway). As such, one may utilize a richer S3 implementation on northbound than the southbound supports.

## Disadvantages

By using cloud storage gateways the complexity to use object storage is hidden, but that also hides some of the advantages of object storage:

* the ability of horizontal scaling
* ability to add high efficient metadata to the data content
* to use extended WORM and archiving capabilities of object storage

As applications change to cloud-aware applications (aka called cloud native applications), cloud storage gateways will change from multiprotocol gateways to multi-cloud gateways, providing access to multiple cloud providers as well as multiple southbound protocols and act as relays between different clouds.

## Market

As of 2020[update] the cloud storage gateway market was valued at over US$2 billion and was predicted to reach US$11 billion by 2026, based on a report by the market research firm Mordor intelligence.[9]

## See also

* Cloud computing
* CTERA Networks
* Panzura
* Nasuni
* Oracle Zero Data Loss Recovery Appliance

## References

1. ↑ Gary Orenstein (22 June 2010). "GigaOm, Show Me the Gateway — Taking Storage to the Cloud". http://gigaom.com/2010/06/22/show-me-the-gateway-taking-storage-to-the-cloud/.
2. ↑ Boles, Jeff. Cloud file storage pros and cons. 15 March 2011
3. ↑ Stanley Zaffos, Adam W. Couture. Hybrid Cloud Gateway Appliances Expand Cloud Storage Use Cases. Gartner Group Research G00209453. http://storageswiss.com/2014/05/09/hybrid-cloud-storage-vs-the-enterprise/10January 2011
4. ↑ SNIA. "Object Storage – Understanding the What, How and Why". https://www.snia.org/sites/default/files/Object_Storage_101.pdf.
5. ↑ "5 Ways cloud technology improves your business | Austin Technology | Perth" (in en-US). 2017-02-10. https://www.austintechnology.com.au/5-ways-cloud-technology-improves-business/.
6. ↑ Spillner, J (2012). "Flexible data distribution policy language and gateway architecture". 2012 IEEE Latin America Conference on Cloud Computing and Communications (LatinCloud). pp. 1–6. doi:10.1109/LatinCloud.2012.6508149. ISBN 978-1-4673-5163-8.
7. ↑ Kovacs, Gali. "How to Mount Amazon S3 Buckets as a Local Drive". https://cloud.netapp.com/blog/amazon-s3-as-a-file-system.
8. ↑ Columbus, Louis. "Roundup Of Cloud Computing Forecasts, 2017" (in en). https://www.forbes.com/sites/louiscolumbus/2017/04/29/roundup-of-cloud-computing-forecasts-2017/.
9. ↑ CLOUD STORAGE GATEWAY MARKET - GROWTH, TRENDS, COVID-19 IMPACT, AND FORECASTS (2021 - 2026)

* v
* t
* e

Cloud computing

As a service|

* Content as a service
* Data as a service
* Desktop as a service
* Function as a service
* Infrastructure as a service
* Mobile backend as a service
* Network as a service
* Platform as a service
* Security as a service
* Software as a service

Technologies|

* Cloud database
* Cloud storage
* Data centers
* Distributed file system for cloud
* Hardware virtualization
* Internet
* Native cloud application
* Networking
* Security
* Structured storage
* Virtual appliance
* Web APIs
* Virtual private cloud

Applications|

* Box
* Dropbox
* Google
* G Suite
* Docs, Sheets and Slides
* HP Cloud (closed)
* Microsoft Online
* Oracle Cloud
* Rackspace
* Salesforce
* Workday
* Zoho

Platforms|

* Alpha7
* Amazon Web Services
* AppScale
* Box
* Bluemix
* CloudBolt
* Cloud Foundry
* Cocaine (PaaS)
* Engine Yard
* Helion
* GE Predix
* Google App Engine
* GreenQloud
* Heroku
* Inktank
* Jelastic
* Mendix
* Microsoft Azure
* MindSphere
* Netlify
* Oracle Cloud
* OutSystems
* openQRM
* OpenShift
* PythonAnywhere
* RightScale
* Scalr
* Force.com
* SAP Cloud Platform
* VMware vCloud Air
* WaveMaker

Infrastructure|

* Amazon
* Abiquo Enterprise Edition
* CloudStack
* Citrix Cloud
* CtrlS
* DigitalOcean
* EMC Atmos
* Eucalyptus
* Fujitsu
* GoGrid
* Google Cloud Platform
* GreenButton
* GreenQloud
* IBM Cloud
* iland
* Joyent
* Lunacloud
* Mirantis
* Nimbula
* Nimbus
* OpenIO
* OpenNebula
* OpenStack
* Oracle Cloud
* OrionVM
* Rackspace Cloud
* Safe Swiss Cloud
* SoftLayer
* Zadara Storage
* libvirt
* libguestfs
* OVirt
* Virtual Machine Manager
* Wakame-vdc
* Virtual Private Cloud OnDemand

* Category
* Commons

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Cloud storage gateway. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Cloud_storage_gateway&oldid=4349731"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template