OneFS distributed file system

Short description: File system

OneFSDeveloper(s)| Isilon Systems

|

Full name| OneFS
Introduced| 2003; 23 years ago (2003) with OneFS 1.0 -- based on FreeBSD
Structures
Directory contents| B+ trees
File allocation| B+ trees
Limits
Max. volume size| 66PB+ (144+ nodes at 470TB+ each);[1] 65535 nodes theoretical limit
Max. file size| 16TB
Max. number of files| Cluster size dependent
Max. filename length| 255 bytes
Max. directory depth| 509 (suggested, to fit within PATH_MAX of 1023)[1]
Allowed characters in filenames| Many (UTF-8, EUC-JP, CP932, CP1252, ISO-8859-*, EUC-KR, CP949). Encoding is per-directory entry, not per-filesystem. So multiple encodings may be used in a single volume. UTF-8 is encouraged as normative. `NUL` and `/` are not allowed in individual directory entries in any encoding.
Features
Dates recorded| Create time, rename time, mtime, ctime, atime
Date range| 1970 to 2038
Date resolution| Nanosecond
Forks| Yes (extended attributes and Alternate Data Streams)
File system permissions| Yes (POSIX permissions and NTFS ACLs)
Transparent compression| Yes[2]
Transparent encryption| Integrated with Self-encrypting Drives for encryption of "data at rest"[3]
Data deduplication| Offline only
Copy-on-write| Yes (for snapshots)
Other
Supported operating systems| OneFS

The OneFS File System is a parallel distributed networked file system designed by Isilon Systems and is the basis for the Isilon Scale-out Storage Platform.[3] The OneFS file system is controlled and managed by the OneFS Operating System, a FreeBSD variant.[3]

## Contents

* 1 On-disk Structure
* 2 Clustering
* 3 Protocols
* 4 OneFS Operating System
* 5 Versions
* 6 See also
* 7 References
* 8 External links

## On-disk Structure

All data structures in the OneFS file system maintain their own protection information. This means in the same filesystem, one file may be protected at +1 (basic parity protection) while another may be protected at +4 (resilient to four failures) while yet another file may be protected at 2x (mirroring); this feature is referred to as FlexProtect.[4] FlexProtect is also responsible for automatically rebuilding the data in the event of a failure. The protection levels available are based on the number of nodes in the cluster and follow the Reed Solomon Algorithm. Blocks for an individual file are spread across the nodes. This allows entire nodes to fail without losing access to any data. File metadata, directories, snapshot structures, quotas structures, and a logical inode mapping structure are all based on mirrored B+ trees. Block addresses are generalized 64-bit pointers that reference (node, drive, blknum) tuples. The native block size is 8192 bytes; inodes are 512 bytes on disk (for disks with 512 byte sectors) or 8KB (for disks with 4KB sectors).

One distinctive characteristic of OneFS is that metadata is spread throughout the nodes in a homogeneous fashion. There are no dedicated metadata servers. The only piece of metadata that is replicated on every node is the address list of root btree blocks of the inode mapping structure. Everything else can be found from that starting point, following the generalized 64-bit pointers.

## Clustering

The collection of computer hosts that comprise a OneFS System is referred to as a "cluster". A computer host that is a member of a OneFS cluster is referred to as a "node" (plural "nodes").

The nodes that comprise a OneFS System must be connected by a high performance, low-latency back-end network for optimal performance. OneFS 1.0-3.0 used Gigabit Ethernet as that back-end network. Starting with OneFS 3.5, Isilon offered InfiniBand models. From about 2007 until mid-2018, all nodes sold utilized an InfiniBand back-end. Starting with OneFS 8.1.0 and Gen6 models, Isilon again offers Ethernet back-end network (10, 25, 40, or 100 Gigabit).[5]

Data, metadata, locking, transaction, group management, allocation, and event traffic are communicated using an RPC mechanism traveling over the back-end network of the OneFS cluster. All data and metadata transfers are zero-copy. All modification operations to on-disk structures are transactional and journaled.

## Protocols

OneFS supports accessing stored files using common computer network protocols including NFS, CIFS/SMB, FTP, HTTP, and HDFS.[3] It can utilize non-local authentication such as Active Directory, LDAP, and NIS. It is capable of interfacing with external backup devices and applications that use NDMP protocol.[3]

## OneFS Operating System

The OneFS File System is a proprietary file system that can only be managed and controlled by the FreeBSD-derived OneFS Operating System.[3]

zsh is the default login shell of the OneFS Operating System. OneFS presents a specialized command set to administer the OneFS File System.[6] Most specialized shell programs start with letters isi. Notable exceptions are the Isilon extensions to the FreeBSD `ls` and `chmod` programs.[7]

## Versions

* 1.0 "Bell," 2.0 "Jalapeno," 3.0 "Serrano," 3.5 "Tabasco"
* 4.0 "Poblano," 4.1 "Anaheim," 4.5 "Thai," 4.6 "Ancho"
* 4.7 "Chiltepin"
* 4.7.1 to .11
* 5.0 "Jamaican"
* 5.0.0 to .8
* 5.5 "Scotch Bonnet" (based on FreeBSD 6.1)[8][9]
* 5.5.1 to .2
* 5.5.3 - OS updates with rolling reboots of individual nodes.
* 5.5.4 - Adds iSCSI
* 5.5.5 to .7
* 6.0 "Habanero" - Up to 10.4 PB in a single file system
* 6.0.1 to .4
* 6.5 "Chopu" (based on FreeBSD 7.3)[8]
* 6.5.1 to .5
* 7.0 "Mavericks" - released November 2012;[10] (based on FreeBSD 7.4-STABLE)[8]
* 7.0.1 to .2
* 7.1 "Waikiki" - released October 2013[11]
* 7.1.1 "Jaws" - released July 2014[12]
* 7.2 "Moby" - released November 2014 [13]
* 7.2.0, 7.2.1 "Orca"

* 8.0 "Riptide" (based on FreeBSD 10) - released February 2016[14] \- iSCSI deprecated
* 8.0.1 "Halfpipe" - released October 2016[15]
* 8.1 "Freight Trains" - released June 2017[16]
* 8.1.1 "Niijima" - released January 2018[17][18]
* 8.1.2 "Kanagawa" - Released August 2018[19]
* 8.1.3 "Seismic" - Released January 2019
* 8.2.0 "Pipeline" (based on FreeBSD 11) - Released May 2019[20]
* 8.2.1 "Acela" - Released September 2019[21]
* 8.2.2 "Beachcomber" - Released January 2020[22]
* 9.0.0 "Cascades" - Released June 2020
* 9.1.0 "Deccan" - Released October 2020[23]
* 9.2.0 "Empire" - Released April 2021[24]
* 9.2.1 "Flying Scotsman" - Released May 2021[24]
* 9.3 "Gotham" - Released October 2021[24]
* 9.4 "Hexie" - Released April 2022[24]
* 9.5 "Islander" - Released January 2023[24]
* 9.6 "Jet Rocket" - Released May 2023[25]
* 9.7 "Key West" - Released December 2023[26]
* 9.8 - Released April 2024[24]
* 9.9 - Released August 2024[24]
* 9.10 - Released December 2024[24]

## See also

* List of file systems
* Clustered file system

## References

1. ↑ 1.0 1.1 "Isilon OneFS and IsilonSD Edge: Technical Specifications Guide". Dell Inc.. June 2018. https://support.emc.com/docu84267_Isilon-OneFS-8.1.0-and-IsilonSD-Edge:-Technical-Specifications-Guide.pdf.
2. ↑ Adam Armstrong (12 February 2019). "Dell EMC Launches All-Flash Isilon F810". Flying Pig Ventures. https://www.storagereview.com/dell_emc_launches_allflash_isilon_f810.
3. ↑ 3.0 3.1 3.2 3.3 3.4 3.5 "Dell EMC Isilon OneFS Operating System - Powering the Isilon Scale-out Storage Platform". Dell Inc.. February 2019. https://www.dellemc.com/resources/en-us/asset/white-papers/products/storage/h8202-isilon-onefs-wp.pdf.
4. ↑ "Data Protection and Backup"
5. ↑ "Isilon Gen6 Performance". Dell Inc.. https://emcworldonline.com/2017/connect/fileDownload/session/8D604A7EAE5220ED0429D93D5057DEEE/storage57.Isilon-An_Insider_Peek_Info_OneFS_Enhancements.pdf.
6. ↑ "OneFS Command Line Reference". http://isilon.custhelp.com/ci/fattach/get/262/1303833600/redirect/1.
7. ↑ Aqib Kazi (November 2018). "Isilon OneFS Authentication, Identity Management, & Authorization - Multiprotocol Data Access with a Unified Security Model". Dell EMC. http://www.emc.com/collateral/software/white-papers/h10920-wp-onefs-multiprotocol.pdf.
8. ↑ 8.0 8.1 8.2 Determined by the `__FreeBSD_version` definition in `/usr/include/sys/param.h`. See FreeBSD Porter's Handbook for more information.
9. ↑ The FreeBSD Documentation Project. "18". FreeBSD Porter's Handbook. https://www.freebsd.org/doc/en/books/porters-handbook/versions.html. Retrieved 1 December 2011.
10. ↑ Patel, Mona (16 November 2012). "EMC Isilon OneFS 7.0: Converging Big Data and The Enterprise". EMC Big Data Blog. http://bigdatablog.emc.com/2012/11/16/emc-isilon-onefs-7-0-converging-big-data-and-the-enterprise/.
11. ↑ Grocott, Sam (30 October 2013). "Isilon OneFS 7.1 Big Data Scale Out Storage Is Finally Here!". EMC Pulse Blog. http://pulseblog.emc.com/2013/10/30/the-wait-is-over-isilon-onefs-7-1-now-generally-available/.
12. ↑ Hughes, Carolyn (8 July 2014). ""Happy launch, @EMCIsilon! 2 fantastic new platforms, flash as cache, new HDFS, and performance galore on OneFS 7.1.1 "Jaws!" Way to go team!"". @carolyn_hugs Twitter. https://twitter.com/carolyn_hugs/status/486524819832188929.
13. ↑ "OneFS 7.2.x Release". Dell Inc.. 31 October 2014. https://www.dell.com/community/Isilon/OneFS-7-2-x-Release/td-p/7096370.
14. ↑ Galant, Risa (1 February 2016). "Announcing OneFS 8.0.0". http://isiblog.emc.com/2016/02/announcing-onefs-8-0-0/.
15. ↑ Noy, David (25 October 2016). "Announcing Isilon OneFS 8.0.1". https://blog.dellemc.com/en-us/announcing-onefs-8-0-0/.
16. ↑ Jolley, Todd (21 June 2017). "Dell EMC Announces the Release of Isilon Generation 6 Platform and OneFS 8.1". Dell Inc.. https://blog.dellemc.com/en-us/dell-emc-announces-the-release-of-isilon-generation-6-platform-and-onefs-8-1/.
17. ↑ Stevenson, Russ (29 January 2018). "OneFS 8.1.1.0 and Cloudera CDH 5.13+ Support for Cloudera Navigator". https://community.emc.com/community/products/isilon/blog/2018/01/29/onefs-8110-and-cloudera-cdh-514--support-for-cloudera-navigator.
18. ↑ "Isilon OneFS Version 8.1.1 Release Notes". Dell Inc.. 1 January 2018. https://support.emc.com/docu87518_Isilon-OneFS-8.1.1-Release-Notes.pdf?language=en_US.
19. ↑ "OneFS 8.1.2 Documentation - Isilon Info Hub". Dell Inc.. 3 August 2018. https://community.emc.com/docs/DOC-67098.
20. ↑ "OneFS 8.2.0 Release Notes". Dell Inc.. 3 May 2019. https://support.emc.com/docu93613_Isilon-OneFS-8.2.0-Release-Notes.pdf?language=en_US.
21. ↑ "OneFS 8.2.1 Release Notes". Dell. 6 September 2019. https://support.emc.com/ngoeSitecacheDocs/en_US/support_zone_content/product_documentation/release_notes/isilon_onefs_8-2-1_release_notes.pdf.
22. ↑ "OneFS 8.2.2 Release Notes". Dell. 16 January 2020. https://support.emc.com/ngoeSitecacheDocs/en_US/support_zone_content/product_documentation/release_notes/isilon_onefs_8-2-2_release_notes.pdf.
23. ↑ Mulford, Juan (2020-10-08). "Dell Technologies' PowerScale OneFS 9.1 Released". Storage Review. https://www.storagereview.com/news/dell-technologies-powerscale-onefs-9-1-released.
24. ↑ 24.0 24.1 24.2 24.3 24.4 24.5 24.6 24.7 Trimbee, Nick (January 2023). "Dell PowerScale OneFS: Release Contents". Dell Inc.. https://www.delltechnologies.com/asset/en-us/products/storage/industry-market/h18031-wp-powerscale-onefs-prior-release-contents.pdf.external.
25. ↑ "PowerScale OneFS 9.6.x.x. Release Notes". Dell Inc.. May 2023. https://www.dell.com/support/manuals/en-us/isilon-onefs/ifs_pub_onefs_release_notes_9600/new-features?guid=guid-ddb4cc8e-70c4-4547-8815-d703c5536722&lang=en-us.
26. ↑ Trimbee, Nick (2023-12-13). "PowerScale OneFS 9.7". https://infohub.delltechnologies.com/en-US/p/powerscale-onefs-9-7/.

## External links

* Official website

* v
* t
* e

File systems

* Comparison of file systems
* distributed
* Unix filesystem

Disk|

* ADFS
* AdvFS
* Amiga FFS
* Amiga OFS
* APFS
* AthFS
* bcachefs
* BFS
* Be File System
* Boot File System
* Btrfs
* CVFS
* CXFS
* DFS
* EFS
* Encrypting File System
* Extent File System
* Episode
* ext
* ext2
* ext3
* ext3cow
* ext4
* FFS/FFS2
* FAT
* exFAT
* Files-11
* Fossil
* HAMMER
* HAMMER2
* HFS
* HFS+
* HPFS
* HTFS
* IBM Spectrum Scale
* JFS
* LFS
* MFS
* Macintosh File System
* TiVo Media File System
* MINIX
* NetWare File System
* Next3
* NILFS
* NILFS2
* NSS
* NTFS
* OneFS
* PFS
* QFS
* QNX4FS
* ReFS
* ReiserFS
* Reiser4
* Reliance
* Reliance Nitro
* RFS
* SFS
* SNFS
* Soup (Apple)
* Tux3
* UBIFS
* UFS
* soft updates
* WAPBL
* VxFS
* WAFL
* Xiafs
* XFS
* Xsan
* zFS
* ZFS

Optical disc|

* HSF
* ISO 9660
* ISO 13490
* UDF

Flash memory and SSD|

* APFS
* FAT
* exFAT
* CHFS
* TFAT
* EROFS
* FFS2
* F2FS
* HPFS
* JFFS
* JFFS2
* JFS
* LogFS
* NILFS
* NILFS2
* NVFS
* YAFFS
* UBIFS

Distributed|

* CXFS
* GFS2
* Google File System
* OCFS2
* OrangeFS
* PVFS
* QFS
* Xsan
* more...

NAS|

* AFS (OpenAFS)
* AFP
* Coda
* DFS
* Google File System
* IBM Spectrum Scale
* Lustre
* NCP
* NFS
* POHMELFS
* Hadoop
* SMB (CIFS)
* SSHFS
* more...

Specialized|

* Aufs
* AXFS
* Boot File System
* CDfs
* Compact Disc File System
* cramfs
* Davfs2
* EROFS
* FTPFS
* FUSE
* Lnfs
* LTFS
* NOVA
* MVFS
* SquashFS
* UMSDOS
* OverlayFS
* UnionFS
* WBFS

Pseudo and virtual|

* configfs
* devfs
* debugfs
* kernfs
* procfs
* specfs
* sysfs
* tmpfs
* WinFS

Encrypted|

* eCryptfs
* EncFS
* EFS
* Rubberhose
* SSHFS
* ZFS

Types|

* Clustered
* Global
* Grid
* Self-certifying
* Flash
* Journaling
* Log-structured
* Object
* Record-oriented
* Semantic
* Steganographic
* Synthetic
* Versioning

Features|

* Case preservation
* Copy-on-write
* Data deduplication
* Data scrubbing
* Execute in place
* Extent
* File attribute
* Extended file attributes
* File change log
* Fork
* Links
* Hard
* Symbolic

Access control|

* Access control list
* Filesystem-level encryption
* Permissions
* Modes
* Sticky bit

Interfaces|

* File manager
* File system API
* Installable File System
* Virtual file system

Lists|

* Cryptographic
* Default
* Log-structured

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/OneFS distributed file system. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=OneFS_distributed_file_system&oldid=4226050"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template