Storage system,Erasure Code,Reliability,Performance,Parallel I/OAs data volume keeps increasing at a rapid rate, there is an urgent need for large, reliable, and cost-effective storage systems. Erasure coding ha
To achieve reliability in distributed storage systems, data has usually been replicated across different nodes. However the increasing volume of data to be stored has motivated the introduction of erasure codes, a storage efficient alternative to replication, particularly suited for archival in data cent...
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3
FAST上还有一篇关于一致性协议的,描述的是将Raft应用到Erasure-coding的复制,感兴趣的可以看看 CRaft: An Erasure-coding-supported Version of Raft for Reducing Storage Cost and Network Cost。 Notes 限于作者水平,难免在理解和描述上有疏漏或者错误的地方,欢迎共同交流;部分参考已经在正文和参考文献列表中注明,但...
RAID and erasure coding Reliability, availability, and disaster tolerance Search and data retrieval Security In evaluating the fit of a paper for FAST, a key ingredient is the design of storage software. A paper with only hardware-level contributions will be out-of-scope; a paper could be brou...
Mobile, personal, embedded, and home storage Networking Novel and emerging storage technologies (e.g., DNA and glass storage) Performance and QoS Power-aware storage architectures RAID and erasure coding Reliability, availability, and disaster tolerance Search and data retrieval Security ...
还支持纠删码(Erasure Coding for warm storage),貌似是很牛逼的功能。 说下SeaweedFS的缺点吧:中小型文件效率非常高,但是它的单卷最大容量被程序限制到30GB,对超大文件(比如500MB以上),我感觉它的设计不是很占优势。我建议存储的文件以100MB以内的为主(当然,有少数较大的文件也没任何问题)。
Novel and emerging storage technologies (e.g., DNA storage) Performance and QoS Power-aware storage architectures RAID and erasure coding Reliability, availability, and disaster tolerance Search and data retrieval Security In evaluating the fit of a paper for FAST, a key ingredient is the design...
Customizable Multiple Storage Tiers: Customizable storage disk types to balance performance and cost. Transparent cloud integration: unlimited capacity via tiered cloud storage for warm data. Erasure Coding for warm storage Rack-Aware 10.4 erasure coding reduces storage cost and increases availability. Back...
Customizable Multiple Storage Tiers: Customizable storage disk types to balance performance and cost. Transparent cloud integration: unlimited capacity via tiered cloud storage for warm data. Erasure Coding for warm storage Rack-Aware 10.4 erasure coding reduces storage cost and increases availability. Back...