It's A Digital Disease!

23 readers

1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago

MODERATORS

DeepSeek Realse 5th Bomb! Cluster Bomb Again! 3FS (distributed file system) & smallpond (A lightweight data processing framework) (zerobytes.monster)

submitted 6 months ago by bOt@zerobytes.monster to c/datahoarder@zerobytes.monster

0 comments fedilink hide all child comments

The original post: /r/datahoarder by /u/notlongnot on 2025-02-28 02:14:26.

I can't believe DeepSeek has even revolutionized storage architecture... The last time I was amazed by a network file system was with HDFS and CEPH. But those are disk-oriented distributed file systems. Now, a truly modern SSD and RDMA network-oriented file system has been born!

3FS

The Fire-Flyer File System (3FS) is a high-performance distributed file system designed to address the challenges of AI training and inference workloads. It leverages modern SSDs and RDMA networks to provide a shared storage layer that simplifies development of distributed applications

link: https://github.com/deepseek-ai/3FS

smallpond

A lightweight data processing framework built on DuckDB and 3FS.

link: https://github.com/deepseek-ai/smallpond

https://preview.redd.it/inqemmkh6sle1.png?width=854&format=png&auto=webp&s=1f451f20a22278229810505083e59b914b64fd82

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here