JuiceFS is a distributed POSIX file system that combines object storage with a separate metadata service. It allows applications to use a conventional filesystem interface while storing file contents in scalable object storage services.
File data is divided into chunks and stored in an object storage backend. Metadata, including filenames, directory structures and file attributes, is maintained separately in a compatible database. This architecture enables JuiceFS to work with different object stores and metadata engines without tying the filesystem to a particular cloud provider.
JuiceFS is designed for shared storage in cloud-native environments, data analytics and machine learning. Applications can access the same files through different interfaces, while local caching reduces the overhead of repeated reads.
This is free and open source software.
Key Features
- Provides POSIX-compatible file operations, including extended attributes and symbolic links.
- Supports multiple metadata engines, including Redis, MySQL, PostgreSQL and TiKV.
- Works with S3-compatible and other supported object storage services.
- Provides local data caching to accelerate frequently accessed files.
- Offers distributed file locking with POSIX record locks and BSD flock support.
- Supports data compression using LZ4 and Zstandard.
- Provides encryption for stored data and supported transport connections.
- Includes a Hadoop-compatible filesystem interface for big data processing.
- Offers an S3 gateway for applications requiring object storage access.
- Provides a Kubernetes CSI driver for persistent storage integration.
- Supports shared access by multiple clients with strong filesystem consistency guarantees.
- Includes tools for collecting usage statistics and monitoring filesystem activity.
Website: github.com/juicedata/juicefs
Support:
Developer: Juicedata, Inc.
License: Apache License 2.0
JuiceFS is written in Go. Learn Go with our recommended free books and free tutorials.
Related Software
| File Systems | |
|---|---|
| HDFS | Distributed file system providing high-throughput access |
| SeaweedFS | Simple and highly scalable distributed file system |
| Lustre | File system for computer clusters |
| CephFS | Unified, distributed storage system |
| Alluxio | Virtual distributed file system |
| GlusterFS | Scale-out NAS file system |
| JuiceFS | Distributed POSIX file system |
| XtreemFS | Object-based, distributed file system for wide area networks |
| MooseFS | POSIX-compliant distributed file system |
| Quantcast File System | High-performance, fault-tolerant, distributed file system |
| OrangeFS | Multi-server scalable parallel file system |
| LeilFS | Distributed POSIX file system |
Read our verdict in the software roundup.
| S3 File Systems | |
|---|---|
| SeaweedFS | Fast distributed storage system |
| JuiceFS | Distributed POSIX file system |
| ZeroFS | Filesystem that makes S3 your primary storage |
| s3fs | Mount an S3 bucket via FUSE |
| Mountpoint for Amazon S3 | High-throughput file client |
| GeeseFS | POSIX-ish S3 file system |
| gcsfuse | Cloud Storage FUSE |
| rclone | Command line program to sync files and directories |
| Garage | S3-compatible distributed object storage service |
| S3QL | File system that stores all its data online |
| Goofys | S3 backend filey-system interface |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.