SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

大数据入门指南 ⭐

Ceph is a distributed object, block, and file storage platform

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Utils for streaming large files (S3, HDFS, gzip, bz2...)

The Universal Storage Engine

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly

A native go client for HDFS

A pure python HDFS client

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

💎🔥大数据学习笔记

Real Time Analytics and Data Pipelines based on Spark Streaming

Deprecated - See Lenses.io Community Edition

CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underlying resource management and maintenance.

Big Data Ecosystem Docker

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Fundamentals of Spark with Python (using PySpark), code examples