Env:
1、4 nodes for hot data
2、4 nodes for cold data
3、centos7 kvm
After upgrading from beta.10 to beta.11, the RustFS service fails to start and login via the web frontend is unavailable. The relevant error logs are as follows:
1、
{"timestamp":"2026-07-23T15:45:24.189098641+08:00","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"[::ffff:192.168.120.67]:37954","error_kind":"hyper_error","error":"hyper::Error(Io, Kind(BrokenPipe))","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":1825,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}
{"timestamp":"2026-07-23T15:45:24.282120233+08:00","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"[::ffff:192.168.120.63]:58822","error_kind":"hyper_error","error":"hyper::Error(Io, Kind(BrokenPipe))","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":1825,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}
2、
{"timestamp":"2026-07-23T15:53:44.731553416+08:00","level":"ERROR","message":"ECStore initialization failed","event":"startup_storage_stage","component":"main","subsystem":"storage","stage":"ecstore_initialization","state":"failed","error":"Io(Custom { kind: Other, error: \"store init failed to load formats after 10 retries: erasure read quorum\" })","target":"rustfs::main::run","filename":"rustfs/src/startup_storage.rs","line_number":169,"threadName":"main","threadId":"ThreadId(1)"}
{"timestamp":"2026-07-23T15:53:44.731810143+08:00","level":"ERROR","message":"Server runtime failed","event":"server_runtime_failed","component":"main","subsystem":"startup","error":"store init failed to load formats after 10 retries: erasure read quorum","target":"rustfs::main","filename":"rustfs/src/startup_entrypoint.rs","line_number":104,"threadName":"main","threadId":"ThreadId(1)"}
{"timestamp":"2026-07-23T15:53:44.961709729+08:00","level":"ERROR","message":"RPC auth secret resolution failed: RPC authentication secret is not configured; RUSTFS_RPC_SECRET can be set explicitly; otherwise the RPC secret is derived from the active access/secret key pair","target":"rustfs_ecstore::cluster::rpc::http_auth","filename":"crates/ecstore/src/cluster/rpc/http_auth.rs","line_number":136,"threadName":"main","threadId":"ThreadId(1)"}
3、
root@mysql-dev-5 /mnt$ journalctl -u rustfs-cold -l -f
-- Logs begin at Tue 2025-10-14 11:17:13 CST. --
Jul 23 15:53:43 mysql-dev-5 systemd[1]: rustfs-cold.service holdoff time over, scheduling restart.
Jul 23 15:53:43 mysql-dev-5 systemd[1]: Stopped RustFS Cold Tier (HDD).
Jul 23 15:53:43 mysql-dev-5 systemd[1]: Started RustFS Cold Tier (HDD).
Jul 23 15:55:49 mysql-dev-5 rustfs[29556]: [FATAL] Server runtime failed: store init failed to load formats after 10 retries: erasure read quorum
Jul 23 15:55:49 mysql-dev-5 systemd[1]: rustfs-cold.service: main process exited, code=exited, status=1/FAILURE
Jul 23 15:55:49 mysql-dev-5 systemd[1]: Unit rustfs-cold.service entered failed state.
Jul 23 15:55:49 mysql-dev-5 systemd[1]: rustfs-cold.service failed.
Jul 23 15:55:50 mysql-dev-5 systemd[1]: rustfs-cold.service holdoff time over, scheduling restart.
Jul 23 15:55:50 mysql-dev-5 systemd[1]: Stopped RustFS Cold Tier (HDD).
Jul 23 15:55:50 mysql-dev-5 systemd[1]: Started RustFS Cold Tier (HDD).
Env:
1、4 nodes for hot data
2、4 nodes for cold data
3、centos7 kvm
After upgrading from beta.10 to beta.11, the RustFS service fails to start and login via the web frontend is unavailable. The relevant error logs are as follows:
1、
2、
3、