Lioran S3 V1 pre-alpha design details failure windows and crash recovery limits
Swaraj Puppalwar, CTO of Lioran Group, has detailed the current write pipeline for the Lioran S3 V1 storage engine in its pre-alpha stage. The design clarifies specific failure windows that exist between physical data promotion and metadata commitment to a RocksDB database. The system currently relies on application-level rollback, which cannot handle an uncontrolled process crash occurring between these two steps. This can theoretically lead to orphaned physical files on disk, though not to exposure of partial data. The author notes that achieving true atomicity across the filesystem and database would require more complex durable state machinery beyond the current implementation.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in