Implements the foundation of tidalDB's data pipeline: **Phase 1 – Schema primitives** - EntityId newtype (u64, big-endian ordering) - SignalTypeDefinition with pre-computed decay λ, deduped/sorted windows - SchemaBuilder with full constraint validation (duplicates, identifiers, half-life, windows, velocity) - LumenError wrapping all subsystems with required From impls **Phase 2 – Write-Ahead Log** - Length-prefixed, BLAKE3-protected entry format - Group-commit writer (batch up to 100 events / 10 ms) - Double-buffered content-hash deduplication - Checkpoint, truncation, and crash-recovery with full replay - Integration, property, and UAT tests (incl. 5,500-event deterministic UAT) - Proptest coverage scaled to 10 000 events/run (was ≤500) to meet acceptance criterion; cases reduced 100→10 to keep runtime comparable **Phase 3 – Storage engine** - StorageEngine trait (get/put/delete/scan/batch/flush) - Key encoding: [EntityId][0x00][Tag][suffix] with ordering/prefix helpers - InMemoryBackend (BTreeMap + RwLock) - FjallStorage with three isolated keyspaces and atomic batch helper - Property tests for key ordering and round-trip correctness Also adds planning docs for phases 4-5, research docs, architecture overview, and roadmap updates. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
14 lines
414 B
Rust
14 lines
414 B
Rust
pub mod entity;
|
|
pub mod error;
|
|
pub mod score;
|
|
pub mod signal;
|
|
pub mod timestamp;
|
|
pub mod validation;
|
|
|
|
pub use entity::{EntityId, EntityKind};
|
|
pub use error::{DurabilityError, LumenError, QueryError, SchemaError, StorageError};
|
|
pub use score::Score;
|
|
pub use signal::{DecayModel, SignalTypeDef, Window, WindowSet};
|
|
pub use timestamp::Timestamp;
|
|
pub use validation::{DecaySpec, Schema, SchemaBuilder, SignalBuilder};
|