Skip to main content

01 Event data infrastructureStreams live

Events in
order.
State in reach.

Ferrite is infrastructure for data in motion. A durable ordered log, a stateful stream runtime and read surfaces engineering teams can reason about — so an event can change what a system knows the moment it arrives.

Ordered events threading a lattice of addressable stateA grid of square cores represents keyed state partitions. A continuous lit line enters from the left, threads through the grid row by row, and exits right, illustrating an ordered event stream reading and updating state in place while packets travel along each rail.INGESTORDER + STATESERVEKEYED PARTITIONSACTIVE STATE

Fig. 1 — Conceptual model: ordered events threading keyed state

Ordering

Per-key sequence preserved end to end

Recovery

State rebuilt by replaying the log

Operability

Behaviour you can inspect while it runs

02 Context

Most data platforms were designed to answer questions about the past.

Warehouses and batch pipelines are excellent at describing what already happened. They are a poor fit when a decision has to be made while the event is still relevant — a payment being authorised, a device reporting a fault, an account changing state.

Teams usually close that gap with bespoke queues, caches and cron jobs. It works until ordering, retries and partial failure start producing results nobody can explain.

Ferrite treats the ordered event stream as the primary source of truth, and makes the state derived from it a first-class, queryable part of the system.

03The system

Four stages, one continuous path

Data enters once, keeps its order, updates state as it passes, and leaves through surfaces built for reading. Each stage is separately observable and separately scalable.

  1. AEdge

    Ingest gateway

    • · Producer connections
    • · Schema validation at the boundary
    • · Backpressure signalling
  2. BOrder

    Durable event log

    • · Append-only partitions
    • · Per-key ordering
    • · Replayable offsets
  3. CCompute

    Stateful runtime

    • · Keyed operators
    • · Windowing and joins
    • · Checkpointed local state
  4. DServe

    Read surfaces

    • · Materialised views
    • · Change subscriptions
    • · Sink connectors
Fig. 2 — Stage model of the Ferrite platform, edge to read surface

04Components

What you actually run

Ordered log

An append-only, partitioned event log. Producers append; consumers read by offset; history stays replayable so state can always be rebuilt from source.

Stateful runtime

Keyed operators that filter, enrich, join and window events while holding local state next to the computation, checkpointed for recovery.

Read surfaces

Materialised views and change subscriptions, so applications can query current derived state or follow it as it changes.

Control plane

Deployment, versioning and observability for stream workloads: what is running, on which code, consuming from where.

Platform in detail

05Applied

Where an ordered stream changes the design

  1. 01Operational decisioningEvaluate rules and models against a live event stream instead of yesterday's table.
  2. 02System of record synchronisationPropagate committed changes between services without nightly reconciliation jobs.
  3. 03Telemetry and device streamsAggregate high-cardinality signals per key and keep the aggregate queryable.
  4. 04Continuous auditabilityRetain the ordered history that produced a result, so it can be replayed and inspected.

06Operating posture

Built to be run, not just demonstrated

Streaming systems fail in ways batch systems do not: skew, late data, hot keys, poison records. The platform is designed so those conditions are visible and recoverable rather than silent.

Replay

Reprocess from a chosen offset to rebuild derived state.

Isolation

Workloads are versioned and deployed independently.

Backpressure

Slow downstream stages signal upstream instead of dropping work.

Inspection

Per-operator and per-partition progress is exposed.

Next step

Bring us your data flow, not a form.

Tell us where events originate, what has to happen to them and what currently breaks. We will respond with an architecture-level answer.