Intake
A collector sends a batch. Each record gets a tenant, a receive time and a stable ID, and is written raw before the batch is acknowledged.
The ID hashes the tenant, the file offset and the bytes, so a collector's retry is stored once.
- CollectorVector tails the log file
- Intaketenant demo, evt_0f9ec7592d208b33
- ClickHouseraw table, written first
- Acknowledgedonly after the write returns
ts=2026-09-24T08:11:47.717+01:00 app=authgw node=gw-02 evt=login_fail user=niamh.kelly@corp.example src=10.20.2.76 mfa=webauthn reason=bad_password session=cb1a806b1dfaaffc- received
- 2026-09-24T07:11:48.129Z
- source
- collector-01 /var/log/authgw/auth.log
- state
- stored raw, unparsed