Writing · Tagged
1 article
The data pipeline behind the warehouse system: spreadsheet exports, safe imports, gRPC streaming, typed validation errors, staging tables, and an atomic swap against the ERP database.
Ask PostgreSQL for 100 random rows and it may still evaluate a random key for every candidate. `LIMIT 100` does not make the other rows disappear.
The operational side of the warehouse system: a shared 4 GB Debian server, no Docker, Koa for the hot path, gRPC for isolated jobs, Unix pipes for log forwarding, and one painful native dependency.