Part of #69
Description
Investigate two approaches for handling large CSV files that don't fit in memory:
- SQLite virtual table () — streaming CSV input via a virtual table interface
- Disk-backed temp storage (
PRAGMA temp_store = FILE) — configure SQLite to spill to disk automatically
Produce a written recommendation (implementation notes, trade-offs, estimated effort) to guide sub-issues 2–5.
Acceptance Criteria
Notes
- The disk-backed approach may deliver 80% of the value with 20% of the complexity
- Start with PRAGMA temp_store = FILE since it requires no query-semantic changes
- Timebox to 4 hours max
Part of #69
Description
Investigate two approaches for handling large CSV files that don't fit in memory:
PRAGMA temp_store = FILE) — configure SQLite to spill to disk automaticallyProduce a written recommendation (implementation notes, trade-offs, estimated effort) to guide sub-issues 2–5.
Acceptance Criteria
Notes