Part of #69
Depends on #69-spike (evaluate streaming approaches)
Description
Implement the simpler streaming approach: configure SQLite to use disk-backed temp storage for large datasets. This allows all SQL operations to continue working on datasets larger than RAM, without changing query semantics.
Acceptance Criteria
Notes
- Use
PRAGMA temp_store_directory to configure temp location
- No changes to query parsing or output — only storage backend changes
- Follow spike recommendation on exact PRAGMA configuration
Part of #69
Depends on #69-spike (evaluate streaming approaches)
Description
Implement the simpler streaming approach: configure SQLite to use disk-backed temp storage for large datasets. This allows all SQL operations to continue working on datasets larger than RAM, without changing query semantics.
Acceptance Criteria
--memory-limit <size>flag sets a hint for SQLite temp storage threshold (e.g.256MB,1GB)PRAGMA temp_store = FILEwhen memory limit is setNotes
PRAGMA temp_store_directoryto configure temp location