Skip to content

Stream batch inputs from --input-file (.txt + CSV)#24

Open
paulius-krutkis-dcd wants to merge 1 commit into
mainfrom
batch-input-parsing
Open

Stream batch inputs from --input-file (.txt + CSV)#24
paulius-krutkis-dcd wants to merge 1 commit into
mainfrom
batch-input-parsing

Conversation

@paulius-krutkis-dcd

Copy link
Copy Markdown
Collaborator

Part 1 of 4 for the batch-input feature. Builds on main.

Adds the batch input-parsing layer (src/batch/): lazily read inputs from a file, one per item, without loading the whole file into memory.

  • .txt — one trimmed input per line; blank lines skipped.
  • .csv — requires --input-column; quote-aware line parser handles commas and escaped quotes inside fields.
  • Usage/validation errors for a missing column flag or unknown column.

Unit tests only — no SDK calls.

Stack: 1/4 (this) → 2/4 batch-executor → 3/4 batch-output → 4/4 wire-batch-flags

Add the batch input-parsing layer: lazily read inputs from a file, one
per item, without buffering the whole file in memory.

- .txt: one trimmed input per line, blank lines skipped.
- .csv: requires --input-column; quote-aware line parser handles commas
  and escaped quotes inside fields.
- Usage/validation errors for missing column flag and unknown column.

Unit tests only; no SDK calls.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant