Skip to content

A6.4: Wire batch flags into scrape/search/screenshot/codegen#23

Closed
paulius-krutkis-dcd wants to merge 1 commit into
batch-outputfrom
scr-3181-wire-batch-flags
Closed

A6.4: Wire batch flags into scrape/search/screenshot/codegen#23
paulius-krutkis-dcd wants to merge 1 commit into
batch-outputfrom
scr-3181-wire-batch-flags

Conversation

@paulius-krutkis-dcd

Copy link
Copy Markdown
Collaborator

Last of four stacked PRs for A6 — batch input (SCR-3092). Ties the previous layers into the actual commands.

  • Attaches --input-file, --input-column, --concurrency to every scrape-style command (scrape, search, screenshot, and all codegen targets).
  • createTargetAction detects batch mode, rejects --input-file combined with a positional input, and otherwise runs each input through the same body builder + SDK call with bounded concurrency.
  • Primary positional args are now optional, so the input can come from the file; a genuinely missing input raises a CliUsageError.
  • Binary targets (screenshot) write one file per item and require -o <dir>; non-binary targets stream ndjson by default or write per-item JSON files when -o <dir> is given.

Integration tests cover flag exposure and the usage-error paths; the orchestrator is unit-tested end to end without network calls.

Based on scr-3180-batch-output — review/merge A6.3 (#22) first.

Stack: A6.1 (#20) → A6.2 (#21) → A6.3 (#22) → A6.4 (this)

Closes SCR-3181.

🤖 Generated with Claude Code

Attach --input-file, --input-column and --concurrency to every
scrape-style command and dispatch into the batch pipeline when
--input-file is present.

- createTargetAction detects batch mode, rejects --input-file combined
  with a positional input, and otherwise runs each input through the
  same body builder + SDK call with bounded concurrency.
- Primary positional args are now optional so the input can come from
  the file instead; a genuinely missing input raises a CliUsageError.
- Binary targets (screenshot) write one file per item and require -o
  <dir>; non-binary targets stream ndjson or write per-item JSON files.

Integration tests cover flag exposure and the usage-error paths; the
orchestrator is unit-tested end to end without network calls.

Depends on A6.2 + A6.3 (SCR-3181).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@paulius-krutkis-dcd paulius-krutkis-dcd deleted the scr-3181-wire-batch-flags branch June 9, 2026 12:36
@paulius-krutkis-dcd

Copy link
Copy Markdown
Collaborator Author

Superseded by #27 (rebranched to drop internal ids).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant