cog
feat(test-harness): add parallel execution, better error reporting, and lint fixes
#2944
Merged

feat(test-harness): add parallel execution, better error reporting, and lint fixes #2944

markphelps
markphelps feat(test-harness): add parallel execution, better error reporting, a…
f3e3c024
markphelps fix: use bash instead of sh for setup commands (dash lacks pipefail)
dd1145df
ask-bonk
ask-bonk commented on 2026-04-15
ask-bonk
markphelps feat(test-harness): add requires_tools manifest field and Replicate m…
e9fac6b6
ask-bonk
ask-bonk
ask-bonk commented on 2026-04-15
ask-bonk
markphelps feat(test-harness): stream logs with model name prefix in parallel mode
036a83f9
ask-bonk
ask-bonk commented on 2026-04-15
ask-bonk
markphelps feat(test-harness): add timing output between build and test steps
a9d7ddab
ask-bonk
ask-bonk commented on 2026-04-15
ask-bonk
markphelps feat: add --skip-schema-validation flag to cog build
80b3c8fc
ask-bonk
ask-bonk commented on 2026-04-15
ask-bonk
markphelps chore: rm manifest-replicate
b71c9338
markphelps fix(test-harness): pass --setup-timeout to cog predict/train
3fdde107
ask-bonk
ask-bonk commented on 2026-04-15
markphelps Merge branch 'main' into mphelps/test-harness-parallel-and-error-repo…
f1759e30
ask-bonk
ask-bonk
ask-bonk commented on 2026-04-15
ask-bonk
markphelps fix(test-harness): add pass/fail feedback in sequential mode
e4128678
ask-bonk
markphelps Merge branch 'main' into mphelps/test-harness-parallel-and-error-repo…
1f7c62ff
ask-bonk
markphelps chore: regen cli docs
cf7442c0
markphelps Merge branch 'mphelps/test-harness-parallel-and-error-reporting' of h…
19319adc
ask-bonk
markphelps fix(test-harness): address review findings in parallel execution and …
f3ea12d4
markphelps chore: update llm docs
d4f07ddc
ask-bonk
markphelps markphelps marked this pull request as ready for review 87 days ago
markphelps markphelps requested a review 87 days ago
markphelps markphelps requested a review from michaeldwan michaeldwan 87 days ago
markphelps markphelps requested a review from michaeldwan michaeldwan 87 days ago
markphelps markphelps requested a review from michaeldwan michaeldwan 87 days ago
markphelps markphelps requested a review from michaeldwan michaeldwan 87 days ago
markphelps feat(test-harness): unified-diff schema comparison and quiet builds
d537b25b
ask-bonk
michaeldwan
michaeldwan dismissed these changes on 2026-04-16
markphelps feat(test-harness): classify schema diffs as expected vs real failures
3cb770d2
markphelps markphelps dismissed their stale review via 3cb770d2 86 days ago
ask-bonk
markphelps chore: hide skip schema validation
893a34b4
markphelps markphelps enabled auto-merge 86 days ago
ask-bonk
disabled auto-merge 86 days ago
Manually disabled by user
markphelps markphelps merged d343eb6a into main 86 days ago
markphelps markphelps deleted the mphelps/test-harness-parallel-and-error-reporting branch 86 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone