transformers
bd5df99a - [OLMoE] Update expected logits for A10G and add torch.no_grad() (#47989)

Commit
3 days ago
[OLMoE] Update expected logits for A10G and add torch.no_grad() (#47989) * [OLMoE] Update expected logits for A10G and add torch.no_grad() Expected values in test_model_7b_logits were stale (3/8 mean elements mismatched). Updated to values captured on A10G. Also added torch.no_grad() consistent with other integration tests. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * Fix OLMo2/OLMo3 slow test failures (OOM + stale logits) - Add `tearDownClass` to `Olmo3InternalIntegrationTest` and `Olmo3IntegrationTest` so each class's model is freed before the next class loads, preventing VRAM exhaustion (~14 GB per 7B model) - Add `with torch.no_grad():` to all forward-pass calls in OLMo2 and OLMo3 integration tests - Update stale expected logit values for OLMo2-1B and OLMo3-Internal (shanearora/2025-sep-a-base-model) to match current model outputs - Fix `Olmo3IntegrationTest::test_real_model_7b_greedy_generation_batched` expected value: batched generation with unequal-length prompts produces an empty response for the shorter (padded) item - Fix `test_generate_beyond_sliding_window` expected: model outputs ASCII apostrophe in "you've", not the curly U+2019 that was hardcoded Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * [OLMo3] Fix batched generation test: use left padding + update expected output The tokenizer defaults to right padding, which causes the shorter padded sequence to generate EOS immediately after "assistant\n", producing an empty response. Setting padding_side="left" (required for decoder-only batched generation) produces proper output for both sequences. Update item[1] expected value accordingly. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Author
Parents
Loading