transformers
[OLMo] Fix OOM in logits tests by adding torch.no_grad()
#47986

Merged

[OLMo] Fix OOM in logits tests by adding torch.no_grad() #47986

ydshieh merged 2 commits into main from fix_olmo_logits_oom

[OLMo] Fix OOM in logits tests by adding torch.no_grad()

fcc36fe9

ydshieh force pushed from d9205704 to fcc36fe9 1 day ago

Also fix test_model_1b_logits device mismatch and missing no_grad

8ec474da

ydshieh merged c7ad7287 into main 1 day ago

ydshieh deleted the fix_olmo_logits_oom branch 1 day ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone