transformers
HPU support
#36424
Merged
Overview
Commits
41
Changes
View On GitHub

HPU support #36424

ArthurZucker merged 41 commits into main from hpu-support
IlyasMoutawwakil
IlyasMoutawwakil test
17f0bbc3
IlyasMoutawwakil fix
1c4ecc83
HuggingFaceDocBuilderDev
IlyasMoutawwakil fix
ff05ac36
IlyasMoutawwakil Merge branch 'main' into hpu-support
cd9d5f30
IlyasMoutawwakil Merge branch 'main' into hpu-support
272146cc
IlyasMoutawwakil Merge branch 'main' into hpu-support
504ea393
IlyasMoutawwakil skip some and run some first
9c80ba07
IlyasMoutawwakil test fsdp
43fe5f2b
IlyasMoutawwakil fix
4165c5ab
IlyasMoutawwakil IlyasMoutawwakil marked this pull request as draft 1 year ago
IlyasMoutawwakil patches for generate
cd8b5293
IlyasMoutawwakil test distributed
053e9679
IlyasMoutawwakil Merge branch 'main' into hpu-support
8bd3aa6e
IlyasMoutawwakil copy
10daeb6e
IlyasMoutawwakil don't test distributed loss for hpu
9e79eb59
IlyasMoutawwakil require fp16 and run first
2ca56b6d
IlyasMoutawwakil Merge branch 'main' into hpu-support
23fca81a
IlyasMoutawwakil changes from marc's PR fixing zero3
c1f8d83d
IlyasMoutawwakil better alternative
1a369e33
IlyasMoutawwakil Merge branch 'main' into hpu-support
b92d04fa
IlyasMoutawwakil return True when fp16 support on gaudi without creating bridge
43028735
IlyasMoutawwakil fix
f48ca4d4
IlyasMoutawwakil fix tested dtype in deepspeed inference test
25382bd1
IlyasMoutawwakil test
079f26d9
IlyasMoutawwakil fix
ff2937df
IlyasMoutawwakil test
1e3009fd
IlyasMoutawwakil fix
1a06873b
IlyasMoutawwakil skip
0885868c
IlyasMoutawwakil require fp16
f4622f79
IlyasMoutawwakil run first fsdp
7edadf3e
IlyasMoutawwakil Merge branch 'main' into hpu-support
93cdadaa
IlyasMoutawwakil IlyasMoutawwakil marked this pull request as ready for review 1 year ago
IlyasMoutawwakil Merge branch 'main' into hpu-support
bf74370c
IlyasMoutawwakil IlyasMoutawwakil requested a review from muellerzr muellerzr 1 year ago
IlyasMoutawwakil IlyasMoutawwakil requested a review from regisss regisss 1 year ago
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil Apply suggestions from code review
525ff4dc
IlyasMoutawwakil
IlyasMoutawwakil Merge branch 'main' into hpu-support
347ae5eb
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
IlyasMoutawwakil
IlyasMoutawwakil commented on 2025-03-05
ArthurZucker
ArthurZucker approved these changes on 2025-03-05
muellerzr
muellerzr commented on 2025-03-06
muellerzr
muellerzr approved these changes on 2025-03-06
IlyasMoutawwakil address comments
18546f89
IlyasMoutawwakil address comments and refactor test
3dc64901
IlyasMoutawwakil Merge branch 'main' into hpu-support
2ccd1613
IlyasMoutawwakil Merge branch 'main' into hpu-support
1234fb77
IlyasMoutawwakil reduce precison
d05bc57b
IlyasMoutawwakil IlyasMoutawwakil requested a review from ArthurZucker ArthurZucker 1 year ago
IlyasMoutawwakil IlyasMoutawwakil requested a review from muellerzr muellerzr 1 year ago
ArthurZucker
ArthurZucker approved these changes on 2025-03-11
muellerzr
muellerzr approved these changes on 2025-03-11
IlyasMoutawwakil avoid doing gaudi1 specific stuff in the genreation loop
3bba3ccd
IlyasMoutawwakil document test_gradient_accumulation_loss_alignment_with_model_loss te…
f2b1d047
IlyasMoutawwakil Merge branch 'main' into hpu-support
e3f99ef3
IlyasMoutawwakil
ArthurZucker ArthurZucker merged 89f69560 into main 1 year ago
ArthurZucker ArthurZucker deleted the hpu-support branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum