Add torch.compile for Mistral #30642
ArthurZucker
merged
31 commits into
huggingface:main
from
zhenglongjiepheonix:longjie/add_torch_compile_for_mistral
gante
commented
on 2024-05-08
first version
dcac131d
fix sliding window
9afc73b9
fix style
3fa9285c
add sliding window cache
5246cedc
fix style
6367154e
address comments
c74b329b
fix test
1cd711c8
fix style
06b64ca8
move sliding window check inside cache init
d46c601c
revert changes on irrelevant files & add comment on SlidingWindowCache
ec8f338c
address comments & fix style
a51b44f9
update causal mask
c1fca1aa
Merge remote-tracking branch 'upstream/main' into longjie/add_torch_c…
ecdcff16
[run-slow] mistral
233cb3bb
Merge remote-tracking branch 'upstream/main' into longjie/add_torch_c…
562a9cfb
[run-slow] mistral
40e05537
ArthurZucker
commented
on 2024-05-15
Merge remote-tracking branch 'upstream/main' into longjie/add_torch_c…
47c48d40
[run-slow] mistral
cdb7a573
[run-slow] mistral
fcbd9ad9
fix conflict
902fdbcf
Merge remote-tracking branch 'upstream/main' into longjie/add_torch_c…
7e1537e1
Merge remote-tracking branch 'upstream/main' into longjie/add_torch_c…
c065bbe0
[run-slow] mistral
691b2014
[run-slow] llama
6a9ec8c1
[run-slow] mistral
02cdb1d0
[run-slow] mistral
97795562
[run-slow] mistral
b78e2a0f
zhenglongjiepheonix
commented
on 2024-05-16
fix conflict
c9de82da
revert CI from a10 to t4
93e14ba7
wrap up
ee8f9fb3
ArthurZucker
commented
on 2024-05-20
fix conflict
82b76af9
Reviewers
Assignees
No one assigned
Labels
run-slow
Milestone
No milestone
Login to write a write a comment.
Login via GitHub