text-generation-inference
Refactor dead code - Removing all `flash_xxx.py` files.
#2166
Merged

Refactor dead code - Removing all `flash_xxx.py` files. #2166

Narsil merged 22 commits into main from refactor_dead_code
Narsil
OlivierDehaene
OlivierDehaene dismissed these changes on 2024-07-03
OlivierDehaene OlivierDehaene requested a review from OlivierDehaene OlivierDehaene 1 year ago
OlivierDehaene
OlivierDehaene commented on 2024-07-03
Narsil Narsil dismissed their stale review via d2900abb 1 year ago
danieldk
danieldk commented on 2024-07-04
danieldk
danieldk commented on 2024-07-04
Narsil Refactor dead code.
b28946d6
Narsil First working step.
69cb084b
Narsil Remove a lot of duplicated code.
ed34cf02
Narsil More dead code.
7d96b1a1
Narsil More cleanup.
ce913b87
Narsil Fix Santacoder test.
db9acc44
Narsil Fixing the simple tests.
298500a0
Narsil Fixing sharding.
b2fb8459
Narsil Fixes for VLM.
43ef5268
Narsil Fixing santacoder (num_kv_heads hardcoded).
dbf9292a
Narsil Removing more dead code.
24bbd7b8
Narsil Fixing `config.n_head`.
e8ff76fd
Narsil Stopping earlier because of `<end_of_utterance>` in idefics2.
2259d2f7
Narsil Addresses comments.
9cc58d1c
Narsil Removing the dead code.
fbf38c99
Narsil Fuse back mistral into FlashCausalLM.
f5ff9b57
Narsil Finish removal.
e2edf2be
Narsil Fixing docs + causal_lm `batch_class`.
8ecee728
Narsil Fixing docs + causal.lm.
fc5bfa07
Narsil Add default to Gemma Causality.
425f348e
Narsil Narsil force pushed from f89c2b4f to 425f348e 1 year ago
Narsil Default value for gemma/gemma2.
4aa0642f
Narsil Wrong default.
25c9611c
Narsil Narsil merged fb2f74e2 into main 1 year ago
Narsil Narsil deleted the refactor_dead_code branch 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone