PR #317 feat(server): support vectorized warpers in flash causal lm

feat(server): support vectorized warpers in flash causal lm #317

OlivierDehaene merged 10 commits into main from feat/vectorized_sampling

jlamypoirier commented on 2023-05-17

jlamypoirier commented on 2023-05-18

OlivierDehaene force pushed from 9659f82d to a021ac85 2 years ago

OlivierDehaene marked this pull request as ready for review 2 years ago

feat(server): support vectorized warpers in flash causal lm

f9e3a3bb

fix imports

e7826855

clean dtype

b9ad3acc

add watermarking

c59fb353

optimize argmax

a62f1487

fix tests

caa96083

OlivierDehaene force pushed from bd814e6a to caa96083 2 years ago

faster cumsum

d3cb0d3b

remove unused vars

b973c101

add shared pool

7e53903c

remove cuda graphs

e8fd0e48

OlivierDehaene merged 62f91f78 into main 2 years ago

OlivierDehaene deleted the feat/vectorized_sampling branch 2 years ago

Reviewers

jlamypoirier

Assignees

No one assigned

Labels

None yet

Milestone

No milestone