transformers
78922577 - FA2 can continue generation from cache (#39843)

Commit

170 days ago

FA2 can continue generation from cache (#39843) * add fa2 support to continue generation from cache * update q-len

References

Author

zucchini-nlp

Parents