transformers
3e70a207 - Static Cache: load models with MQA or GQA (#28975)

Commit

2 years ago

Static Cache: load models with MQA or GQA (#28975)

References

#28975 - Static Cache: load models with MQA or GQA

Author

gante

gante

Parents

Loading