text-generation-inference
Move the _update_cos_sin_cache into get_cos_sin
#3254
Merged
Overview
Commits
2
Changes
View On GitHub

Move the _update_cos_sin_cache into get_cos_sin #3254

regisss merged 2 commits into huggingface:main from yuanwu2017:memory
yuanwu2017
yuanwu2017
yuanwu2017 Move the _update_cos_sin_cache into get_cos_sin
8b9a503f
yuanwu2017 Use the max_position_embeddings
d5ba5f54
regisss
regisss approved these changes on 2025-06-12
regisss regisss merged 25fdc5f0 into main 189 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum