vllm
6cbc4d4b - [Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)

Commit

178 days ago

[Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923) Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

References

#20923 - [Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture

Author

tdoublep

Parents

153c6f1e

vllm 6cbc4d4b - [Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)

vllm
6cbc4d4b - [Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)