transformers
feat: err when unsupported attn impl is set w/ `--continuous_batching`
#40618

Merged

feat: err when unsupported attn impl is set w/ `--continuous_batching` #40618

McPatate merged 7 commits into main from feat/error_when_unsupported_attn_impl

McPatate requested a review from

LysandreJik 289 days ago

McPatate force pushed from a1e18b10 to 11c5581a 289 days ago

LysandreJik commented on 2025-09-03

McPatate force pushed from aa8fe331 to f508e29e 288 days ago

McPatate force pushed from f508e29e to 457baa5a 287 days ago

McPatate force pushed from 457baa5a to a8a0fcae 286 days ago

McPatate requested a review from

LysandreJik 286 days ago

feat: err when unsupported attn impl is set w/ `--continuous_batching`

84f892ea

refactor: move defaults and support list to CB code

88bc48a1

feat: add action item in error msg

de490f6c

fix(serve): add default attn implementation

87817c39

feat(serve): add log when `attn_implementation` is `None`

a2b348d4

McPatate force pushed from a8a0fcae to a2b348d4 283 days ago

ArthurZucker commented on 2025-09-08

feat: raise Exception when attn_implementation is not supported by CB

2421a890

McPatate enabled auto-merge (squash) 283 days ago

ArthurZucker approved these changes on 2025-09-08

revert: raise Exception when attn_implementation is not supported

b69e38fc

McPatate merged 2077f175 into main 283 days ago

McPatate deleted the feat/error_when_unsupported_attn_impl branch 283 days ago

Reviewers

ArthurZucker

LysandreJik

Assignees

No one assigned

Labels

None yet

Milestone

No milestone