vllm
c42ff4f4 - [BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513)

Commit

93 days ago

[BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513) Signed-off-by: adabeyta <aabeyta@redhat.com>

References

Author

adabeyta

Parents