vllm
a79cc68b - [V1][Metrics] Initial speculative decoding metrics (#15151)
Commit
View On GitHub
Comment changes are shownComment changes are hidden
Commit
103 days ago
[V1][Metrics] Initial speculative decoding metrics (#15151) Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Author
markmc markmc
Parents
7e3f7a4e
  • tests/v1/core
    • File
      test_scheduler.py
  • vllm/v1
    • core/sched
      • File
        scheduler.py
    • metrics
      • File
        loggers.py
      • File
        stats.py
    • spec_decode
      • File
        metrics.py
FAQ Terms Privacy Refunds Impressum