llama.cpp
e09a78a2 - tests: fix CI flakes in server cancel and sleep tests (#31330)

Commit
24 days ago
tests: fix CI flakes in server cancel and sleep tests (#31330) test_cancel_request enables context shift so the generation only ends when the request is cancelled, then polls /slots with a deadline. Without context shift the generation fills the context and frees the slot on its own on fast machines, so the test passes even with cancellation disabled. test_server_sleep uses the existing wait_for_sleep helper instead of a fixed sleep.
Parents
Loading