PR #6835 Server: fix seed for multiple slots

Server: fix seed for multiple slots #6835

JohannesGaessler merged 4 commits into ggml-org:master from JohannesGaessler:server-seed-fix

Server: add tests for consistent results

b1a18911

JohannesGaessler force pushed 1 year ago

slaren commented on 2024-04-22

sampling: separate rng per sampling context

123eaf05

JohannesGaessler force pushed to 123eaf05 1 year ago

fixup! sampling: separate rng per sampling context

760db9ee

fixup! fixup! sampling: separate rng per sampling context

2b7cff5f

ggerganov approved these changes on 2024-04-23

JohannesGaessler merged 28103f48 into master 1 year ago

Reviewers

ggerganov

slaren

Assignees

No one assigned

Labels

None yet

Milestone

No milestone