llama.cpp
d008733e - examples : utilize new llama_get_logits_ith()

Commit

2 years ago

examples : utilize new llama_get_logits_ith()

References

#3228 - llama : custom attention mask + parallel decoding + no context swaps

Author

ggerganov

ggerganov

Parents

Loading