also add LLAMA_ARG_CONT_BATCHING - SemanticDiff

Commit

1 year ago

also add LLAMA_ARG_CONT_BATCHING

References

xsn/server_params_2

#9116 - server : add some missing env variables

Author

ngxson

ngxson

Parents

Loading