huggingface/text-generation-inference

Pull Requests Commits
Add qwen2 multi lora layers support (#3089)
EachSheep committed 1 year ago
Verified bbe218a4
Add request parameters to OTel span for `/v1/chat/completions` endpoint (#3000)
aW3st committed 1 year ago
Verified 58a65f79
Nix: the launcher needs a Python env with Torch for GPU detection (#3085)
danieldk committed 1 year ago
Verified 976eae21
Fix tool call2 (#3076)
Narsil committed 1 year ago
Verified 622908de
Update `--max-batch-total-tokens` description (#3083)
alvarobartt committed 1 year ago
Verified 55a66184
Nix: add `openai` to impure shell for integration tests (#3081)
danieldk committed 1 year ago
Verified 036d802b
Making `tool_calls` a vector. (#3075)
Narsil committed 1 year ago
Verified 8e92942a
Revert "Trying to reduce the logs in the case of errors."
Narsil committed 1 year ago
Verified 3208d1cd
Trying to reduce the logs in the case of errors.
Narsil committed 1 year ago
Verified cdf70d6a
Making sure Olmo (transformers backend) works. (#3074)
Narsil committed 1 year ago
Verified ab9dafc6
Force upgrade transformers version for olmo.
Narsil committed 1 year ago
Verified 31766dad
Only add token when it is defined. (#3073)
Narsil committed 1 year ago
Verified ec35976f
fix(neuron): explicitly install toolchain (#3072)
dacorvo committed 1 year ago
Verified cb42b3ad
Patch rust release. (#3069)
Narsil committed 1 year ago
Verified 491ed9e1
Fix a tiny typo in `monitoring.md` tutorial (#3056)
sadra-barikbin committed 1 year ago
Verified 144d99c1
Preparing for release. (#3060)
Narsil committed 1 year ago
Verified 08bbfa16
feat: add support for HF_HUB_USER_AGENT_ORIGIN to add user-agent Origin field in Hub requests. (#3061)
Hugoch committed 1 year ago
Verified d8ff7f26
Add property-based testing for `RadixAllocator` (#3068)
danieldk committed 1 year ago
Verified e88f6f6e
Fix two edge cases in `RadixTrie::find` (#3067)
danieldk committed 1 year ago
Verified fa4e9511
Revert "Patch rust release."
Narsil committed 1 year ago
Verified a914a218
Patch rust release.
Narsil committed 1 year ago
Verified aad9c2b0
Updating patch rust release.
Narsil committed 1 year ago
Verified 1f35cc7a
Add Gaudi Backend (#3055)
baptistecolle committed 1 year ago
Verified 683ff53f
Avoid running neuron integration tests twice (#3054)
dacorvo committed 1 year ago
Verified 5eec3a8b
fix: run linters and fix formatting (#3057)
drbh committed 1 year ago
Verified b0069e04
some minor fix (#3048)
sywangyi committed 1 year ago
Verified d7a24c03
You need to seek apparently. (#3049)
Narsil committed 1 year ago
Verified cea9dbc9
Add Neuron backend (#3033)
dacorvo committed 1 year ago
Verified c00add9c
Use `rotary` kernel from the Hub (#3041)
danieldk committed 1 year ago
Verified 97c5f7e6
Improve tool call message processing (#3036)
drbh committed 1 year ago
Verified 1cae3197
Terms Of Use Privacy Policy Refund Policy Impressum