huggingface/text-generation-inference

Pull Requests Commits
fix: update CI to avoid rate limiting
drbh committed 1 year ago
c753a989
fix: run pre-commit
drbh committed 1 year ago
baf2adfb
Merge commit 'refs/pull/1869/head' of github.com:huggingface/text-generation-inference into main
drbh committed 1 year ago
9b08e4ab
docs: Fix grafana dashboard url (#1925)
edwardzjl committed 1 year ago
Verified 904ff369
ROCm: make CK FA2 default instead of Triton (#1924)
fxmarty committed 1 year ago
Verified 293b8125
Fixing the download strategy for ibm-fms (#1917)
Narsil committed 1 year ago
Verified f871f114
Fix TGI issues with ROCm (#1921)
fxmarty committed 1 year ago
Verified 5dad0c0b
Fix TunableOp bug (#1920)
fxmarty committed 1 year ago
Verified b5f1c9de
Update grafana template (#1918)
fxmarty committed 1 year ago
Verified 422bf1f9
Add TGI monitoring guide through Grafana and Prometheus (#1908)
fxmarty committed 1 year ago
Verified c4cf8b49
MI300 compatibility (#1764)
fxmarty committed 1 year ago
Verified 232e8d52
Removing some unused code. (#1915)
Narsil committed 1 year ago
Verified a60fa840
Fixing signals. (#1910)
Narsil committed 1 year ago
Verified 3b5d93e6
Types. (#1909)
Narsil committed 1 year ago
Verified b3dd3902
Fixing types. (#1906)
Narsil committed 1 year ago
Verified f5d43414
OpenAI function calling compatible support (#1888)
phangiabao98 committed 1 year ago
Verified d8402eaf
Pali gemma modeling (#1895)
drbh committed 1 year ago
Verified 40213c95
[Bug Fix] Update torch import reference in bnb quantization (#1902)
DhruvSrikanth committed 1 year ago
Verified 6c715f81
feat: add deprecation warning to clients (#1855)
drbh committed 1 year ago
Verified a69ef52c
Removing accepted ids in the regular info logs, downgrade to debug. (#1898)
Narsil committed 1 year ago
Verified a70b087e
Add GPT-2 with flash attention (#1889)
Daniël de Kok committed 1 year ago
Verified b5bc6e5c
Correct 'using guidance' link (#1892)
brandon-lockaby committed 1 year ago
Verified 92f1338b
Fixing truncation. (#1890)
Narsil committed 1 year ago
Verified 33bc7212
MLPSpeculator. (#1865)
Narsil committed 1 year ago
Verified e3d76564
Add: Support for the Falcon2 11B architecture (#1886)
Nilabhra committed 1 year ago
Verified 3136f27f
Granite support? (#1882)
Narsil committed 1 year ago
Verified d348d2b2
Refactor layers. (#1866)
Narsil committed 1 year ago
Verified fd89d9df
Readd tool_prompt
Thomas SCHILLACI committed 1 year ago
4607b7e9
Add stop parameter to completions route
Thomas SCHILLACI committed 1 year ago
2f644779
Add completion route to client and stop parameter
Thomas SCHILLACI committed 1 year ago
9fb1cdc8
Terms Of Use Privacy Policy Refund Policy Impressum