huggingface/text-generation-inference

Pull Requests Commits

Bump transformers in non-Nix as well to run CI

danieldk committed 1 year ago

49b414b5

feat: bump flake including transformers and huggingface_hub versions (#3313)

drbh committed 1 year ago

Verified 356de85c

chore: prepare version 3.3.5 (#3314)

tengomucho committed 1 year ago

Verified 0f791622

Disable Cachix pushes (#3312)

danieldk committed 1 year ago

Verified 06d9d88b

Optimum neuron 0.3.0 (#3308)

tengomucho committed 1 year ago

Verified 8801ba12

HuggingFaceM4/Idefics3-8B-Llama3 crash fix (#3267)

sywangyi committed 1 year ago

Verified d618424d

Fix outline import issue (#3282)

sywangyi committed 1 year ago

Verified c5e6f9a1

Some gptq case could not be handled by ipex. but could be handle by triton (#3298)

sywangyi committed 1 year ago

Verified 6624fec1

Multi modality fix (#3283)

sywangyi committed 1 year ago

Verified 5284b5c6

XCCL for XPU (#3252)

sywangyi committed 1 year ago

Verified 6a2fa835

Migrate to V2 Pydantic interface (#3262)

emmanuel-ferdman committed 1 year ago

Verified b4386b8c

Gaudi gptq gidx support (#3297)

sywangyi committed 1 year ago

Verified 24c2bff6

[gaudi] Fix the CI test errors (#3286)

yuanwu2017 committed 1 year ago

Verified fc2405c5

[gaudi] Deepseek v2 mla and add ep to unquantized moe (#3287)

sywangyi committed 1 year ago

Verified ebb26f0c

[gaudi] Remove unnecessary reinitialize to HeterogeneousNextTokenChooser to make sampling output correct (#3284)

sywangyi committed 1 year ago

Verified 778b61c0

Optimum neuron 0.2.2 (#3281)

dacorvo committed 1 year ago

Verified 3d2e7c8f

xpu lora support (#3232)

sywangyi committed 1 year ago

Verified f6005d68

[gaudi] Gemma3 sliding window support (#3280)

sywangyi committed 1 year ago

Verified 429dcd9c

Gaudi: add CI (#3160)

baptistecolle committed 1 year ago

Verified 9f38d930

[gaudi] Refine rope memory, do not need to keep sin/cos cache per layer (#3274)

sywangyi committed 1 year ago

Verified 71990741

Neuron backend fix and patch version 3.3.4 (#3273)

dacorvo committed 1 year ago

Verified 238fbd4d

[gaudi] gemma3 text and vlm model intial support. need to add sliding window support later (#3270)

sywangyi committed 1 year ago

Verified 14ee6e78

doc: fix README (#3271)

dacorvo committed 1 year ago

Verified bd1bdebb

[gaudi] Refine logging for Gaudi warmup (#3222)

regisss committed 1 year ago

Verified f13e28c9

chore: prepare release 3.3.3 (#3269)

dacorvo committed 1 year ago

Verified b4d17f18

[Gaudi] use pad_token_id to pad input id (#3268)

sywangyi committed 1 year ago

Verified 0627983c

[Gaudi] Fix the integration-test issues (#3265)

yuanwu2017 committed 1 year ago

Verified 3752143b

[Gaudi] Enable Qwen3_moe model (#3244)

yuanwu2017 committed 1 year ago

Verified ded4cb52

[gaudi] HuggingFaceM4/idefics2-8b issue fix (#3264)

sywangyi committed 1 year ago

Verified a220e57f

[Gaudi] Remove optimum-habana (#3261)

yuanwu2017 committed 1 year ago

Verified e07056ab

Older