huggingface/text-generation-inference

Pull Requests Commits

chore: release 3.2.3

dacorvo committed 182 days ago

1754b79f

doc: fix README (#3271)

dacorvo committed 183 days ago

Verified bd1bdebb

[gaudi] Refine logging for Gaudi warmup (#3222)

regisss committed 183 days ago

Verified f13e28c9

chore: prepare release 3.3.3 (#3269)

dacorvo committed 183 days ago

Verified b4d17f18

[Gaudi] use pad_token_id to pad input id (#3268)

sywangyi committed 184 days ago

Verified 0627983c

[Gaudi] Fix the integration-test issues (#3265)

yuanwu2017 committed 187 days ago

Verified 3752143b

[Gaudi] Enable Qwen3_moe model (#3244)

yuanwu2017 committed 188 days ago

Verified ded4cb52

[gaudi] HuggingFaceM4/idefics2-8b issue fix (#3264)

sywangyi committed 188 days ago

Verified a220e57f

[Gaudi] Remove optimum-habana (#3261)

yuanwu2017 committed 188 days ago

Verified e07056ab

[gaudi] Move the _update_cos_sin_cache into get_cos_sin (#3254)

yuanwu2017 committed 188 days ago

Verified 25fdc5f0

[gaudi] Vlm rebase and issue fix in benchmark test (#3263)

sywangyi committed 188 days ago

Verified 613b8dd6

[gaudi] Perf optimization (#3256)

sywangyi committed 189 days ago

Verified 83947767

Bump neuron SDK version (#3260)

dacorvo committed 190 days ago

Verified 79183d16

Remove useless packages (#3253)

yuanwu2017 committed 197 days ago

Verified 1ff9d185

Prepare for 3.3.2 (#3249)

danieldk committed 201 days ago

Verified 249189d9

[gaudi] Fix the Llama-4-Maverick-17B-128E crash issue (#3246)

yuanwu2017 committed 203 days ago

Verified 6b6e30a6

[Gaudi] Fix the OOM issue of Llama-4-Scout-17B-16E-Instruct (#3245)

yuanwu2017 committed 203 days ago

Verified 70217ac3

fp8 compressed tensors w8a8 support for Gaudi backend (#3242)

sywangyi committed 203 days ago

Verified f1404400

Add Qwen3 for Gaudi backend (#3229)

yuanwu2017 committed 209 days ago

Verified 1883a62a

Nix: switch to hf-nix (#3240)

danieldk committed 209 days ago

Verified f58d7cf5

Upgrade to new vllm extension ops for Gaudi backend (fix issue in exponential bucketing) (#3239)

sywangyi committed 209 days ago

Verified f08b44ad

Prepare for 3.3.1 (#3238)

danieldk committed 210 days ago

Verified 674c514d

Move input_ids to hpu and remove disposal of adapter_meta (#3237)

sywangyi committed 210 days ago

Verified 9e7e5469

Switch to punica-sgmv kernel from the Hub (#3236)

danieldk committed 210 days ago

Verified e3252879

Fix the crash in default ATTENTION path for Gaudi backend (#3235)

sywangyi committed 211 days ago

Verified 43b1b07f

Refine warmup and upgrade to synapse AI 1.21.0 (#3234)

sywangyi committed 212 days ago

Verified 000e313a

Deepseek R1 for Gaudi backend (#3211)

sywangyi committed 212 days ago

Verified d658b5de

fix: count gpu uuids if NVIDIA_VISIBLE_DEVICES env set to all (#3230)

drbh committed 215 days ago

Verified 58934c8b

Enable Llama4 for Gaudi backend (#3223)

yuanwu2017 committed 216 days ago

Verified 18cbecfb

Update to Torch 2.7.0 (#3221)

danieldk committed 217 days ago

Verified 7e531f41

Older