huggingface/text-generation-inference

Pull Requests Commits

docs: add AWS (EC2/SageMaker) deployment + benchmarking guide (#3352)

KOKOSde committed 59 days ago

Verified b4adbf2f

Update CodeQL workflow for security analysis

paulinebm committed 131 days ago

Verified db931fcf

fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void" (#3346)

oOraph committed 151 days ago

Verified dfb3fbe7

Maintenance mode (#3345)

LysandreJik committed 159 days ago

Verified 34988476

maintenance mode

julien-c committed 159 days ago

Verified 52c6dddf

Maintenance mode (#3344)

LysandreJik committed 159 days ago

Verified 55f7f7cb

feat: support max_image_fetch_size to limit (#3339)

drbh committed 181 days ago

Verified 24ee40d1

misc(gha): expose action cache url and runtime as secrets (#2964)

mfuntowicz committed 183 days ago

Verified 85790a19

Patch version 3.3.6 (#3329)

tengomucho committed 244 days ago

Verified efb94e0d

Revert "feat: bump flake including transformers and huggingface_hub versions" (#3330)

drbh committed 244 days ago

Verified 5e747f4e

Revert "Revert "feat: bump flake including transformers and huggingfa… (#3326)

drbh committed 252 days ago

Verified 1b90c508

Update iframe sources for streaming demo (#3327)

coyotte508 committed 252 days ago

Verified d2ad7c48

Fix mask passed to flashinfer (#3324)

danieldk committed 252 days ago

Verified c6071749

fix: remove azure (#3325)

drbh committed 252 days ago

Verified 4f067c22

Revert "feat: bump flake including transformers and huggingface_hub versions" (#3323)

drbh committed 253 days ago

Verified 9dedeb89

Add missing backslash (#3311)

philsupertramp committed 255 days ago

Verified 5739b5b0

feat: bump flake including transformers and huggingface_hub versions (#3313)

drbh committed 259 days ago

Verified 356de85c

chore: prepare version 3.3.5 (#3314)

tengomucho committed 259 days ago

Verified 0f791622

Disable Cachix pushes (#3312)

danieldk committed 265 days ago

Verified 06d9d88b

Optimum neuron 0.3.0 (#3308)

tengomucho committed 266 days ago

Verified 8801ba12

HuggingFaceM4/Idefics3-8B-Llama3 crash fix (#3267)

sywangyi committed 271 days ago

Verified d618424d

Fix outline import issue (#3282)

sywangyi committed 271 days ago

Verified c5e6f9a1

Some gptq case could not be handled by ipex. but could be handle by triton (#3298)

sywangyi committed 273 days ago

Verified 6624fec1

Multi modality fix (#3283)

sywangyi committed 273 days ago

Verified 5284b5c6

XCCL for XPU (#3252)

sywangyi committed 273 days ago

Verified 6a2fa835

Migrate to V2 Pydantic interface (#3262)

emmanuel-ferdman committed 273 days ago

Verified b4386b8c

Gaudi gptq gidx support (#3297)

sywangyi committed 306 days ago

Verified 24c2bff6

[gaudi] Fix the CI test errors (#3286)

yuanwu2017 committed 316 days ago

Verified fc2405c5

[gaudi] Deepseek v2 mla and add ep to unquantized moe (#3287)

sywangyi committed 316 days ago

Verified ebb26f0c

[gaudi] Remove unnecessary reinitialize to HeterogeneousNextTokenChooser to make sampling output correct (#3284)

sywangyi committed 320 days ago

Verified 778b61c0

Older