huggingface/transformers

Pull Requests Commits

SunMarc committed 2 days ago

dc97cbf9

SunMarc committed 2 days ago

ee929dde

SunMarc committed 2 days ago

742dfd01

Serve decision-head checkpoints like pipeline("decision")

SunMarc committed 2 days ago

7bfd98ba

Ponytail: jev docs on the decide API, one tiny_qwen2 test helper, drop repeated tests

ArthurZucker committed 6 days ago

f4a96a95

One sanitize check, in _mark_chat_inputs

ArthurZucker committed 6 days ago

0a08f615

Ponytail: drop dead auto_docstring entries and imports, one process_scores, DecisionConfig defaults when absent, revert unrelated auto_factory

ArthurZucker committed 6 days ago

d2b6d43a

extra_files: from the config class only, safetensors file names in the repo

ArthurZucker committed 7 days ago

bfa93e2c

DecisionConfig.logits_processors: built once per question type

ArthurZucker committed 7 days ago

23104d0f

decision_config from the head configs already read by checkpoint_config: no second download

ArthurZucker committed 7 days ago

a164abac

Docstring: decide keeps the token ids and marks

ArthurZucker committed 7 days ago

f331cd85

DecisionMixin.from_pretrained reads the checkpoint's head configs; configuration_utils back to main

ArthurZucker committed 7 days ago

1549208c

Decision models like generate: chat_template_kwargs + apply_chat_template, model.decide, decode_decision; no DecisionTemplate / DecisionPrompt

ArthurZucker committed 7 days ago

e7fd386a

Repo -> JevConfig in __post_init__: extra_config_files read next to the checkpoint's config; no from_checkpoint, no decision_head.json / config_file_name

ArthurZucker committed 7 days ago

e2f8fac7

Decision tests read hf-internal-testing

ArthurZucker committed 7 days ago

b182f723

Stateless decision template and pipeline: each request carries its questions

ArthurZucker committed 7 days ago

19dbefd7

head_files → extra_files

ArthurZucker committed 7 days ago

28c4aaa1

Decision models read the files of the checkpoint they ship next to: JevConfig.head_files + from_checkpoint, at load time

ArthurZucker committed 7 days ago

c76f595a

Merge branch 'jev-1-core-fix-auto' into jev-1-core

ArthurZucker committed 7 days ago

068cb6c9

AutoModelForDecision

ArthurZucker committed 7 days ago

50b883ce

Merge branch 'jev-1-core-fix-serve' into jev-1-core

ArthurZucker committed 7 days ago

b2a06557

Jev docs: the model with its files next to the checkpoint, and its use without the pipeline

ArthurZucker committed 7 days ago

e7d4597e

serve reads the decision config of the repo it loads

ArthurZucker committed 7 days ago

70cde08b

One model_inputs per prompt, batched: ids, marks, questions and the inputs of the model it reads

ArthurZucker committed 7 days ago

7121b57f

Merge remote-tracking branch 'origin/main' into jev-1-core

ArthurZucker committed 7 days ago

d18d7185

No DecisionPreTrainedModel: config_file_name loads decision_head.json, the pipeline loads the LoRA subfolder

ArthurZucker committed 7 days ago

8a728eab

Update dev version (#50068)

albertvillanova committed 7 days ago

Verified 8090b6aa

Decision test mixin: backbone keys under the names of the backbone class

ArthurZucker committed 7 days ago

27d48668

Decision test mixin: the backbone file has every key of the backbone, float32

ArthurZucker committed 7 days ago

fb82f63d

Byte-level tokenizer.json + Hub tokenizer_class LlamaTokenizer/Fast (#48317)

itazap committed 7 days ago

Verified 70b9938d

Older