transformers
Universal Speculative Decoding `CandidateGenerator`
#35029
Merged
Overview
Commits
112
Changes
View On GitHub
Commits
  • move `TestAssistedCandidateGeneratorDifferentTokenizers` into a new testing file
    Nadav Timor committed 1 year ago
  • refactor
    Nadav Timor committed 1 year ago
  • NOTHING. add space to rerun github actions tests
    Nadav Timor committed 1 year ago
  • remove it...
    Nadav Timor committed 1 year ago
  • `UniversalSpeculativeDecodingGenerator`
    Nadav Timor committed 1 year ago
  • Use `UniversalSpeculativeDecodingGenerator` when `generation_config.do_sample=True`
    Nadav Timor committed 1 year ago
  • assistant tokenizes only the target's new suffix
    Nadav Timor committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • fix code
    jmamou committed 1 year ago
  • fix code
    jmamou committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • add `TestGenerateWithDifferentModels`
    Nadav Timor committed 1 year ago
  • `TestGenerateWithDifferentModels` parameterize on `do_sample`
    Nadav Timor committed 1 year ago
  • `AssistantVocabMapping` & `AssistantVocabMappingCache`
    Nadav Timor committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • `AssistantToTargetTranslator`: `get_target_input_ids` & `get_target_logits`
    Nadav Timor committed 1 year ago
  • improve `_get_assistant_to_target_input_ids` & formatting
    Nadav Timor committed 1 year ago
  • renaming
    Nadav Timor committed 1 year ago
  • WIP: debugging `min_new_tokens`
    Nadav Timor committed 1 year ago
  • fix get_target_ids
    jmamou committed 1 year ago
  • `UniversalSpeculativeDecodingGenerator`
    Nadav Timor committed 1 year ago
  • assistant tokenizes only the target's new suffix
    Nadav Timor committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • fix code
    jmamou committed 1 year ago
  • fix code
    jmamou committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • `TestGenerateWithDifferentModels` parameterize on `do_sample`
    Nadav Timor committed 1 year ago
  • `AssistantVocabMapping` & `AssistantVocabMappingCache`
    Nadav Timor committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • `AssistantToTargetTranslator`: `get_target_input_ids` & `get_target_logits`
    Nadav Timor committed 1 year ago
  • improve `_get_assistant_to_target_input_ids` & formatting
    Nadav Timor committed 1 year ago
  • renaming
    Nadav Timor committed 1 year ago
  • WIP: debugging `min_new_tokens`
    Nadav Timor committed 1 year ago
  • fix get_target_ids
    jmamou committed 1 year ago
  • fix device issue
    jmamou committed 1 year ago
  • fix get_assistant_input_ids
    jmamou committed 1 year ago
  • add `TestAssistedCandidateGeneratorDifferentTokenizers`
    Nadav Timor committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • `AssistantVocabTranslatorCache` refactor & tests
    Nadav Timor committed 1 year ago
  • revert changes in `src/transformers/generation/logits_process.py`
    Nadav Timor committed 1 year ago
  • refactor `AssistedCandidateGenerator`
    Nadav Timor committed 1 year ago
  • refactor `AssistedCandidateGeneratorDifferentTokenizers`
    Nadav Timor committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • refactor `UniversalSpeculativeDecodingGenerator`
    Nadav Timor committed 1 year ago
  • fix negative value for max_new_tokens
    jmamou committed 1 year ago
  • fix generation length target + attention_mask vs. assistant + attent
    jmamou committed 1 year ago
  • fix device
    jmamou committed 1 year ago
  • fix negative max_new_tokens bug
    jmamou committed 1 year ago
  • fix UAG
    jmamou committed 1 year ago
  • minor
    jmamou committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • `AssistedCandidateGeneratorDifferentTokenizers` `lookbehind`s init
    Nadav Timor committed 1 year ago
  • resolve conflict & formatting
    Nadav Timor committed 1 year ago
  • rerun CI tests
    Nadav Timor committed 1 year ago
  • remove space...
    Nadav Timor committed 1 year ago
  • remove old code
    Nadav Timor committed 1 year ago
  • fix candidate_input_ids device
    jmamou committed 1 year ago
  • minor
    jmamou committed 1 year ago
  • Merge pull request #4 from keyboardAnt/fix_device
    keyboardAnt committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • Fix prepare + apply (#7)
    jmamou committed 1 year ago
  • Add unittests for Universal Assisted generation
    gauravjain14 committed 1 year ago
  • Merge branch 'main' into usd
    jmamou committed 1 year ago
  • fix style
    jmamou committed 1 year ago
  • update tests
    jmamou committed 1 year ago
  • Remove unused import and fix `test_speculation_depth` test
    gauravjain14 committed 1 year ago
  • exclude special and reserved tokens from tokenizer for UAG
    gauravjain14 committed 1 year ago
  • mv `test_universal_assisted_generation.py` to `generation/test_candidate_generator.py`
    gauravjain14 committed 1 year ago
  • Merge pull request #8 from keyboardAnt/unit_tests_usd
    gauravjain14 committed 1 year ago
  • Remove unused imports and fix style using `make style` (#9)
    gauravjain14 committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • Swap gated `meta-llama/llama-3.2` with `allenai/llama` (#10)
    gauravjain14 committed 1 year ago
  • Merge branch 'main' into usd
    Nadav Timor committed 1 year ago
  • Fix space sign disagreement (#12)
    jmamou committed 1 year ago
  • Default values for some fields of assistant to target translator (#11)
    jmamou committed 1 year ago
  • Update candidate_generator.py (#15)
    jmamou committed 1 year ago
  • BUG fix in _prepare_assistant_input_ids (#14)
    jmamou committed 1 year ago
  • typo (`target_to_assistant_input_ids`)
    Nadav Timor committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • merge upstream/main
    Nadav Timor committed 1 year ago
  • Merge branch 'main' into usd
    Nadav Timor committed 1 year ago
  • Fix minor review comments (#16)
    gauravjain14 committed 1 year ago
  • Fix: `token_ids.to(torch.int64)` (#18)
    keyboardAnt committed 1 year ago
  • fix dtype
    Nadav Timor committed 1 year ago
  • `assistant_input_ids.to(dtype=torch.long)`
    Nadav Timor committed 1 year ago
  • Remove unused import from test_candidate_generator.py
    gauravjain14 committed 1 year ago
  • Merge branch 'main' of https://github.com/keyboardAnt/transformers into usd
    Nadav Timor committed 1 year ago
  • resolve pr comments (#19)
    keyboardAnt committed 1 year ago
  • formatting
    Nadav Timor committed 1 year ago
  • Merge branch 'main' into usd
    keyboardAnt committed 1 year ago
  • Merge branch 'main' into usd
    jmamou committed 1 year ago
  • Merge branch 'main' into usd
    jmamou committed 1 year ago
  • Fix Joao's comments (#21)
    jmamou committed 1 year ago
  • Merge branch 'main' into usd
    jmamou committed 1 year ago
  • Merge branch 'main' into usd
    jmamou committed 1 year ago
  • fix style (#23)
    jmamou committed 1 year ago
  • Merge branch 'main' into usd
    jmamou committed 1 year ago
  • Move atm (#24)
    jmamou committed 1 year ago
  • fix logit_processor
    jmamou committed 1 year ago
  • add atm_translator test
    jmamou committed 1 year ago
  • + more commits ...
FAQ Terms Privacy Refunds Impressum
Loading