transformers.js
11f6a080 - Add support for `min_length` and `min_new_tokens` generation parameters (#308)

Comment changes are shownComment changes are hidden
Commit
1 year ago
Add support for `min_length` and `min_new_tokens` generation parameters (#308) * Add support for `MinNewTokensLengthLogitsProcessor` * Add support for `MinLengthLogitsProcessor` * Fix `generation_config` defaults * Fix `input_ids_seq_length` * Add unit tests for generation * Fix generation parameters test case * Allow specification of multiple `eos_token_ids`
Author
Parents
  • src
    • File
      models.js
    • utils
      • File
        generation.js
  • tests
    • File
      generation.test.js