text-generation-inference
Outlines guided generation
#1539
Merged
Overview
Commits
34
Changes
View On GitHub
Commits
  • feat: first draft constraining generation via outlines
    drbh committed 2 years ago
  • feat: support simple grammars via outlines
    drbh committed 2 years ago
  • feat: support JSON schemas
    drbh committed 2 years ago
  • fix: update all NextTokenChoosers
    drbh committed 2 years ago
  • feat: support other models and add fsm caching
    drbh committed 2 years ago
  • feat: support grammars in batch
    drbh committed 2 years ago
  • fix: update grammar states after filter
    drbh committed 2 years ago
  • fix: prefer grammar as logit processor
    drbh committed 2 years ago
  • fix: remove small unneeded changes
    drbh committed 2 years ago
  • fix: adjust protos and router
    drbh committed 2 years ago
  • fix: adjust docs
    drbh committed 2 years ago
  • fix: re update docs
    drbh committed 2 years ago
  • fix: resolve typos and docs
    drbh committed 2 years ago
  • feat: add grammar tests and typo tweaks
    drbh committed 2 years ago
  • feat: address syntactically comments
    drbh committed 2 years ago
  • feat: remove states from proto and simplify logit processor
    drbh committed 2 years ago
  • feat: improve grammar init
    drbh committed 2 years ago
  • feat: improve grammar advance logic to avoid blocking GPU
    drbh committed 2 years ago
  • feat: advance grammars in all models
    drbh committed 2 years ago
  • feat: add --grammar-support cli flag and validation error
    drbh committed 2 years ago
  • fix: update docs
    drbh committed 2 years ago
  • fix: add grammar_support to validation tests
    drbh committed 2 years ago
  • feat: add grammar_support to test launcher
    drbh committed 2 years ago
  • fix: adjust client and conftest for grammar
    drbh committed 2 years ago
  • feat: fix advance_grammar sig, add comment and move advance call
    drbh committed 2 years ago
  • feat: improve client typing and update tests
    drbh committed 2 years ago
  • feat: include grammar type in request, avoid alloc and improve proto types
    drbh committed 2 years ago
  • fix: adjust type typo
    drbh committed 2 years ago
  • fix: adjust next type typo
    drbh committed 2 years ago
  • fix: add missing grammar type typo
    drbh committed 2 years ago
  • fix: remove unnecessary code, avoid copies and make deser safer
    drbh committed 2 years ago
  • feat: prefer disable grammar
    drbh committed 2 years ago
  • feat: support spectulative decoding grammar advances
    drbh committed 2 years ago
  • fix: add disable_grammar_support to docker_launcher args
    drbh committed 2 years ago
FAQ Terms Privacy Refunds Impressum
Loading