transformers
[Whisper] Fix whisper tokenizer
#34537
Merged

Commits
  • handle single timestamp ending
    eustlb committed 1 year ago
  • include last timestamp token
    eustlb committed 1 year ago
  • handle single timestamp ending
    eustlb committed 1 year ago
  • Merge branch 'huggingface:main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • avoid floating points arithm limitations
    eustlb committed 1 year ago
  • ensure float64 operations
    eustlb committed 1 year ago
  • new test
    eustlb committed 1 year ago
  • make fixup
    eustlb committed 1 year ago
  • make copies
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • handle edge case double tokens ending with different tokens
    eustlb committed 1 year ago
  • handle single timestamp ending
    eustlb committed 1 year ago
  • make fixup
    eustlb committed 1 year ago
  • handle conditioning on prev segments
    eustlb committed 1 year ago
  • fix
    eustlb committed 1 year ago
  • Update src/transformers/models/whisper/generation_whisper.py
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • [run-slow] whisper
    Eustache Le Bihan committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • don't call item() to avoid unnecessary sync
    eustlb committed 1 year ago
  • Merge branch 'main' into fix-whispertokenizer
    eustlb committed 1 year ago
  • fix
    eustlb committed 1 year ago
Loading