transformers.js

df7a3d83 - Fix whisper timestamp extraction for tokenizers with added tokens (#804)

Fix whisper timestamp extraction for tokenizers with added tokens (#804) * support user defined tokens by bounding timestamp token if statement * Update src/tokenizers.js Co-authored-by: Joshua Lochner <admin@xenova.com> * calculate timestamp_end instead of hardcoding * Update tokenizers.js * Merge conflict resolution --------- Co-authored-by: Joshua Lochner <admin@xenova.com>