lighteval
Small fixes to InferenceEndpointModel
#112
Merged

Commits
  • Added implementation for missing properties in InferenceEndpointModel
    shaltielshmid committed 2 years ago
  • Added tokenized context in greedy generate + handled stop_sequence of tuple/list/str
    shaltielshmid committed 2 years ago
  • Santized endpoint model name
    shaltielshmid committed 2 years ago
  • Redid disable_tqdm & fixed call to batch generate with logits
    shaltielshmid committed 2 years ago
  • Removed debug flag
    shaltielshmid committed 2 years ago
  • Swapped debug to true
    shaltielshmid committed 2 years ago
  • Fixed format changes
    shaltielshmid committed 2 years ago
  • Added get original order for InferenceEndpoint calls
    shaltielshmid committed 2 years ago
  • Added option to specify model info in args
    shaltielshmid committed 2 years ago
  • Merge remote-tracking branch 'huggingface/main' into fix-greedy-generate-bugs
    shaltielshmid committed 2 years ago
  • Removed model info
    shaltielshmid committed 2 years ago
  • Added model dtype to inference endpoint model config
    shaltielshmid committed 2 years ago
  • Fixed format
    shaltielshmid committed 2 years ago
  • Revert "Fixed format"
    shaltielshmid committed 2 years ago
  • Revert "Added model dtype to inference endpoint model config"
    shaltielshmid committed 2 years ago
  • Removed cleanup when reusing
    shaltielshmid committed 2 years ago
Loading