mosaicml/llm-foundry

Pull Requests Commits

raise a foundry err

jjanezhang committed 1 year ago

2f45f8e1

fix dash issue (#919)

milocress committed 1 year ago

Verified ff8c32be

Tiktoken chat format fix (#893)

rajammanabrolu committed 1 year ago

Verified 8c5182c4

Create HF checkpointer model on meta device (#916)

dakinggg committed 1 year ago

Verified 5ccceffa

Make yamllint consistent with Composer (#918)

b-chu committed 1 year ago

Verified 34a1dad9

Fix fmapi_chat for instruct models and custom tokenizers (#914)

aspfohl committed 1 year ago

Verified f132f055

Warn instead of error on tokenizer-only with http (#904)

jerrychen109 committed 1 year ago

Verified b48fa58f

Add the model license file for mlflow (#915)

dakinggg committed 1 year ago

Verified 34cdaf68

Add support for eval_loader & eval_subset_num_batches in async callback (#834)

aspfohl committed 1 year ago

Verified bdcce637

Add flag to enable/disable param upload (#912)

ngcgarcia committed 1 year ago

Verified 534f5b4d

Adds support for chat formatted finetuning input data. (#884)

milocress committed 1 year ago

Verified ac783541

No symlinks at all for HF download (#908)

jerrychen109 committed 1 year ago

Verified 26349879

Add new GC option (#907)

dakinggg committed 1 year ago

Verified 69bf90ed

mvpatel2000 committed 1 year ago

Verified 1469dcb6

Enable QK Group Norm (#869)

vchiley committed 1 year ago

Verified ea0521ca

Allow bool input for loggers (#897)

ngcgarcia committed 1 year ago

Verified 4961436f

Add better error for non-empty local output folder in convert_text_to_mds.py (#891)

irenedea committed 1 year ago

Verified 36fcb5e5

Foundational Model API eval wrapper (#849)

aspfohl committed 1 year ago

Verified f2614a4a

Add `tokenizer-only` flag to only download tokenizers from HF or oras (#895)

irenedea committed 1 year ago

Verified 07d6db36

Bump transformers version to support Mixtral (#894)

dakinggg committed 1 year ago

Verified 02c44ad6

Upgrade Datasets version (#892)

dakinggg committed 1 year ago

Verified b2a0c03b

Fix tiktoken add generation prompt (#890)

irenedea committed 1 year ago

Verified c9a49d0b

Update license (#887)

b-chu committed 1 year ago

Verified 19368c66

Update model download utils to support ORAS (#881)

jerrychen109 committed 1 year ago

Verified 35bb3390

fsdp wrap refac (#883)

vchiley committed 1 year ago

Verified 19ee0869

add missing import (#882)

mvpatel2000 committed 1 year ago

Verified 2e4f4b2f

Precompute flash attention padding info (#880)

ShashankMosaicML committed 1 year ago

Verified 6dcc0d84

fix regex (#877)

Nancy Hung committed 1 year ago

Verified f43d1cfb

fix mock (#872)

jerrychen109 committed 1 year ago

Verified b40b8051

Delta to JSONL conversion script cleanup and bug fix (#868)

Nancy Hung committed 1 year ago

Verified b69318e8

Older