barebones orpo
e6b734e8
remove reference model.
2c041bd0
full implementation
58f441cd
change default of beta_orpo
cc0cff21
add a training command.
6aa8fc8e
fix: dataloading issues.
83af3add
interpreting the formulation.
fe7c9236
revert styling
2f801b96
add: wds full blown version
07872301
Merge branch 'main' into orpo-lora
67767858
fix: per_gpu_batch_siz
98fe76c7
start debuggin
a7ed27c1
debugging
675f7bb4
remove print
4ca3ec69
fix
34681cb9
remove filter keys.
2d4d84f2
turn on non-blocking calls.
4b43d793
device_placement
e695c3dd
let's see.
48a75f24
add bigger training run command
6b43a5d8
Merge branch 'main' into orpo-lora
1fa16c15
reinitialize generator for fair repro
7b05bf82
Merge branch 'main' into orpo-lora
698903a3
add: detailed readme and requirements
4240024c
feffy380
commented
on 2024-05-15
Login to write a write a comment.
Login via GitHub