icefall
[Not for merge] Contrastive Language-Speech Pre-training (CLSP) Recipe
#2053
Open
Open
[Not for merge] Contrastive Language-Speech Pre-training (CLSP) Recipe #2053
yfyeung
wants to merge
27 commits into
k2-fsa:master
from
yfyeung:clsp
init
7ac6fdd9
try to init clap model
d086f6cf
fix utils.py
3f6d6f79
update
e89f6697
support strict fixed batch size
2d3d7c80
unwrap model for rank0-only evaluation to avoid NCCL hang
e64bb85d
use while-loop for strict batch sync, remove sampler state_dict
5a86b740
use emilia webdataset and split out test_fixedbucketbatchsizeconstraint
1d999df9
add paraspeechcaps manifests and support evaluate retrieval
38156927
use short caption from paraspeechcaps
edb01f34
add normalization for paraspeechcaps
a168cfbe
add attach_caption
cdd26437
support finetune stage 1 and stage 2
0c3cec84
add iemocap manifests
00bcc517
support multi-positive labels
29cf090c
support export retrieval details
7b2f70e2
fix
60da35a4
add finetune stage3
3c578e56
support zero-shot classification
7d76033a
update finetune stage 3
c3218d3f
add ravdess manifest
6ce8fa0c
add cremad manifest
098216f1
yfyeung
changed the title
yfyeung
changed the title
yfyeung
changed the title
yfyeung
changed the title
support zero-shot classification
e935b8af
add glap evaluation recipe
740b7db2
add laion_clap evaluation recipe
8d4b9a34
add paraclap evaluation recipe
a7163fd4
add clsp recipe
ba0b41c0
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub