Port ESMC and ESMFold2 to Transformers #46419
Rocketknight1
wants to merge
27 commits into
main
from
port-esmc-esmfold2
Port ESMC + ESMFold2 model code from fork onto v5 main (baseline, una…
4a947b00
Strip vendored Triton kernels + set_kernel_backend selector from esmf…
e78e6ca4
Remove vendored distributed/ (2D context-parallel) stack from esmfold2
0dd2f492
Refactor ESMC attention onto the v5 ALL_ATTENTION_FUNCTIONS interface
5ba14861
Remove transformer_engine dependency from ESMC (pure-PyTorch only)
a863532a
Modernize ESMC rotary to the standard (cos, sin) + apply_rotary_pos_e…
5bbaa6e1
Add modular_esmc.py; generate modeling_esmc.py from it
3ddc7139
Fix ESMC checkpoint loading + bidirectional attention (verified vs fo…
64d9ae59
Fix ESMCTokenizer docstring example + add tokenizer tests
7a40acf7
Drop vestigial vocab_file entry from ESMCTokenizer VOCAB_FILES_NAMES
7d35c168
Add ESMC model tests + make _init_weights cover all modules
d9a1438c
Add ESMC docs + resolve auto_docstring checkpoint for the classificat…
e553eda8
Remove the SAE (esmc_sae) from ESMC — deferred to a follow-up PR
ddd371d1
Normalize ESMC docstrings to satisfy check_docstrings
68fdb7de
Get ESMFold2 importing: add __all__ + load ESMC via the Auto registry
b1ff167c
Drop the experimental ESMFold2 variant + esmfold2_v2 mapping (release…
1db174df
Remove TransformerEngine fp8 path from ESMFold2
6a4af599
Route ESMFold2 plain self-attention through the v5 attention interface
5fe5ac45
Convert ESMFold2Config to the v5 @strict / PreTrainedConfig style
f639c770
Add ESMFold2 tests + sub-config model_types
5e4e96af
Add ESMFold2 model doc page
a5ec40d2
Ruff-format the ESMFold2 fork files (deferred style sweep)
d2bdfe0c
Convert ESMCConfig to the v5 @strict / @auto_docstring style
c3e02c19
Fix ESMFold2 integration test: ubiquitin + correct 0-1 pLDDT/pTM scale
ce2ba0e0
Make ESMFold2 dtype-honest: drop in-model autocast, support from_pret…
7c5b8c89
Apply make fix-repo sweep + bf16 ESMFold2 usage example
302402aa
Keep ESMFold2 sub-configs internal (drop their model_types)
bec43e21
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub