transformers
Extended & simplified n-to-1 kernel fusion via KernelConfig
#46339
Merged
Merged
Extended & simplified n-to-1 kernel fusion via KernelConfig #46339
michaelbenayoun
merged
72 commits into
huggingface:main
from
michaelbenayoun:extended_kernel_api_easy
feat: module fusion API for kernels
b3871906
fix: improve __repr__ for fused modules
6bc94021
wip: integration to KernelConfig
62d44545
wip: add temporary example
4082fe15
wip: pattern matching in KernelConfig and actual kernel repo
ac4a6994
refactor: move relevant code to hub_kernels.py
e13111fb
docs: reformat docstring
d9d53f08
refactor: remove comment
e1c7f3f0
Merge branch 'main' into fused_kernels
db0b7f01
Merge branch 'main' into fused_kernels
e21d06e8
refactor: update example script for testing
bd640ae3
wip: remove apply_fusions method
323b0009
wip: add core feature for integration with the current fusing API
fe3002d2
fix: move kernel mapping patching to kernelize
b5414530
wip: update example script
b3d73a7a
wip: add transform_model method for WeightTransform
08452227
wip: conversion_mapping in Kernel
ecfd97de
Merge branch 'main' into extended_kernels_api
973a6165
wip: remove things from __all__
0f0a64b7
wip: remove imports
91177ae0
fix: remove register_fusion_pattern path
2636c06a
Merge branch 'main' into extended_kernels_api
573d9f09
fix: remove unused attribute
f7c15bd6
wip: update experimentation script
f9d42999
refactor: add convert as abstract method
847dbd4c
style: reformat hub_kernels.py
4443c9a8
wip: transform_model API
51c59c96
wip: transform_model API, WeightTransform
4c585030
wip: transform_model API, WeightConverter
a7f983f3
wip: transform_model API, WeightConverter
b8d860f7
wip: make transform_model idempotent
3d5f353f
refactor: infer_kernel_fusion_transforms
c35b5133
style: regexs -> regexes
6e369c0c
refactor: register_kernel_fusions
731d0b72
refactor: post transformation cleanup
4e56ad35
Merge branch 'main' into extended_kernels_api
96ac123e
style: fix comment
105a4034
test: add TestApplyTransformsToMetaModel tests
b1c96453
test: add kernels test
b10b864a
Merge branch 'main' into extended_kernels_api
d1bd06de
test: fix hub_kernels package reload
fb0a748c
style: ruff
ded8b5fc
Merge branch 'main' into extended_kernels_api
6d6411b0
refactor: do not create dynamic classes in test
318553e3
refactor: no dynamic class creation in tests
2a247602
refactor: test
81367813
Merge branch 'main' into extended_kernels_api
aa7743af
fix: TYPE_CHECKING imports were broken
17f4a9e9
Merge branch 'main' into extended_kernels_api
8ec88d1f
wip: get rid of transform_model methods
fabadcad
wip: move tests
e1f3a833
wip: make conversion happen before fused module instantiation
68c36591
refactor
041182fa
wip: move conversion_mapping inside the init
519e673c
wip: without any transform_model
88e0aee8
wip: remove dead code
ad0e24e9
wip: api imrpovement
3924cf35
wip: refactor
c9488342
wip: enable __init__ support in kernels
e0c0366a
wip: fuse + init
da0fdae7
clean: remove "dead" code
06add712
wip: use two classes in kernels
597bb8c3
wip: remove docstring
1489146f
Merge branch 'main' into extended_kernel_api_easy
024fd4ce
test: add relevant tests
b20cb71c
chore: remove experiment file
1fb1787f
cleanup: remove helper function
2e87c9f4
cleanup: remove helper function
11ecc564
refactor: merge the two register kernel functions into one
d98489af
cleanup: use explicit regex patterns to match for monkey patching
89adf48b
test: cleanup and update tests
c841433e
doc: add docstring to make_parent_class_for_kernel_fusion
edf33ab5
Login to write a write a comment.
Login via GitHub