add rotary kernel support to Qwen3 model (#41147)
* add rotary kernel support to Qwen3 model
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* delete unnecessary import
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* adjust code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* adjust code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* put get rotary kernel to hub_kernels.py
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix wrong import
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* refine code and adjust related modular code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix modular mismatch bug
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update code, use lazy load kernels
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix check modular conversion issue
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix CI bug for qwen3-next
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix CI issue
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* delete unused code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* rename to `apply_rotary_transformers`
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* adjust import `lazy_load_kernel` location
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* Update modular-generated modeling files with lazy_load_kernel import location
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix conflicts
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* add more check
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* use decorator to map kernels for functions
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* small fix
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* small adjustment
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix LINT issue
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update code to adapt to new `use_kernel_func_from_hub` API in kernels
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* do not consider check_modular first
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* add compatibility for old version `kernels`
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* add rotary fn kernel to all models
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update modular part
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* Revert "update modular part"
This reverts commit b8b68c7caf466257b88ef910efa18d0812c33597.
* update code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
---------
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
