ulysses enabling in native attention path (#12563)
* ulysses enabling in native attention path
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
* address review comment
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
* add supports_context_parallel for native attention
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
* update templated attention
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
---------
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
