DeepSpeed
(1/2) Implementing Compiler Pass for AutoTP
#8204
Merged
Overview
Commits
17
Changes
View On GitHub

(1/2) Implementing Compiler Pass for AutoTP #8204

tohtana merged 17 commits into deepspeedai:master from therealnaveenkamal:feature/autotp
therealnaveenkamal
therealnaveenkamal therealnaveenkamal requested a review from tjruwase tjruwase 20 days ago
therealnaveenkamal therealnaveenkamal requested a review from tohtana tohtana 20 days ago
therealnaveenkamal therealnaveenkamal requested a review from hwchen2017 hwchen2017 20 days ago
therealnaveenkamal therealnaveenkamal requested a review from loadams loadams 20 days ago
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-08-02
tohtana
tohtana requested changes on 2026-08-03
tohtana
therealnaveenkamal added support for autotp
8abe7ed4
therealnaveenkamal fix for 2x residuals
d4420016
therealnaveenkamal restore AutoTP torch version check
478c1e9d
therealnaveenkamal therealnaveenkamal force pushed from a3a2bb41 to 478c1e9d 17 days ago
therealnaveenkamal autotp works now
e7762c3b
therealnaveenkamal cleaning up
4738778e
therealnaveenkamal Merge pull request #1 from therealnaveenkamal/feature/autotp-dev
3f6e1791
tohtana
tohtana requested changes on 2026-08-10
therealnaveenkamal fixed for partial compiler flags, now raises error
40d92d6c
therealnaveenkamal skip pytest if transformers not 5.x
a816df04
therealnaveenkamal precommit
84ec6caa
therealnaveenkamal fixed for partial compiler flags, now raises error and skip pytest if…
445632e3
therealnaveenkamal
tohtana
therealnaveenkamal added guards for test_tp_compile
218cf7b1
therealnaveenkamal added guards for test_tp_compile
196e62bf
tohtana
therealnaveenkamal added warning for transformers bug
0f71bad6
therealnaveenkamal added warning for transformers bug
66a5b2b2
therealnaveenkamal
tohtana Fix AutoTP MoE compatibility guard
6cb92ef7
tohtana
therealnaveenkamal Narrow AutoTP Transformers MoE guard to batched_mm
611ed988
therealnaveenkamal
tohtana
tohtana approved these changes on 2026-08-12
tohtana tohtana enabled auto-merge 10 days ago
tohtana Merge branch 'master' into feature/autotp
8377ddad
tohtana tohtana merged 79046032 into master 9 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum