accelerate

b0528392 - Integrate MS-AMP Support for FP8 as a seperate backend (#2232)

Integrate MS-AMP Support for FP8 as a seperate backend (#2232) * Redo with new version * Store * Working version * Seperate for now * Min diff * check if available * Better docstring * Check for multiple models and optimizers * Check for TE and MSAMP args seperately * String clarity * Better docstring and types * Quality * Simplify a bunch for fp8 * Convert literals to type alias * Better err * Docs * toc typo * Apply suggestions from code review Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Maria Khalusova <kafooster@gmail.com> * Address doc nits --------- Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> Co-authored-by: Maria Khalusova <kafooster@gmail.com>