transformers

b1954fd6 - layernorm_decay_fix (#35927)

layernorm_decay_fix (#35927) * layernorm_decay_fix * W293 fix * ruff format fix * black format * ruff format * erase last layer * add test_get_parameter_names_rmsnorm * rmsnorm fix