peft
5efeba18 - ENH: Add default target layers for gemma2 architecture (#2078)

Commit
1 year ago
ENH: Add default target layers for gemma2 architecture (#2078) Google's gemma 2 models have a slightly different architecture than gemma 1 and thus a different model_type attribute. This PR adds default target_layer for gemma 2 that correspond to the default target_layer of gemma 1. LayerNorm tuning adds one more LN layer.
Parents
Loading