Megatron-DeepSpeed
e742a3fe - I think OPT doesn't have shared vocabulary embedding

Commit

3 years ago

I think OPT doesn't have shared vocabulary embedding

References

#301 - [WIP] Hack my way to get OPT running

Author

thomasw21

thomasw21

Parents

Loading