Megatron-DeepSpeed
Add xPos embeddings
#370
Open
Overview
Commits
3
Changes
View On GitHub

Add xPos embeddings #370

janEbert wants to merge 3 commits into bigscience-workshop:main from janEbert:xpos
janEbert
janEbert Add xPos embeddings
366ae3e1
janEbert janEbert force pushed from 8646457d to 366ae3e1 2 years ago
janEbert Fix xPos embedding
875ce8fe
janEbert Fix caching error
2c3e96fc

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum