gh-37596: fix performance regression in elliptic-curve point constructor
See [here](https://github.com/sagemath/sage/issues/37593#issuecomment-
1989251306).
URL: https://github.com/sagemath/sage/pull/37596
Reported by: Lorenz Panny
Reviewer(s): Giacomo Pope
