perf(turbopack): Do not allocate vectors if we are not going to use it (#80504)
### What?
Avoid allocations when we are not going to use it
### Why?
I think static tools can technically analyze all of these kinds of needless allocations, but I'm not sure, so I'll try to find them by hand.