ci: Unit test partitioning (#11107)
### Description
With #11084 and #11089 now landed, our unit tests can be our CI
bottleneck sometimes.
They can take more than 10 minutes. In this PR, we give them some light
partitioning to get them completed quicker.
### Testing Instructions
CI
