[CMake] Re-land #102671 after the flaky test is disabled
Reland #102671 after the other attempted fixes are all flawed in some
build configurations. The previous try for the same commit was breaking
a flaky tests under ASAN which is not marked as unsupported. This fix
should be good to go now.
Fixes AIX bot for DynamicLibraryTests failure.
