Current State
In scope of this task we should test collecting paths of tests (used for partitioning) in parallel but with a thread cap.
Ref discussion: #4108 (comment)
Objective
Collect test paths in parallel with thread cap
Additional Context
No response