[CI] Unify numpy version for python-3.9 and 3.10 configs (pytorch#139244)

Per dependabot numpy-1.21 is subject of CVE-2021-34141 so perhaps it's ok not to test against it

Pull Request resolved: pytorch#139244
Approved by: https://github.com/huydhn

Author: malfet

.ci/docker/requirements-ci.txt

@@ -128,8 +128,7 @@ numba==0.55.2 ; python_version == "3.10"
 #test_nn.py, test_namedtensor.py, test_linalg.py, test_jit_cuda_fuser.py,
 #test_jit.py, test_indexing.py, test_datapipe.py, test_dataloader.py,
 #test_binary_ufuncs.py
-numpy==1.21.2; python_version == "3.9"
-numpy==1.22.4; python_version == "3.10"
+numpy==1.22.4; python_version == "3.9" or python_version == "3.10"
 numpy==1.26.2; python_version == "3.11" or python_version == "3.12"
 numpy==2.1.2; python_version >= "3.13"