Add workerGroupSpec to rayjob_lightweight_test #5352

Job	Run time
Build Apiserver, CLI Binaries and Docker Images	3m 45s
Build Operator Binaries and Docker Images	5m 39s
Build security proxy Binaries and Docker Images	1m 36s
Lint	8m 49s
Python Client Test	59s
Compatibility Test - 2.7.0	11m 37s
Compatibility Test - 2.8.0	17m 11s
Compatibility Test - 2.9.0	11m 29s
Compatibility Test - Nightly	10m 53s
	1h 11m 58s

Provide feedback