test_runner: support test order randomization #3191

Job	Run time
Build slim tarball	1m 40s
x86_64-darwin: with shared libraries	3m 48s
aarch64-darwin: with shared libraries	3m 48s
x86_64-linux: with shared libraries	3m 43s
aarch64-linux: with shared libraries	3m 37s
	16m 36s

Provide feedback