test_runner: support test order randomization #4393

Job	Run time
Build slim tarball	2m 1s
aarch64-darwin: with shared libraries	23m 46s
x86_64-linux: with shared libraries	26m 47s
x86_64-darwin: with shared libraries	32m 41s
aarch64-linux: with shared libraries	21m 2s
	1h 46m 17s

Provide feedback