test_runner: support test order randomization #4181

Job	Run time
Build slim tarball	1m 59s
aarch64-darwin: with shared libraries	22m 36s
x86_64-darwin: with shared libraries	33m 38s
aarch64-linux: with shared libraries	20m 55s
x86_64-linux: with shared libraries	26m 5s
	1h 45m 13s

Provide feedback