Make manifest cache size configurable #9106

Job	Run time
lint-and-unit-test (3.12)	3m 12s
integration-test-s3	1m 21s
integration-test	10m 45s
lint-and-unit-test (3.14)	2m 42s
lint-and-unit-test (3.11)	3m 1s
integration-test-adls	1m 16s
lint-and-unit-test (3.10)	2m 58s
integration-test-gcs	29m 1s
lint-and-unit-test (3.13)	3m 17s
cibw-dev-env-smoke-test	26s
integration-coverage-report	1s
	58m 0s

Provide feedback