Fix distributed CSV comparison test

[yrasool]

Summary

• Compare distributed test CSV output using comma delimiters.
• Remove noisy directory listings from the test script.
• Show a unified diff when the single-rank and distributed outputs differ.
• Use tolerant cleanup for generated CSV files.

Testing

• bash -n tools/test_distributed.sh
• git diff --check
• Tried configuring the full HARD test build in WSL with cmake -S . -B build -G Ninja -DENABLE_UNIT_TESTS=ON -DENABLE_VERIFICATION=ON. Configure stopped because FleCSI is not installed in my local WSL environment.

[JulienLoiseau]

We have huge changes of the code coming soon with a new Spack and a new structure for the different applications. I will wait for these changes to be pushed before merging this MR. I hope to push before the end of the month. Thank you!

[JulienLoiseau]

Sorry for the delay! The new version of the code is finally out.

[yrasool]

Sorry for the delay! The new version of the code is finally out.

Thankyou for your message . I will review the new code and make changes accordingly.

[yrasool]

Hello, I saw the new code changes. However, distributed regression test in the new codebase was still reading those .csv files as tab-separated text.

[JulienLoiseau]

Thank you for the fix, I tested it on our CI internally and this causes the test to fail (as it should!) I will merge this here and proceed to push a fix to the github asap for the failing test.

[yrasool]

Appreciate it. Will love to learn more and contribute more.