Add CI testcases and benchmark for allreduce

[yanboshao]

Motivation

1. rm mem_ops module
2. add CI testcase of allreduce

Technical Details

Test Plan

Test the performance of allreduce on MI325.

Test Result

Submission Checklist

• Look over the contributing guidelines at https://github.com/ROCm/ROCm/blob/develop/CONTRIBUTING.md#pull-requests.

[coderfeli]

[rank=7] Error: [rank=7] cudagraph max_err=7.845e+00 >= atol=0.15
File "/tmp/flydsl-main/tests/kernels/test_allreduce.py", line 458, in _dist_worker
assert max_err < atol, f"[rank={rank}] cudagraph max_err={max_err:.3e} >= atol={atol}"
^^^^^^^^^^^^^^
File "/tmp/flydsl-main/tests/kernels/test_allreduce.py", line 458, in _dist_worker
assert max_err < atol, f"[rank={rank}] cudagraph max_err={max_err:.3e} >= atol={atol}"
^^^^^^^^^^^^^^

Are these expected?

[coderfeli]

Too many logs in benchmark. Difficult to figure out whether regressions exist.