Skip to content

Commit f1ccbbe

Browse files
maxrjonesdcherian
andauthored
Fix cut-off sentence in GPU blog post (#808)
Co-authored-by: Deepak Cherian <dcherian@users.noreply.github.com>
1 parent f7f7d92 commit f1ccbbe

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

src/posts/gpu-pipeline/index.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -101,7 +101,7 @@ PyTorch’s `DataLoader` includes options like `num_workers`, `pin_memory`, and
101101

102102
## Hackathon: Strategies Explored!
103103

104-
During the hackathon, we tested the following strategies to improve the data loading performance. In the end, we were able to achieve
104+
During the hackathon, we tested the following strategies to improve the data loading performance. In the end, we were able to achieve at least ~17x improvement on 1 GPU in training throughput by optimizing data loading and preprocessing steps.
105105

106106
### Step 1: Optimized Chunking & Compression
107107

@@ -198,7 +198,7 @@ With nvCOMP, all steps of data loading including reading from disk, decompressio
198198

199199
To unlock this, we would need zarr-python to support GPU-based decompression codecs, with one for Zstandard (Zstd) currently being implemented in [this PR](https://github.com/zarr-developers/zarr-python/pull/2863).
200200

201-
We tested the performance of GPU-based decompression using nvCOMP with Zarr-Python 3 and KvikIO, and compared it to CPU-based decompression using [this data reading benchmark here](https://github.com/pangeo-data/ncar-hackathon-xarray-on-gpus/tree/v1.0/benchmarks/era5_zarr_benchmark.py).
201+
We tested the performance of GPU-based decompression using nvCOMP with Zarr-Python 3 and KvikIO, and compared it to CPU-based decompression using [this data reading benchmark here](https://github.com/pangeo-data/ncar-hackathon-xarray-on-gpus/blob/v1.0/benchmarks/era5_zarr_benchmark.py).
202202

203203
Here are the results:
204204

0 commit comments

Comments
 (0)