Dowload performance is slow when downloading 10 K packages #118
Description
I have used blob_client and blob_wrap api for Downloading 10000+ Packages and found some issues.
BlobClient download_blob_to_stream
BlobWrap download_blob_to_file
I set the concurrencylimit as 16, But I noticed that at one point if we used download_blob_to_stream, the Download becomes very slow, and if we go with the download_blob_to_file where CPU usages increased and make the Gateway slow. And the slowness I observed after downloading the 1000 packages after that it becomes slow.
Can you please suggest the way to use this effetively and also suggest How we can improve the performance .