Skip to content

Optional threaded uploads #1250

@sigmavirus24

Description

@sigmavirus24

Some projects have a large number of artifacts they need to upload for a release. This could be faster by leveraging requests-toolbelt's ability to parallelize requests across a thread pool of sessions. Alternatively, given our new authentication class for Trusted Publishing, we could do our own threaded implementation.

Todo:

  • make sure this is off by default initially and behind a flag
  • verify progress bar behavior
  • find a project willing to experiment with this and report bugs

See also #1246 for motivation and discussion

In the past I have avoided the complexity of relying on something like threading to parallelize uploads. Would it potentially be a helpful mitigation here too? It will certainly mess up our progress bars but I can imagine that combined with the token refresh logic would help these users regardless

Originally posted by @sigmavirus24 in #1246 (comment)

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions