Skip to content

Conversation

@txus
Copy link
Collaborator

@txus txus commented Dec 4, 2012

A naive semiparallel processor.

It chunks consecutive GET requests and executes each chunk in a map of threads.

To use it, simply pass sequential: false in the request parameters.

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have an explicit option -- params["strategy"] or whatever: "sequential", "semiparallel", "parallel", etc.

@arsduo
Copy link
Owner

arsduo commented Jan 14, 2013

After writing a spec for the Batch API, I'm thinking this should be the default. There's really no need for fully sequential. I'll poke around with this later this week.

@lukelex
Copy link

lukelex commented Oct 4, 2014

Any progress on this?

@dvgica
Copy link

dvgica commented Nov 11, 2014

I would love to see some movement on this as well.

@arsduo
Copy link
Owner

arsduo commented Apr 4, 2015

@lukelex @DWvanGeest I haven't worked on this project in a while, but hope to catch it up this weekend. Did you ever test @txus' pull request? Does it work for you? If so, I'll merge it in.

@arsduo
Copy link
Owner

arsduo commented Apr 4, 2015

Actually, there's a later pull request that does full parallel processing with Celluloid: #33 -- if you're still interested in parallel processing and could try that out and see if that works for you, that's probably the direction this project should go.

@jeremyhaile
Copy link

So should this commit be closed in favor of #33?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants