Add workflow for checking rstan and/or StanHeaders reverse-dependency status#1190
Open
andrjohns wants to merge 7 commits into
Open
Add workflow for checking rstan and/or StanHeaders reverse-dependency status#1190andrjohns wants to merge 7 commits into
andrjohns wants to merge 7 commits into
Conversation
…duce default running times
Contributor
Author
|
I've tweaked the config to allow for customising the sources for |
Member
|
If this is working well can we use this same workflow (or a slightly modified one) to do the reverse dependency checks for rstantools? Although I guess doing the rstan checks is essentially already checking all the rstantools reverse dependencies I would assume. So maybe we only need this here and not also in rstantools? |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary:
In order to make the process of getting new
rstanup on CRAN a bit easier, I've put together an actions workflow for running the full reverse-dependency checks. Once all reverse-dependencies are consistently passing, it would be great to also include as an (infrequently) scheduled CI.It operates in three stages:
The full dependency tree for all reverse-dependencies is built/downloaded, and then cached and reused in the subsequent steps
a. Pre-built binary packages are used for almost all dependencies (~10 need to be built)
The list of reverse dependencies is split into batches of a specified size and batches are checked in parallel
a. The number of dependencies to check per batch defaults to 10, but can be set when triggering workflow
b. The maximum number of batches running in parallel is limited to 5 by default, but can also be configured
The results of all checks are collated and a summary generated
The job can be set to check either
rstan(implying also developmentStanHeaders) or justStanHeaders(implying CRANrstan).The reverse-dependency summary is reported in the action summary itself, and all check/install logs are attached as artifacts. You can see current runs here:
StanHeaders(CRANrstan)rstan(GHStanHeaders)Using the defaults (10 packages per batch, maximum 5 batches running at once), the
rstanchecks finished in ~3.5 hours. This might increase as the number of incompatible packages increases (currently 64 not building), but I'm hoping that the twin dials for batch size and parallelism will keep the impact fairly minimalCopyright and Licensing
Please list the copyright holder for the work you are submitting (this will be you or your assignee, such as a university or company): Andrew Johnson
By submitting this pull request, the copyright holder is agreeing to license the submitted work under the following licenses: