The CI process takes the previous and current states of the resources file, and performs the following check on each Source:
- Is the source new
- Has the source URL changed
- Has the destination URL changed
- Is the destination bucket absent
If these are True, nothing is copied. This fails to spot the situation in #31 where the sources and destinations are the same, but the content is moved around, or new files are required from previously existing sources. In this PR a whole bunch of data was added in files, but that is not checked by this process, so no transfer is initiated.
In this instance it's a happy coincidence that the discrepant files had previously been sync'd over, they just weren't present in config.
The CI process takes the previous and current states of the resources file, and performs the following check on each Source:
If these are True, nothing is copied. This fails to spot the situation in #31 where the sources and destinations are the same, but the content is moved around, or new files are required from previously existing sources. In this PR a whole bunch of data was added in
files, but that is not checked by this process, so no transfer is initiated.In this instance it's a happy coincidence that the discrepant files had previously been sync'd over, they just weren't present in config.