fix: Do not start and end the stream prematurely

[pavelhoral]

This PR fixes premature start of the glob stream which can lead to closing the resulting Transform stream before it is being properly processed by upstream components. This can lead to very strange race conditions and unfinished pipelines.

Closes #135

[phated]

This is awesome. Thanks for debugging and adding a regression test! I think we can actually leverage the open function in streamx for this.

[pavelhoral]

This is awesome. Thanks for debugging and adding a regression test! I think we can actually leverage the open function in streamx for this.

Not sure why, but moving the code to open function breaks the pipeline completely. Seems like open state is too soon for data being produced by the stream.

UPDATE: I am dumb... forgot about the callback.

[pavelhoral]

Pushed new changes (switch to open method).

[pavelhoral]

Any update on this? Is there anything else I can do? Ty.

[pavelhoral]

Any update on this? Is there anything else I can do? Ty.

Would love to have this merged and released. If there is anything I can do to help that, let me know.

[yocontra]

Seems reasonable to me, will let @phated weigh in here

[phated]

@pavelhoral Sorry for such a long delay—life kicked my butt last year. I want to say that your work here is greatly appreciated! You performed amazing debugging and the fix is great.

I wanted to give this PR the attention it deserved, which lead me to finding the regression test didn't fail on main. I figured out that inserting a transform stream resulted in the failure, so I pushed that on the branch. I also rebased to get some CI fixes that I just landed.

[phated]

This has been released as v8.0.3

Again, sorry for the really long delay and thank you so much for the contribution!