Skip to content

Conversation

@kaladron
Copy link
Contributor

This checks out GNU tar and runs its test suite
against our built tar binary.

The hooks in autotest aren't working correctly,
so we manually overwrite the built binary with
our generated binary for testing.

This checks out GNU tar and runs its test suite
against our built tar binary.

The hooks in autotest aren't working correctly,
so we manually overwrite the built binary with
our generated binary for testing.
@kaladron
Copy link
Contributor Author

Hi @sylvestre! I need guidance on this PR. =)

It's correctly showing that all tests are failing (I spot checked the logs, it's calling with "tar cf", which we don't handle)

How do we make the nice graph that you have for Coreutils? =)

@codecov
Copy link

codecov bot commented Nov 22, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 0.00%. Comparing base (b55f085) to head (1022db3).
⚠️ Report is 36 commits behind head on main.

Additional details and impacted files
@@    Coverage Diff     @@
##   main   #45   +/-   ##
==========================
==========================

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@kaladron
Copy link
Contributor Author

Also, how do you have it set on uutils/coreutils to not show everything as failing on each PR? I cribbed the setup from coreutils, but I think I'm missing something in the setup.

@sylvestre
Copy link
Contributor

the process is basically:

  1. build with the right options - https://github.com/uutils/coreutils/blob/main/util/build-gnu.sh
  2. run the gnu testsuite with our impl - https://github.com/uutils/coreutils/blob/main/util/run-gnu-test.sh
  3. parse the results and generate the json file - https://github.com/uutils/coreutils/blob/main/util/analyze-gnu-results.py / https://github.com/uutils/coreutils/blob/main/.github/workflows/GnuTests.yml
  4. comments are published this way: https://github.com/uutils/coreutils/blob/main/.github/workflows/GnuComment.yml
  5. for the graph, every day (or twice), this project https://github.com/uutils/coreutils-tracking/ is going to download the .json file and generate the graphs

@sylvestre
Copy link
Contributor

hope this helps!

@kaladron
Copy link
Contributor Author

kaladron commented Nov 22, 2025 via email

@kaladron kaladron marked this pull request as draft November 23, 2025 16:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants