Skip to content

fix(#13): fix GitHub issue/comment scraping for stale repos#15

Open
rbalogic wants to merge 1 commit into
ohcnetwork:productionfrom
rbalogic:fix/13-missing-comment-activities
Open

fix(#13): fix GitHub issue/comment scraping for stale repos#15
rbalogic wants to merge 1 commit into
ohcnetwork:productionfrom
rbalogic:fix/13-missing-comment-activities

Conversation

@rbalogic
Copy link
Copy Markdown

@rbalogic rbalogic commented Apr 27, 2026

Summary

Fixes partial GitHub activity ingestion for repositories that had stale repository.updated_at timestamps, which could cause valid recent issue/comment activity to be skipped.

Changes

  • Removed the early skip gate based on repo.updated_at < since
  • Updated GitHub issue fetching to include both OPEN and CLOSED states
  • Made scrape lookback window configurable via config.scrapeDays or SCRAPE_DAYS
  • Added issue #13 handoff notes, including verification and backfill guidance

Context

Resolves #13, where recent issue_opened and commented activities from ohcnetwork/design were missing while other activity types (e.g. pr_opened) continued to update.

Verification

  • Ran node --check plugins/github.js
  • Verified reported missing events using gh API:
    • ohcnetwork/design#92 (issue opened)
    • recent comment activity on ohcnetwork/design#85

Follow-up

Run a manual scrape with a wider lookback window (for example, days: 30) to backfill already-missed April 2026 events.

@rbalogic rbalogic changed the title fix(#13): fix gitHub issue/comment scraping for stale repos fix(#13): fix GitHub issue/comment scraping for stale repos Apr 27, 2026
@rbalogic
Copy link
Copy Markdown
Author

rbalogic commented May 6, 2026

@rithviknishad Please review the changes when you can, Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Missing issue_opened and commented activities in leaderboard-data

1 participant