Skip to content

feat: Reddit thread/subreddit archival #37

@Snider

Description

@Snider

Summary

Collect Reddit threads and subreddit content for community context archival.

Use Case

Dead crypto projects often have subreddits with valuable community discussion and announcements.

Commands

# Single thread
borg collect reddit thread https://reddit.com/r/Monero/comments/abc123

# Subreddit top posts
borg collect reddit subreddit r/Masari --limit 100 --sort top

# User posts
borg collect reddit user u/fluffypony

API Options

  1. Reddit API (requires auth)
  2. old.reddit.com scraping
  3. Pushshift archive API

Output

reddit/
├── r-Masari/
│   ├── posts/
│   │   ├── abc123.md
│   │   └── def456.md
│   ├── comments/
│   └── INDEX.json

Challenges

  • API rate limits
  • Deleted content (use Pushshift)
  • Media embeds

Acceptance Criteria

  • Collect single thread with comments
  • Collect subreddit top/new posts
  • Include comment threads
  • Handle deleted content via Pushshift
  • Markdown output format

Metadata

Metadata

Assignees

No one assigned

    Labels

    julesFor Jules AI to work on

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions