Skip to content

feat(seo): add sitemap, robots.txt, and meta tags for Google indexing #245

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
DevanshuNEU merged 7 commits into from
Feb 17, 2026
Merged

feat(seo): add sitemap, robots.txt, and meta tags for Google indexing #245

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
ce18a45
feat(seo): add robots.txt, sitemap.xml, and meta tags
DevanshuNEU Feb 17, 2026
f752628
feat(seo): add OG image template (SVG)
DevanshuNEU Feb 17, 2026
19aef51
fix(seo): change domain from .dev to .com
DevanshuNEU Feb 17, 2026
7563375
feat: added png format for the og-image
DevanshuNEU Feb 17, 2026
8dbf51b
fix(seo): address review nitpicks
DevanshuNEU Feb 17, 2026
1e85e79
fix(seo): correct routes in robots.txt and add all public pages to si…
DevanshuNEU Feb 17, 2026
b33fec1
chore: remove internal planning files from repo
DevanshuNEU Feb 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,3 +38,7 @@ mcp-server/__pycache__/
# Validation experiments
validation-experiment/
exp-2/

# Internal planning
IDEAS.md
TODO.md
57 changes: 55 additions & 2 deletions frontend/index.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,65 @@
<link rel="icon" type="image/png" href="/favicon.png" />
<link rel="apple-touch-icon" href="/favicon.png" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<meta name="description" content="Stop feeling lost in unfamiliar codebases. Semantic code search powered by AI." />

<!-- Primary Meta Tags -->
<title>OpenCodeIntel – Understand Any Codebase</title>
<meta name="title" content="OpenCodeIntel – Understand Any Codebase" />
<meta name="description" content="Stop feeling lost in unfamiliar codebases. Semantic code search powered by AI. Index your repos and search by meaning, not just keywords." />
<meta name="keywords" content="code search, semantic search, AI code assistant, codebase understanding, developer tools, MCP, code intelligence" />
<meta name="author" content="OpenCodeIntel" />
<meta name="theme-color" content="#0a0a0f" />

<!-- Canonical URL -->
<link rel="canonical" href="https://opencodeintel.com/" />

<!-- Open Graph / Facebook -->
<meta property="og:type" content="website" />
<meta property="og:url" content="https://opencodeintel.com/" />
<meta property="og:title" content="OpenCodeIntel – Understand Any Codebase" />
<meta property="og:description" content="Stop feeling lost in unfamiliar codebases. Semantic code search powered by AI. Index your repos and search by meaning, not just keywords." />
<meta property="og:image" content="https://opencodeintel.com/og-image.png" />
<meta property="og:image:width" content="1200" />
<meta property="og:image:height" content="630" />
<meta property="og:site_name" content="OpenCodeIntel" />

<!-- Twitter -->
<meta name="twitter:card" content="summary_large_image" />
<meta name="twitter:url" content="https://opencodeintel.com/" />
<meta name="twitter:title" content="OpenCodeIntel – Understand Any Codebase" />
<meta name="twitter:description" content="Stop feeling lost in unfamiliar codebases. Semantic code search powered by AI. Index your repos and search by meaning, not just keywords." />
<meta name="twitter:image" content="https://opencodeintel.com/og-image.png" />

<!-- Additional SEO -->
<meta name="robots" content="index, follow" />
<meta name="googlebot" content="index, follow" />

<!-- Fonts -->
<link rel="preconnect" href="https://fonts.googleapis.com">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link href="https://fonts.googleapis.com/css2?family=Inter:wght@300;400;500;600;700&family=JetBrains+Mono:wght@400;500&display=swap" rel="stylesheet">
<title>OpenCodeIntel – Understand Any Codebase</title>

<!-- JSON-LD Structured Data -->
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "SoftwareApplication",
"name": "OpenCodeIntel",
"applicationCategory": "DeveloperApplication",
"operatingSystem": "Web",
"description": "Semantic code search powered by AI. Index your repos and search by meaning, not just keywords.",
"url": "https://opencodeintel.com/",
"offers": {
"@type": "Offer",
"price": "0",
"priceCurrency": "USD"
},
"author": {
"@type": "Organization",
"name": "OpenCodeIntel"
}
}
</script>
</head>
<body>
<div id="root"></div>
Expand Down
Binary file added frontend/public/og-image.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
61 changes: 61 additions & 0 deletions frontend/public/og-image.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
15 changes: 15 additions & 0 deletions frontend/public/robots.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# OpenCodeIntel - Robots.txt
# https://opencodeintel.com

User-agent: *
Allow: /

# Disallow authenticated/private routes
Disallow: /dashboard
Disallow: /github/callback
Disallow: /login
Disallow: /signup
Disallow: /api/

# Sitemap location
Sitemap: https://opencodeintel.com/sitemap.xml
93 changes: 93 additions & 0 deletions frontend/public/sitemap.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,93 @@
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://opencodeintel.com/</loc>
<changefreq>weekly</changefreq>
<priority>1.0</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs</loc>
<changefreq>weekly</changefreq>
<priority>0.9</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/quickstart</loc>
<changefreq>weekly</changefreq>
<priority>0.9</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/mcp-setup</loc>
<changefreq>weekly</changefreq>
<priority>0.8</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/mcp-tools</loc>
<changefreq>weekly</changefreq>
<priority>0.8</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/mcp-examples</loc>
<changefreq>weekly</changefreq>
<priority>0.8</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/features/search</loc>
<changefreq>monthly</changefreq>
<priority>0.7</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/features/dependencies</loc>
<changefreq>monthly</changefreq>
<priority>0.7</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/features/impact</loc>
<changefreq>monthly</changefreq>
<priority>0.7</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/features/style</loc>
<changefreq>monthly</changefreq>
<priority>0.7</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/deployment/docker</loc>
<changefreq>monthly</changefreq>
<priority>0.6</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/deployment/self-host</loc>
<changefreq>monthly</changefreq>
<priority>0.6</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/api</loc>
<changefreq>weekly</changefreq>
<priority>0.8</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/api/repositories</loc>
<changefreq>monthly</changefreq>
<priority>0.7</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/api/search</loc>
<changefreq>monthly</changefreq>
<priority>0.7</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/api/analysis</loc>
<changefreq>monthly</changefreq>
<priority>0.7</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/architecture</loc>
<changefreq>monthly</changefreq>
<priority>0.6</priority>
</url>
<url>
<loc>https://opencodeintel.com/docs/contributing</loc>
<changefreq>monthly</changefreq>
<priority>0.6</priority>
</url>
</urlset>