📧 AEC Outlook MCP - AEC-Specialized AI Email Intelligence

An MCP (Model Context Protocol) server that transforms Outlook email management with RAG-based semantic search and Vision AI for architectural document analysis - built specifically for Architecture, Engineering & Construction workflows.

🎯 Built for AEC Professionals

Unlike generic email tools, this is designed for the unique challenges of architectural practice:

🔍 Semantic Search with RAG

• ChromaDB vector database for intelligent email indexing
• Natural language queries: "Find emails about the BIM coordination meeting"
• Attachment content search: Search inside PDFs, Word docs, Excel files

👁️ Multi-Modal Vision AI

• Claude Vision API for architectural drawing analysis
• Gemini Vision API for technical document processing
• Specialized prompts for floor plans, elevations, sections, details
• OCR fallback with Tesseract (Korean + English)

🏗️ AEC-Specific Features

• Bilingual support: Korean + English for international projects
• Technical drawing analysis: Understands architectural documents
• RFI/Submittal parsing: Extract key information from construction docs
• 100% Local processing: Email data never leaves your machine

📋 Features Overview

Feature	Description
Semantic Search	Natural language email queries via RAG
Vision AI	Claude + Gemini for image/PDF analysis
Attachment Parsing	PDF, Word, Excel, Images
Date/Sender Filters	Metadata-based search
Folder Navigation	Access all Outlook folders
Local Processing	Complete privacy, no cloud upload

🛠️ Installation

git clone https://github.com/dongwoosuk/aec-outlook-mcp.git
cd aec-outlook-mcp
python -m venv .venv
.venv\Scripts\activate  # Windows
pip install -e .

For OCR support:

pip install -e ".[ocr]"

For Vision AI:

pip install anthropic google-generativeai

⚙️ Configuration

Environment Variables (Optional)

# For Vision AI features
set ANTHROPIC_API_KEY=your_claude_api_key
set GOOGLE_API_KEY=your_gemini_api_key

Claude Desktop Configuration

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "outlook": {
      "command": "path/to/aec_outlook_mcp/.venv/Scripts/python.exe",
      "args": ["-m", "aec_outlook_mcp"],
      "env": {
        "PYTHONPATH": "path/to/aec_outlook_mcp"
      }
    }
  }
}

📚 Available Tools

Tool	Description
email_search	Natural language semantic search
email_search_by_sender	Filter by sender
email_search_by_date	Filter by date range
email_search_attachments	Search attachment contents
email_index_status	Check indexing progress
email_index_refresh	Index new emails
email_get_detail	Get full email details
email_list_folders	List Outlook folders

💡 Usage Examples

In Claude Desktop:

"Find emails from the structural engineer about beam calculations"

"Search for RFI responses from last week"

"Find all emails with PDF attachments about the facade design"

"What did the contractor say about the schedule delay?"

Vision AI for Attachments:

"Analyze the floor plan attached in John's email"

"What dimensions are shown in this elevation drawing?"

"Extract the specification details from the attached PDF"

🏗️ Architecture

aec_outlook_mcp/
├── aec_outlook_mcp/
│   ├── server.py           # Main MCP server
│   ├── outlook_reader.py   # Win32com Outlook integration
│   ├── email_indexer.py    # ChromaDB RAG indexing
│   ├── attachment_parser.py # PDF/Word/Excel/Vision AI
│   ├── config.py           # Configuration management
│   └── cli.py              # Command-line interface
└── pyproject.toml

🔧 Technical Stack

Component	Technology
Email Access	win32com (Outlook COM API)
Vector DB	ChromaDB
Embeddings	sentence-transformers (all-MiniLM-L6-v2)
PDF Parsing	PyMuPDF
Word Parsing	python-docx
Excel Parsing	openpyxl
OCR	Tesseract (kor+eng)
Vision AI	Anthropic Claude, Google Gemini

🎯 Use Cases

For Project Architects (PA)

• Quickly find client feedback across hundreds of emails
• Search RFI responses and submittal approvals
• Track consultant coordination threads

For Project Managers (PM)

• Search contract and schedule discussions
• Find meeting notes and action items
• Track change order communications

For Designers

• Find design review comments
• Search for reference images and inspiration
• Locate specification discussions

Future: Office-Wide Deployment

• Centralized email intelligence for entire teams
• Shared knowledge base across projects
• AI-powered email analytics and reporting

⚠️ Requirements

• Windows with Outlook Desktop app installed and logged in
• Python 3.10+
• Outlook must be running for email access

🔒 Privacy & Security

• 100% local processing: Emails are indexed locally in ChromaDB
• No cloud upload: Email content never leaves your machine
• API keys optional: Vision AI features require API keys, but core search works without them
• Data location: C:\Users\{USERNAME}\Documents\OutlookMCP\

📄 License

MIT License - see LICENSE file.

🙏 Acknowledgments

• Built on the Model Context Protocol by Anthropic
• ChromaDB for vector storage
• sentence-transformers for embeddings

📬 Contact

Dongwoo Suk - Computational Design Specialist

• GitHub: dongwoosuk
• LinkedIn: dongwoosuk