Skip to content

fix(#43): data integrity — PII scrubbing, INSERT-only, UUIDv5, repository pattern#118

Open
Dan-StrategicAutomation wants to merge 1 commit into
devfrom
fix/43-data-integrity
Open

fix(#43): data integrity — PII scrubbing, INSERT-only, UUIDv5, repository pattern#118
Dan-StrategicAutomation wants to merge 1 commit into
devfrom
fix/43-data-integrity

Conversation

@Dan-StrategicAutomation

Copy link
Copy Markdown
Collaborator

Fixes #43

  • Extract KnowledgeBaseStorage to utils/knowledge/repository.py (repository pattern)
  • Use INSERT instead of INSERT OR REPLACE to prevent silent overwrites
  • Generate migration IDs with UUIDv5 (deterministic namespace)
  • Scrub PII from metadata string values before JSON serialization
  • Delegate SQLite persistence to KnowledgeBaseStorage
  • Remove unused json and sqlite3 imports
  • Add missing init.py files

Depends-on: fix/config-quality (must merge first)

…v5 IDs, repository pattern extraction

- Extract KnowledgeBaseStorage to utils/knowledge/repository.py (repository pattern)
- Use INSERT instead of INSERT OR REPLACE to prevent silent overwrites
- Generate migration IDs with UUIDv5 (deterministic namespace)
- Scrub PII from metadata string values before JSON serialization
- Delegate SQLite persistence to KnowledgeBaseStorage
- Remove unused json and sqlite3 imports
- Add missing utils/__init__.py and utils/agent/__init__.py
data["content"] = meta.pop("original_content_object")
# Merge rest
data.update(meta)
except Exception:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[P1] data: Improve Knowledge Base Transaction Safety and PII Scrubbing

1 participant