Skip to content

Conversation

@muhammad-zoaib-scale
Copy link
Collaborator

@muhammad-zoaib-scale muhammad-zoaib-scale commented Jan 27, 2026

Summary
Add GCP (Google Cloud Platform) support to model-engine, enabling deployment on GCP infrastructure alongside existing AWS and Azure support.
Changes
New GCP Gateway Implementations:
gcs_filesystem_gateway.py - GCS file operations using smart_open library
gcs_llm_artifact_gateway.py - LLM model artifact storage and retrieval from GCS
gcs_file_storage_gateway.py - High-level file storage interface for GCS
New GCP Repository Implementations:
gcs_file_llm_fine_tune_repository.py - Store/retrieve fine-tune job templates from GCS
gcs_file_llm_fine_tune_events_repository.py - Store/retrieve fine-tune events from GCS
New Queue Delegate:
redis_queue_endpoint_resource_delegate.py - Redis-based queue lifecycle management for GCP (uses Memorystore)
Modified Files:
api/dependencies.py - Added GCP conditionals for dependency injection
celery_autoscaler.py - Added GCP_MEMORYSTORE_REDIS_BROKER constant
infra/gateways/init.py - Export new GCS gateway classes
infra/repositories/init.py - Export new GCS repository classes
requirements.in - Added google-auth and google-cloud-storage dependencies
Architecture Decisions
Celery Broker: GCP uses Redis (Memorystore) - same as ElastiCache pattern
Celery Backend: Uses Redis for task results (not GCS, avoiding need for custom Celery backend)
Storage: Uses smart_open library with GCS client, consistent with S3/ABS patterns
Queue Management: Redis queues are implicit (created on message push), so delegate handles lifecycle tracking and metrics

@muhammad-zoaib-scale muhammad-zoaib-scale self-assigned this Jan 27, 2026
@muhammad-zoaib-scale muhammad-zoaib-scale changed the title added gcp support in llm engine [Draft]added gcp support in llm engine Jan 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants