System Architecture#

This section provides detailed architectural documentation for the CCAT Data Center infrastructure.

Infrastructure Overview#

CI/CD Pipeline Infrastructure Details

Components#

The CCAT Data Center consists of several integrated systems:

Data Management Layer

  • Operations Database - OpsDB - PostgreSQL database for observation metadata

  • Object Storage - DataStorage.NRW - S3 compatible object storage for raw and processed data files

  • Time-Series Database - InfluxDB for metrics and monitoring data

Application Layer

  • ops-db-api - RESTful API for data access and filing

  • ops-db-ui - Web interface for browsing and management

  • data-transfer - Automated data movement services

Infrastructure Layer

  • Container Platform - Docker and Kubernetes (on RAMSES)

  • Monitoring Stack - Monitoring & Observability - InfluxDB, Grafana, Loki, and Promtail for observability

  • Secrets Management - [Infisical](infisical_secrets_management) for credential management

  • Reverse Proxy - nginx for routing and SSL termination

  • CI/CD - GitHub Actions for automated builds and Jenkins for deployment

  • Configuration Management - Ansible for configuration management

Network Architecture#

Note

Detailed network diagrams and configuration will be added here.

The data center is accessible from:

  • University of Cologne network (direct)

  • University VPN

  • Whitelisted collaborator institutions

  • Observatory on-premises network

Deployment Topology#

Note

Detailed deployment diagrams will be added here.

The system supports multiple deployment configurations:

  • Production - High availability, multi-node Kubernetes cluster

  • Staging - Single-node or reduced-scale testing environment

  • Local Development - Docker Compose for developer workstations