Consolidate enterprise extensions from PRs #3-#10

[Copilot]

Consolidates 8 PRs adding enterprise-grade deployment, resource provisioning, and infrastructure automation capabilities into a single mergeable branch.

New Modules (14 files, ~2,956 lines)

Deployment & Orchestration

• proxy.py — Fluent builders for Caddyfile/nginx with production presets (.api(), .spa(), .security_headers())
• detect.py — Framework auto-detection (Python/Go/Rust/Node.js) + Dockerfile generation
• ship.py — Enhanced with Hetzner auto-provisioning and GCP Cloud Run targets
• compliance.py — SOC2/HIPAA/ISO27001 hardening commands and config presets

Resource Provisioning

• resources.py (872 lines) — Cloud-agnostic provisioning: databases, caches, queues, storage, LLM, functions, search across Docker/AWS/Azure/GCP
• connect.py (358 lines) — ResourceConfig for config persistence and Python client wrappers (fastsql, redis, boto3)
• teardown.py (415 lines) — Resource cleanup with destroy(), destroy_stack(), status()

Cloud Integrations

• azure.py, aws.py, gcp.py — CLI wrappers + *_stack() orchestrators
• secrets.py — Unified API across Azure KV, AWS SM, GCP SM, env vars

Infrastructure & CI/CD

• infra.py (389 lines) — pyinfra integration for idempotent provisioning with auto-fallback to SSH
• ci.py (592 lines) — Programmatic GitHub Actions/GitLab CI generation

Conflict Resolutions

• __init__.py — Merged exports from all PRs (112 total)
• ship.py — Combined Hetzner and GCP deployment branches
• pyproject.toml — Merged optional deps: db, storage, llm, cache, queue, search, azure, aws, infra
• teardown.py — Appended GCP-specific teardown functions to base module

Usage

from fastops import ship, stack, database, cache, github_actions

# Define resources once, deploy anywhere
resources = {
    'db': lambda: database('app', engine='postgres', provider='docker'),
    'cache': lambda: cache('redis', provider='docker'),
}

ship('.', to='docker', resources=resources)      # Local dev
ship('.', to='hetzner', resources=resources)     # Hetzner VPS (auto-provisioned)
ship('.', to='gcp', resources=resources)         # GCP Cloud Run

# Generate CI/CD
github_actions('deploy', app_name='myapp', 
               registry='ghcr', deploy_target='hetzner')

Deployment Targets

• docker — Local compose
• vps — Generic SSH
• hetzner — Auto-provisioned cx22 with cloud-init (€4/mo)
• azure — Container Instances + managed services
• aws — ECS/App Runner + managed services
• gcp — Cloud Run + Cloud SQL/Memorystore

All providers support idempotent provisioning and teardown.

Original prompt

Objective

Consolidate all changes from the following open PRs into a single branch targeting main, so everything can be reviewed and merged in one unified PR:

• PR Add enterprise extensions: proxy builders, auto-detection, compliance, secrets, and multi-cloud orchestration #3 (copilot/implement-enterprise-grade-extensions → main): Enterprise extensions - proxy builders (proxy.py), auto-detection (detect.py), compliance (compliance.py), secrets (secrets.py), cloud CLI wrappers (azure.py, aws.py), unified orchestrator (ship.py), and __init__.py updates. ~2,000 lines across 7 new modules.

• PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4 (copilot/add-cloud-resource-provisioning → PR Add enterprise extensions: proxy builders, auto-detection, compliance, secrets, and multi-cloud orchestration #3's branch): Cloud resource provisioning (resources.py) - database, cache, queue, bucket, LLM, function, search, stack. Updates to ship.py and __init__.py.

• PR Add ResourceConfig for zero-config resource provisioning and Pythonic client wrappers #5 (copilot/add-resource-config-export → PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4's branch): connect.py with ResourceConfig class, zero-config defaults in resources.py, optional dependency groups in pyproject.toml.

• PR Add resource teardown, CLI validation, and idempotent provisioning #6 (copilot/add-resource-teardown-methods → PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4's branch): teardown.py with destroy(), destroy_stack(), status(). CLI validation and idempotent provisioning updates to resources.py.

• PR Add ship(to='hetzner') auto-provisioning deployment target #7 (copilot/add-hetzner-deployment-target → PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4's branch): ship(to='hetzner') auto-provisioning in ship.py.

• PR Add optional pyinfra integration for idempotent server provisioning #8 (copilot/add-pyinfra-integration → PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4's branch): infra.py with idempotent provisioning via pyinfra. Optional dependency in pyproject.toml.

• PR Add GCP Cloud Run support with managed services orchestration #9 (GCP Cloud Run support - likely based on PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4's branch): GCP CLI wrapper and Cloud Run deployment.

• PR Add CI/CD pipeline generation module for GitHub Actions and GitLab CI #10 (CI/CD pipeline generation - likely based on PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4's branch): CI/CD pipeline generation module for GitHub Actions and GitLab CI.

Instructions

1. Create a new branch off main (e.g., consolidated/all-enterprise-features).
2. Cherry-pick or merge all changes from the above PRs in dependency order:
   • First: PR Add enterprise extensions: proxy builders, auto-detection, compliance, secrets, and multi-cloud orchestration #3's changes (the base enterprise extensions)
   • Then: PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4's changes (resource provisioning layer)
   • Then: PRs Add ResourceConfig for zero-config resource provisioning and Pythonic client wrappers #5, Add resource teardown, CLI validation, and idempotent provisioning #6, Add ship(to='hetzner') auto-provisioning deployment target #7, Add optional pyinfra integration for idempotent server provisioning #8, Add GCP Cloud Run support with managed services orchestration #9, Add CI/CD pipeline generation module for GitHub Actions and GitLab CI #10 (all branch off PR Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4)
3. Resolve any conflicts — particularly in files modified by multiple PRs:
   • fastops/__init__.py (exports added by every PR)
   • fastops/ship.py (modified by PRs Add enterprise extensions: proxy builders, auto-detection, compliance, secrets, and multi-cloud orchestration #3, Add cloud-agnostic resource provisioning layer (databases, caches, queues, storage, LLM, search) #4, Add ship(to='hetzner') auto-provisioning deployment target #7)
   • pyproject.toml (modified by PRs Add ResourceConfig for zero-config resource provisioning and Pythonic client wrappers #5, Add optional pyinfra integration for idempotent server provisioning #8)
4. Ensure the final branch compiles/imports cleanly.
5. The PR description should list all consolidated changes with a summary of every module added/modified.

Expected Result

A single PR targeting main that contains ALL new modules and changes from PRs #3-#10, ready for a single review and merge.

This pull request was created from Copilot chat.

---

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.