Automate AIOpsLab provisioning and deployment with unified Terraform-Ansible integration

[Copilot]

This PR significantly reduces manual steps for AIOpsLab deployment by creating a unified automation solution that integrates Terraform provisioning with Ansible configuration management.

Problem

Previously, setting up AIOpsLab required 15-20 manual steps involving:

• Separate Terraform commands for infrastructure provisioning
• Manual SSH key management and file permissions
• Manual creation of Ansible inventory files
• Multiple shell script executions with manual coordination
• Manual error handling and recovery
• Complex handoff between infrastructure and configuration phases

This process was error-prone, time-consuming (30-60 minutes), and required deep technical knowledge of multiple tools.

Solution

Created a comprehensive automation solution with three main components:

1. Unified Deployment Script (deploy_unified.py)

A complete orchestration tool that:

• Validates prerequisites (Azure CLI, Terraform, Ansible)
• Provisions Azure infrastructure using Terraform
• Automatically generates Ansible inventory from Terraform outputs
• Executes Ansible playbooks for Kubernetes cluster setup
• Installs and configures AIOpsLab on the controller node
• Provides comprehensive error handling and retry logic
• Supports both interactive and automated deployment modes

2. Simplified Entry Point (deploy.py)

A user-friendly wrapper that:

• Provides interactive prompts for required parameters
• Maintains backward compatibility with existing workflows
• Guides users through configuration options
• Executes the unified deployment tool with proper parameters

3. Enhanced Infrastructure Configuration

• Terraform: Added support for automatic resource group creation, improved variable management, and enhanced outputs for better integration
• Ansible Integration: Automatic inventory generation with proper SSH key references and connectivity validation
• Security: Proper SSH key permissions, sensitive data handling, and configurable network security

Additional Features

Testing and Validation

• Comprehensive test suite (13 unit tests) covering deployment logic, configuration validation, and error handling
• Post-deployment verification script that validates SSH connectivity, Kubernetes cluster health, service status, and network connectivity
• YAML and Python syntax validation for all configuration files

Documentation and Usability

• Complete rewrite of deployment documentation with quick start guide
• Quick reference card for common operations
• Configuration templates and examples
• Comprehensive troubleshooting section

Usage

Simple deployment (recommended for most users):

cd scripts/terraform/
python deploy.py  # Interactive prompts guide configuration

Advanced deployment:

python deploy_unified.py deploy \
  --resource-group "my-aiopslab-rg" \
  --prefix "aiopslab" \
  --location "westus2" \
  --create-resource-group

Verify deployment:

python verify_deployment.py

Cleanup:

python deploy_unified.py destroy --resource-group "my-rg" --prefix "prefix"

Impact

• Time reduction: From 30-60 minutes to 5-10 minutes of active work
• Steps reduced: From ~20 manual steps to 1 command
• Error reduction: Automated validation prevents common configuration failures
• Skill barrier lowered: Interactive interface accessible to users with varying technical expertise

The solution maintains full compatibility with existing Ansible playbooks while adding significant automation and error handling on top of the current infrastructure.

Fixes #54.

---

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.