Terraform by itself knows nothing about AWS, Azure, or any cloud. It needs a "translator" that knows how to talk to each platform. That translator is the provider. In this subchapter, you'll understand what a provider is, how Terraform communicates with AWS, and how it is configured. It's the piece that connects your code to the real cloud.
What is a provider
A provider is a plugin that teaches Terraform how to communicate with a specific platform. The AWS provider knows how to create, read, modify, and delete AWS resources through its API.
Analogy: Terraform is like a person who wants to give instructions in many different countries. The provider is the interpreter/translator who knows the language of each country. The AWS provider "speaks AWS"; the Azure provider "speaks Azure." You give instructions in HCL and the provider translates them into the language of the corresponding cloud.
This is what makes Terraform multi-cloud (remember Chapter 9): the same Terraform uses different providers to talk to different platforms. There are hundreds of providers: AWS, Azure, GCP, Kubernetes, GitHub, Cloudflare, and many more.
How Terraform communicates with AWS
The flow, simplified, is this:
Your HCL code → Terraform → AWS Provider → AWS API → Your infrastructure (.tf) (the engine) (the translator) (internet) (real resources)
- You write what you want in HCL (
resource "aws_instance"...). - Terraform processes your code.
- The AWS provider translates that into AWS API calls (the same ones used by the web console behind the scenes).
- AWS creates/modifies/deletes the real resources.
Every resource that starts with aws_ (like aws_instance, aws_s3_bucket) is managed by the AWS provider.
How to declare the provider
In your code, you declare which provider you want to use and configure it. This usually goes in a terraform block (to set the version) and a provider block:
terraform {
required_providers {
aws = {
source = "hashicorp/aws"
version = "~> 5.0"
}
}
}
provider "aws" {
region = "eu-west-1"
}Let's break it down:
- The
terraform { required_providers { ... } }block declares that you need the AWS provider, where to download it from (hashicorp/aws), and which version (~> 5.0means "version 5.x"). - The
provider "aws" { ... }block configures it: here you specify, for example, the region to work in (remember Chapter 3).
Why setting the version matters: providers are updated and sometimes change their behavior. Setting the version (
~> 5.0) ensures your code keeps working the same even if new versions come out. It's a good practice to avoid surprises.
Authentication: how does Terraform prove who it is?
For AWS to allow it to create resources, Terraform needs credentials (remember IAM, Chapter 7). But, very importantly, credentials are not written in the code. There are secure ways to provide them:
| Method | How it works | When to use it |
|---|---|---|
| Configured AWS CLI | Terraform uses the credentials from your machine's AWS CLI | Local development |
| Environment variables | AWS_ACCESS_KEY_ID, etc. in the environment |
Local and automation |
| IAM Role | The machine (EC2) or CI/CD system assumes a role | Production and CI/CD (the best) |
⚠️ Critical security rule: NEVER write access keys inside your
.tfcode. If you push it to Git, you would be leaking your credentials (remember the disasters from Chapter 7). Instead, use the AWS CLI, environment variables, or, best of all, IAM roles (subchapter 7.4). Terraform automatically picks them up from the environment, without them appearing in the code.
terraform init: downloading the provider
Before you can use a provider, you have to download it. This is done by the terraform init command, which is the first command you run in any Terraform project.
terraform init → downloads the AWS provider (and any others you use) → prepares the working directory → "Terraform has been successfully initialized!"
init reads your configuration, downloads the necessary providers, and gets everything ready for plan and apply (remember the cycle from subchapter 9.4). You run it:
- The first time you start a project.
- Every time you add a new provider or change its version.
- (It also configures the state backend, which we'll see in subchapter 11.3.)
So, the complete Terraform cycle is actually: init → plan → apply → ... → destroy.
Multiple providers and aliases
For advanced cases, you can use multiple providers at once or the same provider with different configurations. For example, deploying to two AWS regions using two AWS provider configurations with aliases:
provider "aws" {
region = "eu-west-1" # default provider
}
provider "aws" {
alias = "us"
region = "us-east-1" # a second provider for another region
}This is useful for multi-region architectures (Chapter 26) or multi-account (Chapter 30). Don't worry about this now; just know that it's possible.
What you should remember
- A provider is the "translator" that allows Terraform to talk to a platform. The AWS provider translates your HCL into AWS API calls.
- Thanks to providers, Terraform is multi-cloud (there are hundreds: AWS, Azure, GCP, Kubernetes…).
- It is declared with
required_providers(setting the version, good practice) and configured with theproviderblock (region, etc.). - Credentials NEVER go in the code: use AWS CLI, environment variables, or, better, IAM roles.
terraform initdownloads the providers and is the first command you run in a project.
In the next subchapter, we'll see Terraform's most characteristic (and sometimes confusing) concept: the state file (terraform.tfstate) and why it is so important.
Cloud, AWS & Terraform — From Zero to Expert
Chapter 1 · What is cloud computing
- 1.1 The traditional client-server model
- 1.2 Problems the cloud came to solve
- 1.3 On-premise vs cloud vs hybrid
- 1.4 The three service models: IaaS, PaaS, SaaS
- 1.5 The five pillars of cloud (according to NIST)
- 1.6 Real advantages: elasticity, pay-as-you-go, global availability
Chapter 2 · The cloud market and major providers
- 2.1 AWS, Azure and GCP: differences and market share
- 2.2 Why learn AWS first
- 2.3 Concepts that are universal among providers
Chapter 3 · Regions, availability zones and edge
- 3.1 What is an AWS region and how to choose it
- 3.2 Availability Zones: high availability by design
- 3.3 Edge locations and CloudFront
- 3.4 Latency, resilience and data sovereignty
Chapter 4 · Compute: EC2
- 4.1 Instances: types, families and when to choose each
- 4.2 AMIs, key pairs and Security Groups
- 4.3 Instance lifecycle
- 4.4 Elastic IPs and Placement Groups
- 4.5 Savings Plans vs Reserved vs On-Demand vs Spot
Chapter 5 · Storage: S3
- 5.1 Buckets, objects and keys
- 5.2 Storage classes (Standard, IA, Glacier…)
- 5.3 Versioning and object lifecycle
- 5.4 Bucket policies and ACLs
- 5.5 Static website hosting
Chapter 6 · Networking: VPC
- 6.1 What is a VPC and why you need it
- 6.2 Public and private subnets
- 6.3 Internet Gateway and NAT Gateway
- 6.4 Route Tables and Network ACLs
- 6.5 VPC Peering and endpoints
Chapter 7 · Identity and access: IAM
- 7.1 Users, groups, roles and policies
- 7.2 The principle of least privilege
- 7.3 Identity-based vs resource-based policies
- 7.4 MFA and temporary credentials (STS)
- 7.5 IAM security best practices
Chapter 8 · Managed databases
- 8.1 RDS: engines, Multi-AZ and read replicas
- 8.2 Aurora and its advantages over vanilla RDS
- 8.3 DynamoDB: key-value / document model
- 8.4 ElastiCache for in-memory cache
- 8.5 When to use each type of database
Chapter 9 · Why Infrastructure as Code
- 9.1 Problems with manual provisioning
- 9.2 Declarative vs imperative IaC
- 9.3 Terraform vs CloudFormation vs Pulumi vs CDK
- 9.4 The plan → apply → destroy cycle
Chapter 10 · HCL: the Terraform language
- 10.1 Resource, variable, output, locals blocks
- 10.2 Data types: string, number, bool, list, map, object
- 10.3 Expressions, references and built-in functions
- 10.4 Conditionals and loops (count, for_each, for)
Chapter 11 · Providers and state
- 11.1 How the AWS provider works
- 11.2 The terraform.tfstate file and its importance
- 11.3 Local state vs remote state (S3 + DynamoDB)
- 11.4 Essential commands: init, plan, apply, destroy, fmt, validate
Chapter 12 · Your first real infrastructure in Terraform
- 12.1 Create a VPC with subnets from scratch
- 12.2 Launch a public EC2 instance
- 12.3 Associate a Security Group and an Elastic IP
- 12.4 Outputs and references between resources
- 12.5 Team workflow: PR review of plans
Chapter 13 · Load balancing and auto scaling
- 13.1 Application Load Balancer vs Network Load Balancer
- 13.2 Target Groups, listeners and rules
- 13.3 Auto Scaling Groups: policies and metrics
- 13.4 Warm pools and lifecycle hooks
Chapter 14 · Serverless with Lambda
- 14.1 The Lambda execution model
- 14.2 Triggers: API Gateway, S3, DynamoDB Streams, SQS
- 14.3 Dependency management and layers
- 14.4 Cold starts and strategies to reduce them
- 14.5 Limits and anti-patterns
Chapter 15 · Messaging and events
- 15.1 SQS: standard vs FIFO queues, DLQ
- 15.2 SNS: topics, subscriptions, fan-out
- 15.3 EventBridge: event buses and rules
- 15.4 Patterns: pub/sub, decoupling, saga
Chapter 16 · Content delivery and DNS
- 16.1 Route 53: record types and routing policies
- 16.2 CloudFront: distributions, caches and origins
- 16.3 ACM: free SSL/TLS certificates
- 16.4 WAF integrated with CloudFront
Chapter 17 · Containers on AWS
- 17.1 Docker: quick review of key concepts
- 17.2 ECR: private image registry
- 17.3 ECS: task definitions, services, Fargate vs EC2
- 17.4 EKS: when Kubernetes and when not
Chapter 18 · Modules: reuse and composition
- 18.1 Anatomy of a Terraform module
- 18.2 Input variables, outputs and dependencies
- 18.3 Local modules vs Terraform Registry modules
- 18.4 Module versioning with Git tags
- 18.5 Design of generic vs domain-specific modules
Chapter 19 · Workspaces and environment management
- 19.1 Terraform workspaces: use cases and limitations
- 19.2 Directory strategy per environment (dev/stg/prod)
- 19.3 Terragrunt: DRY for environment configurations
- 19.4 Environment variables and .tfvars files
Chapter 20 · Remote backends and locking
- 20.1 Configure S3 + DynamoDB as backend
- 20.2 State locking: avoiding team corruption
- 20.3 State migration between backends
- 20.4 terraform import: bring existing resources into state
Chapter 21 · Infrastructure testing
- 21.1 Terraform validate and fmt in CI
- 21.2 Checkov and tfsec: static security analysis
- 21.3 Terratest: integration tests in Go
- 21.4 Contract testing between modules
Chapter 22 · Terraform in CI/CD
- 22.1 Basic pipeline: lint → plan → apply in GitHub Actions
- 22.2 Atlantis: GitOps for Terraform
- 22.3 Terraform Cloud / HCP Terraform
- 22.4 Drift detection and automatic reconciliation
Chapter 23 · Defense in depth
- 23.1 AWS Organizations and Service Control Policies
- 23.2 AWS Config: continuous compliance
- 23.3 GuardDuty: threat detection
- 23.4 Security Hub: centralized view
- 23.5 KMS: key management and rotation
- 23.6 Secrets Manager vs Parameter Store
Chapter 24 · Observability: logs, metrics and traces
- 24.1 CloudWatch Logs, metrics and alarms
- 24.2 CloudWatch Dashboards and Contributor Insights
- 24.3 X-Ray: distributed tracing
- 24.4 OpenTelemetry on AWS
- 24.5 Managed Grafana and Managed Prometheus
Chapter 25 · Cost optimization
- 25.1 AWS Cost Explorer and budgets with alerts
- 25.2 Trusted Advisor and Compute Optimizer
- 25.3 Rightsizing: how to detect overprovisioning
- 25.4 Savings Plans vs Reserved Instances: strategic decision
- 25.5 FinOps: culture and processes to control spending
Chapter 26 · High availability and disaster recovery
- 26.1 RTO and RPO: defining objectives
- 26.2 Strategies: backup/restore, pilot light, warm standby, multi-site
- 26.3 Route 53 health checks and automatic failover
- 26.4 AWS Backup: centralized backup policy
Chapter 27 · AWS Well-Architected Framework
- 27.1 The six pillars: operational excellence, security, reliability, performance efficiency, cost optimization, sustainability
- 27.2 Well-Architected Tool: formal reviews
- 27.3 How to apply the framework in design decisions
Chapter 28 · Serverless architectures at scale
- 28.1 Event-driven architecture with Lambda + EventBridge
- 28.2 Saga pattern for distributed transactions
- 28.3 Step Functions: orchestration of complex workflows
- 28.4 Lambda@Edge and CloudFront Functions
Chapter 29 · Data platforms on AWS
- 29.1 Data Lake with S3, Glue and Athena
- 29.2 Kinesis Data Streams and Firehose for streaming
- 29.3 Redshift: data warehousing at scale
- 29.4 Lake Formation: data governance
Chapter 30 · Multi-account and landing zones
- 30.1 Why separate workloads into different accounts
- 30.2 AWS Control Tower and Account Factory
- 30.3 Centralized log and security management
- 30.4 Terraform at multi-account scale with shared modules
Chapter 31 · Platform Engineering and Internal Developer Platform
- 31.1 Golden paths and abstractions over Terraform
- 31.2 AWS Service Catalog
- 31.3 Backstage as a developer portal
- 31.4 Terraform modules as internal product
Chapter 32 · Relevant AWS certifications
- 32.1 Cloud Practitioner: is it worth it?
- 32.2 Solutions Architect Associate → Professional
- 32.3 DevOps Engineer Professional
- 32.4 Specialty: Security, Database, Networking
- 32.5 HashiCorp Terraform Associate
Chapter 33 · Projects to consolidate what you've learned
- 33.1 Project 1: serverless blog (S3 + CloudFront + Lambda + DynamoDB)
- 33.2 Project 2: REST API with ECS Fargate + RDS + ALB
- 33.3 Project 3: data platform with Glue + Athena + Redshift
- 33.4 Project 4: multi-account landing zone with Terraform and Control Tower
