[Day 173] Terraform, GCP, virtual machines, data pipelines
Hello :) Today is Day 173! A quick summary of today: learned more about terraform and how to set up a GCP VM and connect to it locally used mage for some data engineering pipelines with GCP Last videos from Module 1: terraform variables , GCP set up Turns out there is a bit more of terraform from the data eng zoomcamp, and today I covered it. After learning how to connect to gcp using terraform and create a storage bucket, the first thing today was creating a bigquery dataset Adding the above to main.tf which now looks like: terraform apply, creates a demo_dataset as well Then I learned about variables in terraform Create a variables.tf file and put a variable like: and in main.tf we can directly use the created variables like: Great intro to terraform - being able to define infrastructure code, create resources, and destroy resources. The next part was an instruction on setting up GCP (cloud VM + SSH access) First was creating an ssh key locally And add it to the metadata in GCP'...
