Khadeer Khancloudkhanquest.hashnode.dev·Sep 21, 2024The Data Engineer's Guide to Lakes and Warehouses: Navigating Google Cloud SolutionsAs we navigate the complexities of big data, understanding the nuances between data lakes and data warehouses becomes crucial for designing scalable, efficient, and powerful data solutions. We'll examine how these architectural elements fit into the ...1 likedata-engineering
Sourabh Aswalsourabhaswal.hashnode.dev·Nov 29, 2023Private Cloud Sql Connection / Cloud Nat / Private Compute Engine / Mysql Workbench / Cloud Run / VPCPRIVATE CLOUD SQL Create sql database with private ip and default vpc and network (10.111.112.0/20) PRIVATE COMPUTE ENGINE 1 :- Create a virtual machine with private ip 2 :- Create a service account with cloud-sql-client-proxy permission SSH 1:-Dow...66 readsCloud
HARISH GAGGARharishgaggar.hashnode.dev·Oct 1, 2023Google Cloud SQL Database using TerraformCloud SQL is a fully managed database service that makes it easy to set up, maintain, manage, and administer your relational databases on Google Cloud. Terraform is an Infrastructure as Code (IaC) tool that allows you to define and manage your infras...26 readsTerraform
Derrick Qinderrickqin.com·Sep 22, 2023CloudSQL Query Insight - Query details truncated to 1024 charactersQuery insights is a useful feature to help Cloud SQL users to detect, diagnose, and prevent query performance problems for Cloud SQL databases. One client had an issue using it because their query was too long and it was truncated on Query details pa...160 readsgoogle cloud
Piotrekkrpiotrekkr.hashnode.dev·Sep 17, 2023Fixing "Connection to Cloud SQL instance at IP:3307 failed: timed out after 10s"This was a rather interesting problem to fix. I'm running a PHP app as Google Cloud Run Service. This app is connected to the Cloud SQL instance using a Cloud SQL connection like this: resource "google_cloud_run_service" "pricing" { provider ...#cloudrun
Ishaanishaanveerdadhwal.hashnode.dev·Sep 16, 2023Google Cloud databasesA cloud database is a database service that is built and deployed on cloud infrastructure. Easily via the Internet. Cloud databases serve the same function as any other modern relational, non-relational, or in-memory database. But with the added flex...Google Cloud Platorm - Servicescloud database
Richard Leedlackty.com·Jul 27, 2023如何在 AWS ECS 上連線 GCP CloudSQL近期遇到一個業務需求，需要在 AWS ECS 上透過 BI 工具 Metabase 連線到 GCP 上一個 CloudSQL 的資料庫。 CloudSQL 遠端連線做法 CloudSQL 官方推薦兩種方式做遠端連線： 透過 IP 白名單的方式，將會連線進來的 IP 做設定 透過 CloudSQL Proxy 來做連線 由於在我本次的環境當中主機的 IP 並不固定，所以使用後者的作法。然而多數 CloudSQL Proxy 的教學，包含官方都是使用 Kubernetes（應該一點都不意外？...AWS
Derrick Qinderrickqin.com·Jul 1, 2023Export data from Cloud SQL to GCS using BigQuery Federated Query and Scheduled QueryRecently, I worked with a client who wanted to export data from Cloud SQL to GCS daily. They tried Cloud SQL Serverless Export orchestrated by Cloud Composer but found it is pretty expensive for their use case. For the context, with Serverless Export...60 readsbigquery
Emmanuel Odenyire Anyiraodenyire.hashnode.dev·Jun 3, 2023Securing Cloud SQL for PostgreSQL: CMEK, pgAudit, and IAM Database AuthenticationIntroduction: Securing your Cloud SQL for PostgreSQL instance is crucial to protect sensitive data and ensure compliance with security requirements. In this blog, we will walk through the steps to secure a Cloud SQL for PostgreSQL instance by enablin...cloud sql
Gilson Filhoblog.gilsondev.in·Sep 23, 2022Cruzando dados entre Cloud SQL e BigQuery com as Queries FederadasNo Google Cloud Platform possuem várias formas de armazenar dados, mas pode ter situações em que é preciso pegar dados de uma base relacional e cruzar com o que está salvo no BQ para suas análises nos dados. Uma forma de fazer é o uso de Queries Fede...110 readsbigquery
