{"post":{"id":"6460f9f5e0999fff87ee53bc","_id":"6460f9f5e0999fff87ee53bc","coverImage":null,"slug":"distributed-google-maps-scraping","readTime":6,"replyCount":1,"responseCount":1,"brief":"Introduction\nIn this post, I will show you how you can utilize the power of Kubernetes to scrape data from Google Maps without using an API key.\nfor the tutorial, I will use as an example deploying to\n\nBut this will work in any managed Kubernetes pro...","subtitle":"How to scrape data from Google maps using Golang and Kubernetes","isFeatured":false,"contributors":[{"_id":"65c3dc7c7f56dfe5806c44cf","name":"Ayub Malayev","photo":"https://cdn.hashnode.com/res/hashnode/image/upload/v1707334780973/ae886965-4557-4462-911e-050994c4d3e5.jpeg","username":"ayubm","__typename":"User"}],"bookmarked":false,"views":1240,"url":"https://blog.gkomninos.com/distributed-google-maps-scraping","totalReactions":1,"title":"Distributed Google Maps scraping","dateAdded":"2023-05-14T15:10:45.148Z","cuid":"clhnjzogs000509msaejugaqs","preferences":{"disableComments":false,"__typename":"PostPreferences"},"__typename":"Post","seo":{"title":null,"description":null,"__typename":"SEO"},"ogMetaData":{"image":null,"__typename":"OpenGraphMetaData"},"author":{"_id":"628f285c43220290a7eec130","name":"Georgios Komninos","photo":"https://cdn.hashnode.com/res/hashnode/image/upload/v1718522685890/dEcoViy36.jpg","isPro":false,"username":"gosom","__typename":"User","tagline":"Sharing 20 years of software engineering experience and Golang expertise"},"coAuthors":[],"series":null,"tags":[{"_id":"5a6b4e41815c95b83a97a082","logo":null,"name":"webscraping ","slug":"webscraping","__typename":"Tag"},{"_id":"6332f59b9daae94e34ac5f83","logo":null,"name":"Google Maps Scraper","slug":"google-maps-scraper","__typename":"Tag"},{"_id":"6332f59b9daae94e34ac5f93","logo":null,"name":"google maps crawler","slug":"google-maps-crawler","__typename":"Tag"},{"_id":"56744721958ef13879b94e1c","logo":null,"name":"golang","slug":"golang","__typename":"Tag"},{"_id":"6460f9f4dd6056c7a6a25713","logo":null,"name":"distributed scraping","slug":"distributed-scraping","__typename":"Tag"}],"publication":{"_id":"628f28a443220290a7eec135","url":"https://blog.gkomninos.com","canonicalURL":"https://blog.gkomninos.com","title":"","displayTitle":null,"isHeadless":false,"favicon":null,"headerColor":"","metaTags":"\n\n\n","isTeam":false,"domainInfo":{"hashnodeSubdomain":"gosom","domain":{"host":"blog.gkomninos.com","ready":true,"__typename":"DomainStatus"},"__typename":"DomainInfo"},"urlPattern":"SIMPLE","__typename":"Publication"},"comments":{"edges":[{"node":{"id":"65c3e1cd3aa17dd1858601f4","author":{"_id":"65c3dc7c7f56dfe5806c44cf","name":"Ayub Malayev","photo":"https://cdn.hashnode.com/res/hashnode/image/upload/v1707334780973/ae886965-4557-4462-911e-050994c4d3e5.jpeg","isPro":false,"username":"ayubm","__typename":"User"},"content":{"html":"

How well does distributing this work? Do you run into request limits / bot checks?

I would like to discuss a project if you could email me at codersfocus at gmail. Thank you.

\n","markdown":"How well does distributing this work? Do you run into request limits / bot checks?\n\nI would like to discuss a project if you could email me at codersfocus at gmail. Thank you.","text":"How well does distributing this work? Do you run into request limits / bot checks?\nI would like to discuss a project if you could email me at codersfocus at gmail. Thank you.\n","__typename":"Content"},"dateAdded":"2024-02-07T20:02:21.280Z","stamp":"clsc7utwf00010al6604v918y","totalReactions":0,"__typename":"Comment","replies":{"edges":[{"node":{"id":"6669d8e80eb8a99b243f873e","author":{"_id":"628f285c43220290a7eec130","name":"Georgios Komninos","photo":"https://cdn.hashnode.com/res/hashnode/image/upload/v1718522685890/dEcoViy36.jpg","isPro":false,"username":"gosom","__typename":"User"},"content":{"html":"

Apologies for the very late reply.

So far I don't run into any limits

\n","markdown":"Apologies for the very late reply. \n\nSo far I don't run into any limits","text":"Apologies for the very late reply. \nSo far I don't run into any limits\n","__typename":"Content"},"dateAdded":"2024-06-12T17:20:40.012Z","stamp":"clxc3k8cs000508mo65ie9exv","totalReactions":0,"__typename":"Reply"},"__typename":"CommentReplyEdge"}],"pageInfo":{"hasNextPage":false,"endCursor":"MQ==","__typename":"PageInfo"},"__typename":"CommentReplyConnection"}},"__typename":"PostCommentEdge"}],"pageInfo":{"hasNextPage":false,"endCursor":"MQ==","__typename":"PageInfo"},"__typename":"PostCommentConnection"},"commenters":{"edges":[{"node":{"_id":"65c3dc7c7f56dfe5806c44cf","name":"Ayub Malayev","photo":"https://cdn.hashnode.com/res/hashnode/image/upload/v1707334780973/ae886965-4557-4462-911e-050994c4d3e5.jpeg","isPro":false,"username":"ayubm","__typename":"User"},"__typename":"PostCommenterEdge"}],"__typename":"PostCommenterConnection"}}}

Distributed Google Maps scraping

2 comments