---
title: "Comment by OnlineProxy on \"How to Build a B2B Contact List from Company Websites Responsibly\" | Hashnode"
description: "i read through the code without running it and the main flow works. but a few parts are not quite good. if robots.txt can't be reached because of a DNS error, a"
url: "https://hashnode.com/posts/how-to-build-a-b2b-contact-list-from-company-websites-responsibly/6ad3339e7b0d9a1e1b7566ee/comment/6ad4ec2c6ce00dfc4fbfaf3b"
---

[Discussion](https://hashnode.com/posts/how-to-build-a-b2b-contact-list-from-company-websites-responsibly/6ad3339e7b0d9a1e1b7566ee)

Comment [How to Build a B2B Contact List from Company Websites Responsibly](https://hashnode.com/posts/how-to-build-a-b2b-contact-list-from-company-websites-responsibly/6ad3339e7b0d9a1e1b7566ee)

[OnlineProxy](https://hashnode.com/@onlineproxyio)

[Oct 18](https://hashnode.com/posts/how-to-build-a-b2b-contact-list-from-company-websites-responsibly/6ad3339e7b0d9a1e1b7566ee/comment/6ad4ec2c6ce00dfc4fbfaf3b)

i read through the code without running it and the main flow works. but a few parts are not quite good. if robots.txt can't be reached because of a DNS error, a refused connection or a timeout, the script crashes and the whole batch stops. phones are read from text lines rather than tel links, so the code and sections 3 and 4 don't quite match, and the label check can pick up a label from a neighbouring block. honouring the declared charset would help with japanese and older taiwanese sites where full width digits break under UTF-8. storing the base number and extension as separate fields would also fix the duplicate switchboard in the demo output
