---
title: "Discussion on \"Finding a Needle in a Haystack: How Facebook Serves Millions of Images per Second\" | Hashnode"
description: "Discussion on \"Finding a Needle in a Haystack: How Facebook Serves Millions of Images per Second\". So a couple of weeks ago, I came across a file system called  SeaweedFS which is according to their readme:\n\n... is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) ..."
url: "https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Finding a Needle in a Haystack: How Facebook Serves Millions of Images per Second](https://sayedalesawy.hashnode.dev/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second?utm_source=hashnode&utm_medium=feed)

So a couple of weeks ago, I came across a file system called SeaweedFS which is according to their readme: ... is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) ...

Jun 4, 2021 · 16 min read · sayedalesawy.hashnode.dev  
Updated Jun 26, 2021  
Read the article

-   [#distributed-system](https://hashnode.com/tag/distributed-system)
-   [#system-architecture](https://hashnode.com/tag/system-architecture)
-   [#web-development](https://hashnode.com/tag/web-development)
-   [#cloud](https://hashnode.com/tag/cloud)

## Written by

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

@sayedalesawy · Cairo, Egypt

  
[View profile](https://hashnode.com/@sayedalesawy)

Lead Software Engineer @ Instabug

Lead Software Engineer at Instabug | Backend team. Passionate about large scale server side applications and distributed systems. Cairo University - Faculty of Engineering grad.

## Responses 6

Markdown supported · ⌘↵ to post

[Jeremiah](https://hashnode.com/@JerryJayce)

[Jul 16, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60f1825438f10a30f4e7ad0c)

Well researched and beautifully written article. I benefited a lot...thanks Sayed.

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jul 16, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60f1825438f10a30f4e7ad0c#reply-60f193b2bceb865a350084f2)

Thank you! Glad you like it. You can checkout the follow up article on how facebook managed to cut costs by integrating a new system for cold storage and move Haystack to serve warm storage purposes only. You can find the article in the series.

[Amolo](https://hashnode.com/@amolo)

[Jun 13, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60c631694e04b16f76730e03)

This is really interesting. Made me check out SeaweedFS. Damn. Thanks ! Keep it up

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 13, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60c631694e04b16f76730e03#reply-60c63ebd1679ed6f51a28293)

Thank you, glad you liked it.

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 26, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60c631694e04b16f76730e03#reply-60d75a44cb0aa8118c23b8d6)

[Amolo](https://hashnode.com/@amolo) Just published a follow up article on this topic discussing a paper by facebook on how they added warm storage to their system to cut costs. You can checkout from the article series. Hope you like it!

[Pankaj Tanwar](https://hashnode.com/@pankajtanwar)

[Jun 8, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60bf7177fffc4c13b9cdaf72)

Never thought someone would ever write such a detailed article on SeaweedFS. I found it one the most complex real-world systems designed ever. But you just made it super simple for me to understand. Thanks! 👏👏

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 8, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60bf7177fffc4c13b9cdaf72#reply-60bff9d47c121d4151b3965f)

Glad it was useful, thanks for the kind words!

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 26, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60bf7177fffc4c13b9cdaf72#reply-60d75a09cb0aa8118c23b8cc)

[Pankaj Tanwar](https://hashnode.com/@pankajtanwar) Just published a follow up article on this topic discussing a paper by facebook on how they added warm storage to their system to cut costs. You can checkout from the article series. Hope you like it!

[Pankaj Tanwar](https://hashnode.com/@pankajtanwar)

[Jun 27, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60bf7177fffc4c13b9cdaf72#reply-60d806bfcb0aa8118c23c205)

[Sayed Alesawy](https://hashnode.com/@sayedalesawy) Really interesting. Back to back.

[Ahmed Sadman Muhib](https://hashnode.com/@ahmedsadman)

[Jun 7, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60be54019cd179337419f47b)

Very informative article. Just bookmarked it far a thorough reading. Thanks for sharing.

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 8, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60be54019cd179337419f47b#reply-60bf55149cd17933741a061f)

Thank you!

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 26, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60be54019cd179337419f47b#reply-60d75a3dde92ef110afde177)

[Ahmed Sadman Muhib](https://hashnode.com/@ahmedsadman) Just published a follow up article on this topic discussing a paper by facebook on how they added warm storage to their system to cut costs. You can checkout from the article series. Hope you like it!

[Victoria Lo](https://hashnode.com/@victoria)

[Jun 7, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60be3b41fffc4c13b9cd9ab1)

Just scanned through it and it's awesome! Gonna re-read it over the weekend to not miss a word of this masterpiece of an article! Thanks for sharing! 🤩🤩

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 7, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60be3b41fffc4c13b9cd9ab1#reply-60be5166fffc4c13b9cd9c24)

Oh, thanks for the kind words! Glad you liked it.

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 26, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60be3b41fffc4c13b9cd9ab1#reply-60d75a30de92ef110afde173)

[Victoria Lo](https://hashnode.com/@victoria) Just published a follow up article on this topic discussing a paper by facebook on how they added warm storage to their system to cut costs. You can checkout from the article series. Hope you like it!

[Catalin Pit](https://hashnode.com/@Catalinpit)

[Jun 7, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60bdb82bfffc4c13b9cd893c)

Your articles are in-depth and very informative. How did I miss your blog?

Followed ✅

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 7, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60bdb82bfffc4c13b9cd893c#reply-60bddc1bfffc4c13b9cd8f30)

Glad you like them, thanks for the kind words!

[Sayed Alesawy](https://hashnode.com/@sayedalesawy)

[Jun 26, 2021](https://hashnode.com/posts/finding-a-needle-in-a-haystack-how-facebook-serves-millions-of-images-per-second/60ba65dffffc4c13b9cd4bc9/comment/60bdb82bfffc4c13b9cd893c#reply-60d75a1cde92ef110afde170)

[Catalin Pit](https://hashnode.com/@Catalinpit) Just published a follow up article on this topic discussing a paper by facebook on how they added warm storage to their system to cut costs. You can checkout from the article series. Hope you like it!
