---
title: "Discussion on \"Building a Data Ingestion Solution for Amazon Bedrock Knowledge Bases\" | Hashnode"
description: "Discussion on \"Building a Data Ingestion Solution for Amazon Bedrock Knowledge Bases\". Automate data source ingestion for Amazon Bedrock Knowledge Bases using a scheduled Lambda-based solution, deployable via Terraform."
url: "https://hashnode.com/posts/building-a-data-ingestion-solution-for-amazon-bedrock-knowledge-bases/67b6c63054dacc3962041076"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building a Data Ingestion Solution for Amazon Bedrock Knowledge Bases](https://blog.avangards.io/building-a-data-ingestion-solution-for-amazon-bedrock-knowledge-bases?utm_source=hashnode&utm_medium=feed)

Automate data source ingestion for Amazon Bedrock Knowledge Bases using a scheduled Lambda-based solution, deployable via Terraform.

Feb 20, 2025 · 11 min read · blog.avangards.io  
Updated Mar 4, 2025  
Read the article

-   [#aws](https://hashnode.com/tag/aws)
-   [#generative-ai](https://hashnode.com/tag/generative-ai)
-   [#terraform](https://hashnode.com/tag/terraform)

## Written by

[Anthony Wat](https://hashnode.com/@acwwat)

@acwwat

  
[View profile](https://hashnode.com/@acwwat)

AWS Architect

Anthony Wat is a seasoned cloud and DevOps architect with deep expertise in software development, modernization, and automation. As a Principal Architect at Globalli, he specializes in AWS solutions, AI-driven development, and at-scale operations.

## Responses 1

Markdown supported · ⌘↵ to post

[Sterling Blue](https://hashnode.com/@white217)

[Feb 28, 2025](https://hashnode.com/posts/building-a-data-ingestion-solution-for-amazon-bedrock-knowledge-bases/67b6c63054dacc3962041076/comment/67c1f530617099ed09f82c43)

Thanks for the article - great solution! Appreciate the caution, but holding off ingestion 'during high usage periods' might not always be needed. Scaling can handle real-time updates, so it’s not a one-size-fits-all rule. Any AWS reference backing that recommendation?

[Anthony Wat](https://hashnode.com/@acwwat)

[Mar 2, 2025](https://hashnode.com/posts/building-a-data-ingestion-solution-for-amazon-bedrock-knowledge-bases/67b6c63054dacc3962041076/comment/67c1f530617099ed09f82c43#reply-67c4c11d1991baf42825ab67)

Thanks for your message. You are right that off-hour ingestion is more of a blanket statement, as it really depends on the usage pattern, the type of data, and the complexity of the ingestion pipeline. It's more of an art than a rule, and I've not seen AWS reference that provides substantial guidance yet.

So far I've worked on a few RAG system (not exclusively on AWS) with relatively static data which can afford scheduled ingestion. But I've not had the opportunity to work on one with real-time ingestion requirements just yet.

I know of the Bedrock KB streaming data ingestion feature that was announced in re:Invent 2024, but have not had a chance to experiment with it. Would be interesting to see how this changes things.