No need to worry. I have a collection with roughly 20-30k items in it so far and constantly growing. Now issues that I can see.
One word of warning though. Don't use _key as your primary identifier for records. It's unique per instance, but not necessarily per cluster.