I don't know the equation(s) off hand or how to work with lat and long for distances, but I'd imagine you have a center point of the circle in lat/long. Calculate the radius of the circle, then find points where the distance to the center point is less than that radius. I think most DB's with geo support have something in place for distance based queries. (At least I would hope so...)