Basically what @tngr said.
A template can render only those data that are available on the concerned controller's $scope object. So, inside your controller you will ideally call the factory and set the http response on the $scope object. That's the best way IMO.