Angular is a tough cookie for everyone at first. For me it was the same.
It 'forces' you to learn some of the concepts like dependency injection or design patterns (factories, observables etc.) that probably you'll encounter in other libraries or frameworks as well but in a later stage.
Probably that's why is hard. It gets you out of confort zone.