How do you go about designing a higher level API?

Frameworks like keras provide a higher level API for tensorflow,cntk,theano which simplifies things. How do we design such APIs and how to go about implementing them?