It's the easiest way to use electricity, on and off.
The CPU is basically a large array of transistors - electronic components (like a gate) that can be turned on and off by giving them power or not. You can imagine that a string of 0s and 1s can turn off multiple gates in any order you choose, and it's this massive puzzle of electron flow that eventually creates characters on the screen as I type them. Marvelous!