Thank you engineer_comp_geek, you hit the nail on the head.
In terms of raw processing power, modern computers come close to the human brain, and will probably surpass it in a few years. The difference is that neural networks are millions of simple processors operating in parallel, and CPUs are one amazingly-complex processor operating in series with itself. We could, in another 10 years or so, fabricate a processor comprised of billions of tiny neuron-like processors which would be capable of mimicking the human brain structurally. The hard part is writing the software that would take it from a hunk of silicon to a thinking entity.
Modern CPUs are complex, but their operation can be broken down into a logical series of deterministic, mathematical operations which are used to build more complex functions and from them, fantastic programs. This is why we can program them so easily, we know exactly what’s happening at every point along the way. In neural networks, we pretty much know how individual neurons act, but the complexity of the system is not based on how one super CPU-neuron acts trillions of times each second, but on how a billion simple neurons interact with each other thousands of times a second. The ghost is in the signal, not the machine.
Imagine an electrical impulse, branching out like lightning across thousands of dendrites, converging on some axons which then fire and spark new dendrite lightning pulses, all in this ever-changing electric feedback system. It’s like holding a microphone in front of a speaker, only with millions of mics and speakers arranged all around the room with wires going every which way. It’s like that episode of Mr. Wizard when Don Herbert himself laid out a matrix of mousetraps with ping-pong balls resting on their springs. He dropped one ball into the glass container confining them and instantly the whole system was a chaos of popping balls triggering other balls to pop. Your brain is the same only your neurons reset after each firing, ready to fire again. You can imagine how this could go on forever (consciousness?) and how hard it would be to organize that mess into anything useful.
The problem isn’t figuring out how to fabricate these systems, it in learning how to program them once we make them. This sort of thing requires a new paradigm of software development, one which might take us 20 or 30 years to figure out. Remember that evolution has put just as much time into our brain’s wiring as it has into its composition. To mimic a human brain we first have to know how it works, exactly, and I mean down to each individual wiring, because our brains look like the power lines running under NYC. And if we get one of them wrong the whole thing might short out.
Nature didn’t design us like we design computers, with math equations scribbled on a chalk board and an industrial fabrication plant. It built a matrix of neurons and let evolution do its slow work over hundreds of millions of years of trying and training.