Photography is a craft. Anyone can learn a craft with normal intelligence and application. To take it beyond the craft is something else. That's when magic comes in. And I don't know that there's any explanation for that.
On the Question: "What marks the difference between a competent photographer and a really great photographer?"
Interview with Erwitt at: http://www.milkphoto.com/elliott_converse.shtm