I don't know much about this, but I believe the genetic evidence says that we did interbreed with the Neanderthals. And yes, as far as I remember, we didn't kill them off, but simply out-competed them.