Your objection is very deep and your opinion is held by a great many people including a good number of Christians. But that is not consistent with Genesis, in my opinion. The doctrine is called "epiphenominalism", and there's some evidence for it. Still, God's word seems to deny it. I think an argument could be made that a human soul is partly an epiphenomenon of the body, but I wouldn't go that far myself.
Accordingly, epiphenomenalism in the philosophy of mind holds that our actions have purely physical causes (neurophysiological changes in the brain, say), while our intention, desire or volition to act does not cause our actions but is itself caused by the physical causes of our actions. To assume that regular successions of mental and physical events—volitions followed by appropriate behavior, fear followed by an increased heart rate, pains followed by wincings etc.—reflect causal processes is to commit the fallacy of post hoc, propter hoc: "The soul stands related to the body as the bell of a clock to the works, and consciousness answers to the sound which the bell gives out when it is struck" (Huxley 1874, 242).
http://www.iep.utm.edu/epipheno/
Vero Man is an anatomically modern human, essentially us. H. erectus, even archaic H. sapiens were notably different.