Yes, probably acoustics imposing its influence. I had a similar effect in my system though I believe, judging from your description, not to the same extent, as I am running a 2.1 setup.
I repeated the test on my main system, this time moving further back to improve the speaker spacing geometry...