Yes it could be the issue. I am seeing more and more sites being penalized for slowness in Google now.