Poll points to swing away from government