Labour hit out at Council office move