Armitage takes hit for Rove