I disagree if the the ref told the player to stop with the shirt grabbing, etc right before the set piece was taken. At that point, I think that call is fair game.