When Brett Gardner was worried about the Yankees