A heretic has violated his faith; an infidel has the wrong faith; a heathen has no faith. In other words, Father Corbelan admires consistency more than creed.