"Both kinds" refers, basically, to the conquering and the conquered -- the dominant Holroyd vs. the ruined Don Jose. As Charles Gould prepares for his own campaign of conquest, his grim aside suggests that it would not be in his best interest to "understand" the plight of the conquered.