“It is but too common, of late, to condemn the acts of our predecessors and to pronounce them unjust, unwise, or unpatriotic from not adverting to the circumstances under which they acted. Thus, to judge is to do great injustice to the wise and patriotic men who preceded us.”