“Our authorities leave us no doubt that the trust lodged with the oligarchy was sometimes abused, but it certainly ought not to be regarded as a mere usurpation or engine of tyranny.”