“We ought not to forget that the government, through all its departments, judicial as well as others, is administered by delegated and responsible agents; and that the power which really controls, ultimately, all the movements, is not in the agents, but those who elect or appoint them.”