“There is little doubt that the majority of Mr. Mill's supporters in 1865 did not know what his political opinions were, and that they voted for him simply on his reputation as a great thinker.”