“To have drunkards, idiots, horse-racing, rumselling rowdies, ignorant foreigners, and silly boys fully recognized, while we ourselves are thrust out from all the rights that belong to citizens, it is too grossly insulting to... be longer quietly submitted to.”