“The denial of our duty to act in this case is a denial of our right to act; and if we have no right to act, then may we well be termed the white slaves of the North, for like our brethren in bonds, we must seal our lips in silence and despair.”