“The mere fact that Lottie had come and gone away again made things seem a little worse-just as perhaps prisoners feel a little more desolate after visitors come and go, leaving them behind.”