“Fame was a mixed blessing for me because I thought I could be as big as I wanted to be, and then I realized that I couldn't because of the racist element in the record business.”