Rich and famous or rich and unknown?

Rich and unknown. I feel that with fame you get harassed by people. I feel like you would not be able to go out in public without people staring.