The things you get from having xp aren't really useful things for a lurker. Having a profile title and banner image will just draw more attention to the lurker. I wouldn't think it's an issue.