It's not so bad. All it means in the D&D context is you're very self-centered. "Good" characters would be exceedingly self-less. "Neutral" is a mix, which is where most people would lie.
That's fine to me. I don't want to be a selfish bastard, but I don't want to be some goody-two shoes either.