I'm a big advocate of doing what's best for you regardless of opposition. If people get upset because you will no longer let them use you, that's their problem and not yours. You're confirming that you made the right decision to finally put yourself first for a change.
