Saying no is a sign of commitment.
When you know that what you are doing matters, you want to dedicate to it as much time and energy as possible. And you can only do that if you have developed the capacity to resist alternatives, to refuse help, to reject opportunities.
Saying no is saying you are on the right path.