A band is not a marriage. There are no oaths of allegiance. If you feel your life will be better served by splitting up the group you've got to do it - but of course it does cause problems.
The illness and the untimely death of my brothers has made me conscious of the fact that - rather than just think about it - it's crucial that you do today what you want to do.