Why can't I leave a fundraiser?

You can, except when you've raised funds for the fundraiser. If you have not raised funds for the fundraiser and still want to leave, then you can click 'My Account' and then click 'Leave' for that fundraiser. Or search under 'Find Fundraiser' and click 'Leave'. You can always rejoin it again later if you want.