Others are already forcing their beliefs on everyone else. The current state of laws isn't natural or god-given, it was constructed by humans. Leaving things as they are is not a neutral stance.