It takes decades because policy makers aren't willing to make big steps. And believes like your that it has to take decades are part of the reason why they don't.

As soon as you take away cars, people look for alternatives and the space is claimed by lots of uses. Bus and bicycle use goes up fast.