Scrolling up means that you rotate the top of the wheel away from you. As things move away they become smaller, not bigger! I think Firefox has it correct, and the other browsers are wrong...
Similarly differing interpretations of controls occur in first person shooters with (non-)inverted mouselook.
Yes, the scroll wheel itself moves in a horizontal plane, but it triggers a vertical action on the computer screen. Nobody with any experience handling a mouse is thinking about the mouse itself, but only about the effect it will produce on the screen.
The "move towards" / "move away" analogy falls apart because the screen is a vertical plane. "Up" is more intuitive than "away", and "down" is more intuitive than "towards". You may even see an example of this intuition in how people talk about using the scroll wheel: nobody says "scroll towards" or "scroll away". The FF people who came up with the backwards convention must have been looking at a mouse without thinking about its common use cases.
Similarly differing interpretations of controls occur in first person shooters with (non-)inverted mouselook.