According to Microsoft it's not actually a hard limit of 2GB. It's just not "guaranteed" to work for anything larger than 2GB. If it does go kaboom and break then also the chances of you recovering your email also are minimal after 2GB.
I like how they recommend you don't exceed this size since they know of problems with it but don't actually make Outlook TELL you.

- Trevor