What kind of programs can we install?

I was wondering if we can just install arbitrary linux programs on the empeg? I'd love to be able to run the mersenne prime program and have my empeg calculate primes while I listen to music!

http://www.mersenne.org/freesoft.htm

Sure can. It's up to you to figure out how to compile them for ARM Linux though, unless there are binaries available.