Matlab/Mathematica Open Source/GPL clones

• FreeMat
• Scilab
• Octave
• RLabPlus
• Maxima
• Axiom
• JMathTools
• Colt
• JMathLib
• JAMA

Another site listing various math software is Alois' Mathematical Software. Also see Simulation tools for Linux systems.