Jama is a simple, lightweight and straightforward matrix library for java. It has two simple matrix classes (Matrix and FloatMatrix) and some common algebraic operations and algorithms to deal with matrices.
The current version brings a build in GPU support, which is in in an experimental stage right now.