This seminar will provide an overview of how one can efficiently solve linear algebra problems using GPGPU (General Purpose Graphics Processing Unit) hardware and the associated CUDA software framework. The basic issues involved in developing efficient code for this type of computation will be discussed, followed by a demonstration of how to use three popular libraries relevant to the problem: cuBLAS, cuSolver and MAGMA.