A matrix is an array of numbers. It usually represents a linear map (in some basis). A tensor is more like that linear map.