Linear algebra, compared to other math classes, is generally seen as being one of the easier college math courses. The difficulty will depend on your prior knowledge in maths, the professor, and college. If you have taken and done well in math classes such as single and multivariable calc, discrete maths, or an intro to proofs, then, linear algebra shouldn't be a problem. Of course, the professor and caliber of the college will also dictate the pace and difficulty of the assessment tasks or exams. The faster the pace, the more material you need to learn in a shorter time while exams that are more proof-based will be more difficult.