Are you sure the complexity is linear? One iteration of training is, but I presume the number of required iterations is problem-dependent... maybe "sub-quadratic" to be on the safe side?

Of course the space complexity of NNs can be controlled, while SVMs can grow linearly in the number of samples.