Also GP themselves do not scale as as far as I know they need to maintain a full copy of the training dataset. Still they might be interesting for small smooth problems.