Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the celebrated Random Fourier Feature methodology to get an approximation of operatorvalued kernels. We propose a general principle for Operator-valued Random Fourier * ro.brault@telecom-paristech. Feature construction relying on a generalization of Bochner's theorem for translationinvariant operator-valued Mercer kernels. We prove the uniform convergence of the kernel approximation for bounded and unbounded operator random Fourier features using appropriate Bernstein matrix concentration inequality. An experimental proof-of-concept shows the quality of the approximation and the efficiency of the corresponding linear models on example datasets.
REF directly build random Fourier features for vector-valued kernels using an operator-valued version of Bochner's theorem.
Random Fourier Features for Operator-Valued Kernels
ACML, Hamilton, New-Zealand, JMLR Workshop and Conference Proceedings, November 2016, vol. 63, pp. 110-125
Computer Science Mathematics