You can searchedData to IBlockProvider.GetBlock, so, when I will implement SPV, the block provider will only download block that contains pushes with the searchedData.
It exists only one implementation that require the full blockchain on your computer: IndexedBlockStore.