We should start using Cython arrays and memoryviews in the LibSVM wrappers. They have thread-safe reference counting separate from Python's.