As confirmed by YouTube, this is not possible. If it appears that subscribers are automatically removed, it just means that either the count is off due to a momentary glitch or the subscriber has accidentally or intentionally unsubscribed.