Prevent endless recursion from external pillars

As per conversation with @thatch45.