The cost to remove barn siding depends on how it is attached. Boards attached with panel glue may cause more damage than nails, making the project more expensive.