lessons learned from production installation