No, not all decomposition reactions are endothermic. A decomposition reaction can be both endothermic and exothermic. However, the latter is more common than the former.