Yes, absolutely. Without the heat sink, there is a high chance of your processor overheating than the usual limits, which can affect performance and in the long term even damage the processor altogether hence rendering your computer useless.
Every computer, no matter how small or how powerful, produces heat that needs to be removed from the components or else they may be damaged. The heat sink does exactly this and is therefore very necessary unless there is a liquid cooling system installed in your PC.