Yes, you can — just be careful not to damage the infrared LEDs behind it. I usually try to rest my back only against the wood and avoid leaning on the fabric.