Yes, you totally can. Use a firm but small pillow and fold it up or place it in the natural curve of your spine. People also use a rolled-up towel because the circular shape is ideal for the shape of your lumbar region. A DIY lumbar support pillow is better than nothing, but consider investing in a pillow designed for lumbar support.