Yes, there is a capability to copy attachments from received emails to case notes.
Further, in-order to help with the email attachments, we have also provided a section on the case form which can show you all the email attachments received from the customer in a summarized list format.