Question: botw are gems only for selling?
Answer: They're not really rare, except for diamonds. They don't have many uses either, so go ahead and sell most of them. Really, they are so common later on that the thought of Nintendo calling a single ruby "useful item" with regard to the DLC gives you aggressions.