Although caffeine is mostly blamed for raising your cholesterol levels in contrast with popular beliefs it has nothing to do with LDL levels. Cholesterol levels are increased by terpenes which are found in oily beans. If you don’t want to have coffee with terpenes, you can simply filter it out with the help of cheesecloth.