Yes, you can use full-fat coconut milk instead of regular milk in the cake and frosting. However, you may want to use a little less in the frosting to avoid thinning it out too much.