Your brioche might not be fluffy because the dough needs more time to rise. Fluffiness comes from proper yeast activity and gluten development, so make sure to give it enough time to rest and rise before baking.