Yes, you can! Heat some olive oil on a non-stick skillet over medium heat and place the chicken without lemon slices (work in batches if needed to not overcrowd the skillet) skin down. Cook until the skin is golden and crispy. Then, flip the chicken and cook until cooked through.