It solely depends upon the type of flooring that you need to opt for. Some floating flooring types including vinyl tiles and laminates require an underlayment for it to stand strong. So, you might not need to remove the underlying flooring. You need to remove any existing flooring before laying ceramic tiles, marbles, and other stone floorings.