Ornamental pepper plants like to be really warm (above 75°F). It sounds like your home is just too chilly to grow an ornamental pepper plant.