Otherwise it should be possible to get a taxi to Gjirokastra or Saranda. In the other direction the bus to Kakavija leaves Tirana at 3.30am. It's also possible to go from Korca to Florin via Kapshtica. It's always a good idea to pick up a tourist visa beforehand at one of these, although I was assured they were also obtainable upon arrival. Instant coffee and hard currency.
Albanian women appreciate western cosmetics.
The reported food shortages in Albania won't affect you, but you could bring tea bags, toilet paper, tampons, paper napkins, soap, razor blades, a diarrhoea remedy, pens, writing paper, envelopes, spare batteries, ample rolls of film and any personal supplies you'll need. As for potential problems, it's sometimes dangerous to go out alone in the towns late at night. Be aware of theft. Take special care if accosted by colourfully dressed women and children begging as they target foreigners and are very aggressive. If you give them money once they'll stick to you like glue whenever they see you again.