read about ViewHolder pattern and adapt your implementation.
http://www.vogella.com/articles/AndroidListView/article.html