Fresh chilli peppers can be found in pretty much any grocery store. If you're looking for different kinds you may not be able to find in your local store, you can usually find some unique ones at a local Latin American grocery store.