If you're interested in local religious buildings head to Avignon City Centre— home to Avignon Cathedral. You could also start your cultural experience by heading over to the museums in the area.
Avignon City Centre is home to Palais des Papes, so why not stop by during your stay in Avignon.