If you're interested in local religious buildings, central Moulins is home to Moulins Cathedral.
You can study the exhibits at Musée Anne de Beaujeu, a museum with a storied past, during your trip to Moulins. Wander the parks and gardens while you're in the area.