You can find out about the history of Machu Picchu with a trip to Royal Tomb. While you're in the area, stroll along the riverfront.
If you're interested in local religious buildings, central Machu Picchu is home to Temple of the Condor. Why not take a stroll along the riverfront and watch the sunset while you're here?