You might want to get your camera out and head to Hurst Castle— just one of the landmarks located 2.1 mi (3.4 km) from central Milford on Sea.
Why not spend a lazy afternoon at Alum Bay Beach during your trip to Totland Bay? While you're in the area, wander around the parks.