The center of Port Jefferson is home to cultural attractions like Mather House Museum, so you might want to stop by during your stay. If you want to experience more of the culture Port Jefferson has to offer, head to Port Jefferson, Stony Brook University Hospital, and Stony Brook University.