The Whitaker-Clary House is a historic house in New Salem, Massachusetts, United States. It currently houses the museum of the Swift River Historical Society. Built about 1816, it is a fine local example of Federal period architecture, and was listed on the National Register of Historic Places in 1975.