Joe Rutherford (20 September 1920 – 27 December 1994) was a footballer who played as a goalkeeper in the Football League for Southport and Aston Villa. Born in Fatfield, County Durham, Rutherford played as a youth for Chester-le-Street Schools, Chester-le-Street Juniors, Fatfield Juniors, Chester Moor Temperance, Ferryhill, Blyth Spartans and Chester-le-Street, and had trials at West Ham United and Reading, before joining Birtley Colliery. He joined Southport in October 1936.