James Harrison "Babe" McCarthy (October 1, 1923 – March 17, 1975), was an American professional and collegiate basketball coach. McCarthy was originally from Baldwyn, Mississippi. McCarthy may best be remembered for Mississippi State's appearance in the 1963 NCAA Men's Division I Basketball Tournament when his all-white team sneaked out of town in order to face Loyola University Chicago, which had four black starters. In March 1975, McCarthy died as a result of colon cancer.