James Lillywhite (23 February 1842 – 25 October 1929) was an English Test cricketer and an umpire. He was the first ever captain of the English cricket team in a Test match, captaining two Tests against Australia in 1876–77, losing the first, but winning the second.