Wheeler was pre-deceased by his wife, Janette Hegner Wheeler, who died last October. He is survived by his three children: Letitia Wheeler Ufford of Princeton; James English Wheeler of Ardmore, Pa.; and Alison Wheeler Lahnston of Princeton. He is also survived by eight grandchildren, six step-grandchildren, 16 great-grandchildren and 11 step-great-grandchildren.