Spencer began his collegiate career as an All-American in 2006 at Modesto Commnuity College. In 2008, he transferred to Inidana State University, where he pitched in 16 games, startin 13 of them. Spencer had his most successful season in 2009, playing for William Penn University (IA). He went 11-0 with a 2.45 ERA, appearing in 16 games, starting 14 and completing nine of them. In 102.2 innings, he struck out 89 and walked only 25. He was named the Midwest Collegiate Conference (MCC) Pitcher of the Year and was a First-Team NAIA All-America selection.