A North Side graduate, Nelson had a stellar career at Michigan, ranking fifth in school history with 84 career receptions. In fact, Nelson led Michigan in receptions and receiving yards in 1983 and 1984. In 1983 he had 41 receptions for 494 yards and three touchdowns from quarterback Steve Smith, and in 1984 he had 40 catches for 459 yards and three scores thrown by Jim Harbaugh. He finished his career with 84 receptions for 976 yards and six touchdowns. Michigan finished 9-3 in 1983, losing to Auburn in the Sugar Bowl, and 6-6 in 1984, losing to BYU in the Holiday Bowl.