Dowdle is originally from Atlanta and attended the University of Georgia where, in his freshman year, he played forward for the basketball team. He then transferred to Georgia State, where he was a pitcher for the baseball team in his junior and senior years, before graduating in 1972. While at Georgia State, Dowdle also worked part time with the Atlanta Braves ground crew.