Plitt was a Lutherville native. He attended Gilman School, where he wrestled and played football and golf. He went on to the U.S. Military Academy at West Point in 2000 and served five years as an Army Ranger. In his final two years of service, he was discovered as a potential model. He appeared on the cover of Muscle and Fitness magazine before beginning a television career.