And now that he's acting in a dual capacity after being promoted to offensive coordinator with Cam Cameron being fired, Caldwell plans to remain upstairs.
"That's my plan, but obviously that could change," Caldwell said Thursday at team headquarters in his first formal news conference since the coaching shakeup Monday. "Whatever John [Harbaugh] wants me to do."
"Jim is a very, very good coach," Caldwell said. "He's been around and has experience. Obviously, he'll be involved as well in terms of tips and things of that nature. I think he realizes I've been around football a little while. So I do have a good sense of some things, but other things I'm going to lean on him heavily for."
Players indicated that they expect Caldwell to push a faster tempo that includes more no-huddle looks. However, major changes aren't expected this late in the season with the offensive system.
"One of the good things about our system is that it's versatile," Caldwell said. "We can do whatever it takes. It just depends on who we're playing, how we want to attack them, what we think best suits our personnel. We kind of bounce in and out of it; every game takes on its own personality. ..
"Obviously there's not going to be a system change of any sort. I'll add a few wrinkles here and there. For the most part I think the guys are comfortable with what we do. I've got to find what best suits our personnel and utilize that. Do the things that we do best."
Caldwell kept it to the point when asked about his offensive philosophy, saying: "Score as many points as you can as often as you can."
This amounts to a three-game audition -- as well as the postseason, if Baltimore qualifies -- for Caldwell to cement his status going forward as offensive coordinator.
Caldwell said he's not thinking that far ahead.
"I don't look any further than the next day," said the former Indianapolis Colts coach. "Nothing's promised to you. In the Bible it tells you that. What I do is do my job. We'll worry about the other things down the road."
After being a head coach in Indianapolis and reaching one Super Bowl and winning another as a quarterbacks coach with Peyton Manning under center, Caldwell said he hasn't lost his ambition in running a team again.
"I think if you're in this business, that should always be your goal," he said. "Right? I don't think I'll ever lose that particular desire until the point in time when they run me out of this business."