Little Big Town's Karen Fairchild and Jimi Westbrook welcomed baby Elijah Dylan into the world on March 5. And while the new parents have enjoyed time at home with their son, they are now trying to figure out how to hit the road next month with their latest addition in tow.

"We're just trying to get in the groove of being parents," Jimi tells PEOPLE. "The real challenge when we're on the road is when we're both on stage. We'll have to bring a nanny out to help us, but I'm sure as soon as we're off stage, we'll be like, 'Where's the baby?'"

The baby, whose name was derived from their favorite Bible story combined with the character of Matt Dillon from TV's 'Gunsmoke,' creates a lot of work for his devoted parents, especially when it comes to changing his diaper! "Elijah hates it, so one does the distraction and the one does the work," Jimi says. "I'm usually the one jumping around trying to distract him. There's a lot of teamwork with us."

Still, Jimi says it's hard to remember what life was like before Elijah entered their world. "It's just a beautiful, beautiful experience, the whole thing, the pregnancy and him being here," he gushes. "Your life changes -- it's all about him and that's OK."

The new parents will join band members Kimberly Roads Schlapman and Philip Sweet when LBT joins the Country Throwdown tour, along with Jamey Johnson, Montgomery Gentry, Jack Ingram, Heidi Newfield and several others. Click here for tour dates.

Download Little Big Town Songs

More From TheBoot