Rascal Flatts bassist Jay DeMarcus is still reveling in the recent arrival of his first son, Dylan Jay, who was born July 20. Jay is also proud dad to 19-month-old Madeline Leigh, and admits he was anything but calm when he found out his wife, Allison, was about to have their baby while he was in Detroit for a show.

"I immediately went into panic mode," he tells People magazine of the moment he found out his wife had to have a C-section due to concerns over their son's health.

Jay raced to the hospital, arriving at his wife's bedside with minutes to spare before his baby boy entered the world. But while many men may have used the opportunity to take a few days off, Jay, who is currently on the Changed tour with his Flatts mates, hopped a plane to rush back in time to take the stage.

"My wife was still on the operating table so it was very, very hard to leave, but we had a sold-out show and four acts out with us," Jay says of the concert date that also included Edens Edge, Little Big Town, Thompson Square and the Eli Young Band. "I wanted to keep my commitment, and my wife gets that."

The musician used every means possible to make sure he was able to perform that night, even though he only had a few minutes to hold his new son. "I had a police escort when I hit the ground and got there 30 minutes before we went on stage, so I just left my scrubs on. The crowd was very sweet and gave me a standing ovation!"

Jay went on to perform two more shows over the weekend, before returning to his home in Tennessee, where he plans on getting acquainted with the newborn. "I literally got back [Monday] morning and Dylan's been in my arms all day," he notes. "It's made the stressful weekend worth it to come back and hold him. It's finally sinking in that I've got a boy that's going to carry on our family name and I'm so thrilled to have little Dylan in our lives."

The father of two is also making sure his little girl, Madeline, is getting plenty of attention as well. "I picked her up first and brought her over and it was the most amazing thing I ever witnessed," he notes. "Ali was holding Dylan, and Maddy went, 'Baby! Baby! Hi, baby!' and started waving at him. She leaned over and kissed him on the cheek and patted his little hand. It was one of those moments I'll never forget as long as I live."

Jay will have a few days at home before the band heads out this weekend for shows in Missouri and Illinois. Keep track of the Changed tour dates here.

Watch Rascal Flatts' "Banjo" Video