Billy Kemp formed the Paradise Pickers in his hometown, Baltimore, who released a record in 1980. He later moved to Nashville, where he played the Grand Ole Opry with Jeanne Pruett and toured with Terri Gibbs, Tommy Overstreet and Bandana. He returned to Maryland in 1988, where he released a second album with the reformed Paradise Pickers. He soon started touring and playing lead guitar with renegade rock-n-roller Tommy Conwell and the Young Rumblers. In addition, he composed music for Maryland Public Television and produced records for regional artists in the Baltimore/DC area, eventually owning a recording studio in rural Maryland. He recorded two CDs on his own label, Willbilly Records, and formed an ensemble, the Willbilly. Kemp's high school classmates called him Willbilly, due to his love of country, folk and blues music.

From 2006-2016 Kemp wrote, recorded and performed with the critically acclaimed Appalachian Folk duo, Jeni & Billy. He released a solo album in 2017, and a collection of released and unreleased songs in 2018. His concerts include songs from his latest releases, as well as selections from a rich and extensive back-catalogue. From Lone Star country to urban shuffles and Appalachian waltzes, Billy remains a songwriter with a love of story.