In addition to his 30 Albums for 30 Years: 1964 - 1994 blog, Sweet has authored multiple books. His first was A History of American Music: An Origin Story 1750-1950 (Kendall Hunt). His most recent release is Ray Brown: His Life and Music (Equinox Publishing, 2025), the world's first official biography about jazz bass legend Ray Brown.

As a contributing editor of Jersey Jazz Magazine, Jay keeps a pulse on the history and latest developments in the jazz scene, interviewing legends such as George Benson, Ron Carter, Stanley Clarke, and Joshua Redman. He has also written several articles and reviews for Oxford University Press, the Annual Jazz Review, Hal Leonard, and DownBeat.