Solved by @heyevwebody@lemmy.world, the song is “I Don’t Want To Set The World On Fire” which is probably best known for the 1941 version by The Ink Spots that is used in Fallout games.

Thanks for playing!