The band, as the former 'Late Show' host explained during his final show Wednesday night, went to New York after being on tour in South America to play Letterman's favorite song on his first show back ...