Alicia Keys was the musical guest on yesterday’s episode of “The Colbert Report” with Stephen Colbert.  Apparently Jay-Z was not available to assist Keys on “Empire State of Mind Part 2″ so Colbert came through with the assist.