Last week. Johnny Depp took some time out of his Black Mass Oscar buzz to rock it in Hollywood.

The actor joined his bandmates from Hollywood Vampires on stage at the LA hotspot, Roxy.

The actor hung back onstage with understated control of his instrument, allowing band members Cooper and Perry to have the limelight, while he played in the background.

There were many surprise guests on the night, including Marilyn Manson, who pulled the actor to the front of the stage. Later the rocker lulled Johnny in and kissed his neck, leaving a very noticeable  mark on Johnny for the rest of the concert.

Later, Kesha made an additional cameo, taking the stage in a black coat and top hat, wowing the crowd with her rendition of Whole Lotta Love.

The band bounced around from playing frontman Cooper’s own songs to John Lennon to Black Sabbath to the Doors and more.