Police say 26-year-old Matthew Colvin swiped the famous rocker's prescription eyeglasses from the Rock 'n Soul Museum in Memphis, Tennessee, on April 21, reported Huffington post.
The white glasses, valued at USD 2,031, were kept in a display case at the museum.
Police lifted a set of prints from the plexiglass case and immediately matched them to Colvin, who was living with his mother in Southaven, Mississippi.
He acknowledged stealing the glasses when police contacted him by phone on Monday, and was arrested the following day.