The seminary is run by Maulana Abdul Aziz, the imam of the Lal Masjid that was once the target of a military operation during Pervez Musharraf's regime.
"He (Osama) might be a terrorist for others but we do not consider him as a terrorist. For us he was a hero of Islam. He is a martyr," Aziz was quoted as saying by Geo TV.
The name plate outside the library read 'Maktbah Usama bin Ladon Sheeed'.
The cleric's brother Rasheed was killed during the Lal Masjid operation in 2007.
The operation had ended in a bloody eight-day siege killing at least 58 Pakistani troops and seminary students.