Established by a few families in 1969 praying at Johns Hopkins University, the Islamic Society of Baltimore community members completed construction of Masjid Al-Rahmah in 1984.  Shortly thereafter, the vision of establishing an educational institution on the premises came to fruition with the founding of Al-Rahmah School in 1987.

The first major expansion of the School was completed in 1996 when ten classrooms, a gymnasium, computer lab and cafeteria were added to the campus.   Since then ten modular classrooms  and a science lab have also been added to meet the growing needs of our students.