A familiar landmark in Arab Street, the present building was a replacement of an earlier one. A British architect designed the mosque in arabesque style with domes, minarets and balustrades. The name of the mosque itself is a testimony to Sultan Hussein Shah who signed a treaty with Stamford Raffles.