Yes there were four different congregations. For example the Shafi'is were allowed to pray their salatul asr earlier than the Hanafis. The Wahabis today don't care about this. They don't care about the Hanafis. Why do you think that they pray their salatul asr according to the Shafi'i times? Our innocent Hanafi brothers and sisters unknowingly pray their salatul asr at this time too! Where is the respect and unity now?