Is it allowed to read something loudly in a mosque while some people are praying?

In our office mosque, we usually read from a hadith book at the end of Asr prayers. Sometimes we read loudly while some of people are still praying, this may cause disturbance to the worshippers. What is the ruling here? Is this recitation allowed?