Muslim had a distinguished ancestry: his grandfather Aslam served as governor of Khurasan in 671–675, and his father Sa'id was a partisan of the powerful governor of Iraq, al-Hajjaj ibn Yusuf, who rewarded his loyalty by appointing him as governor of Makran.