The common causes of bile duct enlargement are: Gallstones: Small gallstones dislodges from the gallbladder, travel all the way in the bile duct and get impacted in the ampula of vater, it is the narrowest site of the bile duct where gallstones can get impacted.