直到1983年3月，市政局見區內對圖書館要求殷切，加上牛池灣同新蒲崗嘅圖書館唔能夠短期內啟用，所以重新考慮喺黃大仙區開間小型圖書館。同年5月，房屋署建議局方喺黃大仙下邨30座56-62號同埋73-77號地下設立圖書館。但老人中心直到10月仍租用上址，結果局方要求房屋署另覓選址。
It was not until March 1983 that the Urban Council reconsidered opening a small library in Wong Tai Sin District in view of the strong demand for libraries in the district and the fact that the libraries in Ngau Chi Wan and San Po Kong could not be opened in the short term. In May of the same year, the Housing Department proposed that a library be set up at G/F, Nos. 56-62 and 73-77, Block 30, Lower Wong Tai Sin Estate. However, the elderly centre continued to rent the premises until October, and as a result, the Bureau requested the Housing Department to find another site.