Yakuo-ji Temple originally belonged to the Shingon sect as was called Baireizan-Yakoji Temple.
The Priest Nichizo, a second-generation disciple of Nichiren, denounced the head priest and converted the temple to the Nichiren sect of Buddhism, changing its name to Yakuo-ji Temple.
The temple grounds feature a memorial tower for Suruga Dainagon Tadanaga, the younger brother of the Third Tokugawa Shogun Iemitsu, and the graves of the wife and daughter of Gamo Tadatomo, the grandson of Tokugawa Ieyasu and head of Matsuyama castle.
Due to the close relationship between the Tokugawa and Gamo clans, the temple was ranked high, employing the hollyhock seal of the Tokugawa clan as its temple seal.
In the early part of the Meiji period(A.D.19th), the temple fell into disrepair due to its conversion from Buddhism to Shinto.
However, Nisshin and Nissho worked to rebuild it and arrange it into its current shape.
There is a seated figure of Priest Nichiren at the main hall, which was built by the shogunate under orders from Ienari, the eleventh shogun.
This figure is unique because its mouth is open in the form of preaching.