After his return in 1783 the king commanded him to Guldberg's option to attend an edition of the New Testament basic text which was printed at royal expense, it was one of Goldberg's last acts as Prime Minister.
Efter hans hjemkomsten i 1783 befalede kongen ham, på Guldbergs indstilling, at besørge en udgave af det nye testamentes grundtekst, som skulle trykkes på kongelig bekostning; det var en af Guldbergs sidste handlinger som minister.