Àwọn òbí rẹ ṣe igbeyawo ni 1855. Ni 1864 awọn ìdílé dispersed nitori ti Charles ká dagba ọti-lile, ati awọn ọmọ won ni igba gbe kọja Edinburgh. Ni 1867, awọn ebi wá papo lẹẹkansi ati ki o gbé ni squalid tenement flats ni 3 Sciennes Place. Doyle ká baba kú ni 1893, ni Crichton, Royal Dumfries, lẹhin ọpọlọpọ ọdun ti psychiatric aisan. Supported nipa ọlọrọ uncles, Doyle ti a rán si England, ni Jesuit igbaradi ile-iwe, St Hodder Place, ni Lancashire.
22 oṣù May ọdún 1859