He must have been either inwardly chuckling .
He must have been either inwardly thinking what a daft fool when I said No !
He must have been either inwardly chuckling or thinking what a daft fool when I said No !