As we turned back to the sitting room, grandfather looked at me searchingly.