Technical solutions are described method for analyzing a natural language conversation-
generating machine. An example computer implemented method includes determining, from
a plurality of adjacency pairs in a conversation, a number of base pairs. The computer
implemented method also includes determining, from the plurality of adjacency pairs, a
number of expansion pairs. The computer implemented method also includes computing a
efficiency score for the conversation by computing a ratio of the number of base pairs and …

Technical solutions are described for analyzing a natural language conversation-generating
machine. The computer implemented method includes identifying, from a conversation log, a
plurality of adjacency pairs. The method further includes determining, from the adjacency
pairs, a number of adjacency pairs with outcome success indicators. The method further
includes determining, from the adjacency pairs, a number of adjacency pairs with outcome
failure indicators. The method further includes computing a mutual understanding score for …