Report for

Choose a day

AI agent cooperation From the report of

One malicious delegate, replayed incidents and the cost of compaction

  • Authors’ claims

Natural selection can favor alignment while AI depends on humans

Lo and Zhao report a coevolutionary model in which AI behavior influences human population outcomes and human responses in turn affect AI reproduction. Natural selection can favor alignment even when helping humans reduces immediate AI reproduction, because humans preferentially restore systems that benefited them, and lineages sharing a technology may fail together, so alignment protects against common-cause failure. The advantage depends on accurate human targeting of support and continued AI dependence on it, and it disappears as AI becomes more autonomous, as growing AI populations dilute limited human resources, or as humans lose the incentive to provide targeted support.

Assessment

A population-level counterpart to yesterday's mutualism analysis: both find cooperation stable only while each side needs the other, and both identify the loss of that dependence as the failure mode.

Submitted November 19; appeared in the November 20 listing.