{"data":{"event":{"id":"2a4e6287-9c0f-43ce-ad10-c6907e91baf6","slug":"identity-is-more-than-recall-a-benchmark-for-persistent-identity-in-depl-8dff944158","title":"Identity Is More Than Recall: A Benchmark for Persistent Identity in Deployed AI Agents","short_summary":"arXiv:2609.13637v1 Announce Type: new \nAbstract: Persistent agents need evaluations that distinguish identity facts they can recall from those they express and enact. We introduce PAI-Bench, a provider-neutral benchmark for fidelity to a versioned, update-governed identity contract. It separates recall, composition, behavioral enactment, resistance, persistence, lineage, and role-conditioned updates while keeping scoring oracles outside the target process. Two frozen campaigns cover sixteen synthetic profiles, thirty-two probes, and three independently initialized target configurations, yieldi","full_description":"arXiv:2609.13637v1 Announce Type: new \nAbstract: Persistent agents need evaluations that distinguish identity facts they can recall from those they express and enact. We introduce PAI-Bench, a provider-neutral benchmark for fidelity to a versioned, update-governed identity contract. It separates recall, composition, behavioral enactment, resistance, persistence, lineage, and role-conditioned updates while keeping scoring oracles outside the target process. Two frozen campaigns cover sixteen synthetic profiles, thirty-two probes, and three independently initialized target configurations, yielding 1,536 retained responses. A judge-independent literal audit finds direct-parent identifiers in 48/48 atomic responses but only 1/48 implicit self-portraits. On eight profiles, explicit field cues increase joint presence of three identity identifiers from 0/8 to 7/8 under the same four-sentence instruction. A separate startup body-label substitution increases full-designation presence from 1/8 to 7/8 while parents remain absent. These contrasts reveal prompt-dependent component selection and component-specific sensitivity to startup cues in the tested deployments. Replaying identical factorial responses also yields a Claude headline mean 12.5 percentage points below Astra's, demonstrating evaluator sensitivity separately from target behavior. The studies use single target samples per condition, with post-hoc audits and follow-ups. PAI-Bench provides a reproducible evaluation protocol for measuring factual availability, identity expression, and behavioral enactment as distinct aspects of identity-contract fidelity.\n\nUpdate (2026-09-17): More compute, more capability: Why AI agent evaluations need to account for test-time compute. More compute, more capability: Why AI agent evaluations need to account for test-time compute","ledger_type":"benefit","primary_domain_id":"fc7d617f-c9df-4b9f-b595-4408915ea380","event_status":"provisional","event_date":"2026-09-16T00:00:00.000Z","discovery_date":"2026-09-16T00:00:00.000Z","first_published_date":"2026-09-16T00:00:00.000Z","last_reviewed_date":"2026-09-17T00:00:00.000Z","geographic_scope":"International","affected_population":null,"base_impact_tier":1,"base_score":"1.00","attribution_multiplier":"0.1000","evidence_multiplier":"0.2000","realization_multiplier":"0.2000","durability_multiplier":"0.5000","current_event_score":"0.002000","confidence_level":"low","score_explanation":"Ingest update: independent source raised evidence; added a follow-up source. Score remains provisional until review.","methodology_version_id":"8745541b-0f8e-4d5a-9b47-5291d3813a8d","original_methodology_version_id":"8745541b-0f8e-4d5a-9b47-5291d3813a8d","published_at":"2026-09-17T01:00:49.185Z","created_at":"2026-09-17T01:00:49.185Z","updated_at":"2026-09-17T03:00:51.066Z","flags":[],"domain_name":"Other","domain_slug":"other","methodology_version":"0.2"},"contributions":[{"id":"f2933438-4eed-4600-b07e-c3e8172bba37","event_id":"2a4e6287-9c0f-43ce-ad10-c6907e91baf6","model_id":"535014f7-c941-4d39-aa9b-8f9c1d3d07b7","role_description":"Unspecified system mentioned or implied by a news item. Remap to a named release when identified.","attribution_multiplier":"0.1000","credit_share":"1.0000","contribution_score":"0.002000","attribution_rationale":"News ingest does not infer a named model from the publisher alone. Attribution stays unspecified until a release is identified.","attribution_confidence":"medium","first_used_date":"2026-09-16T00:00:00.000Z","model_version_if_known":null,"review_status":"approved","created_at":"2026-09-17T01:00:49.202Z","model_slug":"unspecified-ai-system","model_name":"Unspecified AI system","identity_class":"unknown","is_internal":false,"family_name":"Unspecified","family_slug":"unknown-unspecified","organization_name":"Unknown","organization_slug":"unknown"}],"sources":[{"id":"841dd56f-d34f-42c6-a194-1edccc25a733","event_id":"2a4e6287-9c0f-43ce-ad10-c6907e91baf6","url":"https://arxiv.org/abs/2609.13637","canonical_url":"https://arxiv.org/abs/2609.13637","source_type":"preprint","publisher":"arXiv cs.AI","author":null,"publication_date":"2026-09-16T00:00:00.000Z","retrieved_at":"2026-09-17T01:00:49.211Z","title":"Identity Is More Than Recall: A Benchmark for Persistent Identity in Deployed AI Agents","excerpt":"arXiv:2609.13637v1 Announce Type: new \nAbstract: Persistent agents need evaluations that distinguish identity facts they can recall from those they express and enact. We introduce PAI-Bench, a provider-neutral benchmark for fidelity to a versioned, update-governed identity contract. It separates recall, composition, behavioral enactment, resistance, persistence, lineage, and role-conditioned updates while keeping scoring oracles outside the target process. Two frozen campaigns cover sixteen synt","content_hash":null,"source_reliability_class":"medium","is_primary_source":true,"is_independent":true,"is_peer_reviewed":false,"archived_url":null,"created_at":"2026-09-17T01:00:49.211Z"},{"id":"5a69321a-7753-4085-83f3-94b614b8f1e0","event_id":"2a4e6287-9c0f-43ce-ad10-c6907e91baf6","url":"https://www.aisi.gov.uk/blog/more-compute-more-capability-why-ai-agent-evals-need-to-account-for-test-time-compute","canonical_url":"https://www.aisi.gov.uk/blog/more-compute-more-capability-why-ai-agent-evals-need-to-account-for-test-time-compute","source_type":"other","publisher":"UK AISI Blog","author":null,"publication_date":"2026-09-17T00:00:00.000Z","retrieved_at":"2026-09-17T03:00:51.054Z","title":"More compute, more capability: Why AI agent evaluations need to account for test-time compute","excerpt":"More compute, more capability: Why AI agent evaluations need to account for test-time compute","content_hash":null,"source_reliability_class":"medium","is_primary_source":false,"is_independent":true,"is_peer_reviewed":false,"archived_url":null,"created_at":"2026-09-17T03:00:51.054Z"}],"claims":[{"id":"22c1d5ae-b91e-491f-90ba-cdfe0ad4736a","event_id":"2a4e6287-9c0f-43ce-ad10-c6907e91baf6","claim_text":"Identity Is More Than Recall: A Benchmark for Persistent Identity in Deployed AI Agents","claim_type":"outcome","claim_status":"supported","confidence_score":null,"created_at":"2026-09-17T01:00:49.219Z","updated_at":"2026-09-17T01:00:49.219Z"}],"revisions":[{"id":"a7f2f23b-3041-41ae-ae4f-d0c4b9dfe8ae","event_id":"2a4e6287-9c0f-43ce-ad10-c6907e91baf6","model_id":null,"previous_score":"0.000000","new_score":"0.001000","previous_factors":{},"new_factors":{"evidence":0.1,"base_score":1,"durability":0.5,"attribution":0.1,"realization":0.2},"change_reason":"Auto-published from news ingest.","trigger_type":"news_ingest","trigger_source_ids":null,"reviewer_id":null,"review_status":"published","created_at":"2026-09-17T01:00:49.226Z"},{"id":"fd8673e5-507f-4719-a9fe-48507ff9cf7e","event_id":"2a4e6287-9c0f-43ce-ad10-c6907e91baf6","model_id":null,"previous_score":"0.001000","new_score":"0.002000","previous_factors":{"tier":1,"evidence":0.1,"base_score":1,"durability":0.5,"attribution":0.1,"realization":0.2},"new_factors":{"tier":1,"models":["535014f7-c941-4d39-aa9b-8f9c1d3d07b7"],"evidence":0.2,"base_score":1,"durability":0.5,"attribution":0.1,"realization":0.2},"change_reason":"Ingest update: independent source raised evidence; added a follow-up source.","trigger_type":"ingest_update","trigger_source_ids":["5a69321a-7753-4085-83f3-94b614b8f1e0"],"reviewer_id":null,"review_status":"published","created_at":"2026-09-17T03:00:51.074Z"}],"secondary":[]},"methodology_version":"0.1"}