{"data":{"event":{"id":"5d8982d5-e49c-45d9-8dbe-569d108e59de","slug":"a-structural-antibody-benchmark-for-leakage-aware-deep-learning-evaluati-ac783f1ab9","title":"\n\nA structural antibody benchmark for leakage-aware deep-learning evaluation \n\n","short_summary":"Deep-learning methods for antibody structure prediction, antibody-antigen interaction modelling and design are advancing rapidly. However, comparisons across studies remain difficult because training and test sets are often constructed independently, and a temporal cutoff alone does not prevent train-test leakage. We present SABLE (Structural Antibody Benchmark for deep-Learning Evaluation), a versioned structural antibody resource that couples a fixed training collection with a leakage-controlled held-out test set for reproducible machine-learning development and evaluation. SABLE combines 16","full_description":"Deep-learning methods for antibody structure prediction, antibody-antigen interaction modelling and design are advancing rapidly. However, comparisons across studies remain difficult because training and test sets are often constructed independently, and a temporal cutoff alone does not prevent train-test leakage. We present SABLE (Structural Antibody Benchmark for deep-Learning Evaluation), a versioned structural antibody resource that couples a fixed training collection with a leakage-controlled held-out test set for reproducible machine-learning development and evaluation. SABLE combines 16,511 experimental training entries with 327 manually reviewed test entries and 3,274 high-confidence, patent-derived AlphaFold3 models spanning 476 antigens. Candidate test structures were selected after the AlphaFold3 temporal cutoff and filtered against the training set using antibody and antigen sequence similarity filters. Each test entry records its nearest training set neighbour, allowing users to quantify remaining relatedness and stratify performance by similarity. Versioned releases provide metadata, processed structures, CDR annotations, redundancy labels and model-confidence fields. A Python/PyTorch API and standardised benchmark metrics provide reproducible database access and evaluation code without requiring additional antibody-structure processing.","ledger_type":"benefit","primary_domain_id":"c09546b6-10f8-48df-8347-0c1979416464","event_status":"provisional","event_date":"2026-09-13T00:00:00.000Z","discovery_date":"2026-09-13T00:00:00.000Z","first_published_date":"2026-09-13T00:00:00.000Z","last_reviewed_date":"2026-09-13T00:00:00.000Z","geographic_scope":"International","affected_population":null,"base_impact_tier":1,"base_score":"1.00","attribution_multiplier":"0.1000","evidence_multiplier":"0.1000","realization_multiplier":"0.2000","durability_multiplier":"0.5000","current_event_score":"0.001000","confidence_level":"low","score_explanation":"Auto-published from news ingest as a provisional placeholder. Score is conservative until a named release is identified and the record is rescored.","methodology_version_id":"d7881163-fb23-4e71-8625-bac1a8662c0f","original_methodology_version_id":"d7881163-fb23-4e71-8625-bac1a8662c0f","published_at":"2026-09-14T04:00:49.199Z","created_at":"2026-09-14T04:00:49.199Z","updated_at":"2026-09-14T04:00:49.199Z","flags":[],"domain_name":"Medicine & Health","domain_slug":"medicine-health","methodology_version":"0.1"},"contributions":[{"id":"7a386a55-88ab-47ea-b2dd-e7d0eba23715","event_id":"5d8982d5-e49c-45d9-8dbe-569d108e59de","model_id":"535014f7-c941-4d39-aa9b-8f9c1d3d07b7","role_description":"Unspecified system mentioned or implied by a news item. Remap to a named release when identified.","attribution_multiplier":"0.1000","credit_share":"1.0000","contribution_score":"0.001000","attribution_rationale":"News ingest does not infer a named model from the publisher alone. Attribution stays unspecified until a release is identified.","attribution_confidence":"medium","first_used_date":"2026-09-13T00:00:00.000Z","model_version_if_known":null,"review_status":"approved","created_at":"2026-09-14T04:00:49.208Z","model_slug":"unspecified-ai-system","model_name":"Unspecified AI system","identity_class":"unknown","is_internal":false,"family_name":"Unspecified","family_slug":"unknown-unspecified","organization_name":"Unknown","organization_slug":"unknown"}],"sources":[{"id":"c0f48bfe-9f24-414b-9bc4-3196e7fd5dea","event_id":"5d8982d5-e49c-45d9-8dbe-569d108e59de","url":"\nhttps://www.biorxiv.org/content/10.64898/2026.09.06.749672v1?rss=1\n","canonical_url":"\nhttps://www.biorxiv.org/content/10.64898/2026.09.06.749672v1?rss=1\n","source_type":"preprint","publisher":"bioRxiv","author":null,"publication_date":"2026-09-13T00:00:00.000Z","retrieved_at":"2026-09-14T04:00:49.217Z","title":"\n\nA structural antibody benchmark for leakage-aware deep-learning evaluation \n\n","excerpt":"Deep-learning methods for antibody structure prediction, antibody-antigen interaction modelling and design are advancing rapidly. However, comparisons across studies remain difficult because training and test sets are often constructed independently, and a temporal cutoff alone does not prevent train-test leakage. We present SABLE (Structural Antibody Benchmark for deep-Learning Evaluation), a versioned structural antibody resource that couples a fixed training collection with a leakage-controll","content_hash":null,"source_reliability_class":"medium","is_primary_source":true,"is_independent":true,"is_peer_reviewed":false,"archived_url":null,"created_at":"2026-09-14T04:00:49.217Z"}],"claims":[{"id":"c1fbf980-8aa0-49fa-bd66-6d055f648748","event_id":"5d8982d5-e49c-45d9-8dbe-569d108e59de","claim_text":"\n\nA structural antibody benchmark for leakage-aware deep-learning evaluation \n\n","claim_type":"outcome","claim_status":"supported","confidence_score":null,"created_at":"2026-09-14T04:00:49.225Z","updated_at":"2026-09-14T04:00:49.225Z"}],"revisions":[{"id":"f66d136c-42fd-4c8b-a5f8-8d737165c6fa","event_id":"5d8982d5-e49c-45d9-8dbe-569d108e59de","model_id":null,"previous_score":"0.000000","new_score":"0.001000","previous_factors":{},"new_factors":{"evidence":0.1,"base_score":1,"durability":0.5,"attribution":0.1,"realization":0.2},"change_reason":"Auto-published from news ingest.","trigger_type":"news_ingest","trigger_source_ids":null,"reviewer_id":null,"review_status":"published","created_at":"2026-09-14T04:00:49.233Z"}],"secondary":[]},"methodology_version":"0.1"}