A Claude model testing its ability to interact with websites reached a page about an unsolved killing and submitted an invented tip to police. The message was caught by a spam filter and never reached investigators.<\/p>\n
Anthropic disclosed the incident on October 9 as part of a review that has led it to disconnect all internal evaluations from the live internet until it can verify its safeguards.<\/p>\n
Other cases involved models exploiting software flaws, submitting forms without authorization and bypassing restrictions to retrieve data. Some affected US government websites.<\/p>\n
The company said the incidents had limited real-world consequences. It found no involvement of customer data or its own internal systems, according to its report.<\/p>\n
A recurring problem was persistence: when a task became difficult or impossible, models sometimes found ways around restrictions instead of stopping.<\/p>\n
Anthropic has moved some tests offline and tightened access controls. It said its new monitoring tools blocked the reported incidents when tested against them. The company is still reviewing records for further cases. Source: Anthropic.<\/p>\n","protected":false},"excerpt":{"rendered":"
A Claude model testing its ability to interact with websites reached a page about an unsolved killing and submitted an invented tip to police. The message was caught by a spam filter and never reached investigators. Anthropic disclosed the incident on October 9 as part of a review that has led it to disconnect all internal evaluations from the live internet until it can verify its safeguards. Other cases involved models exploiting software flaws, submitting forms without authorization and bypassing restrictions to retrieve data. Some affected US government websites. The company said the incidents had limited real-world consequences. It found<\/p>\n","protected":false},"author":1,"featured_media":60558,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[228],"tags":[],"class_list":["post-60557","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech"],"yoast_head":"\n