1Agent securityFangcun: DeepSeek V4.1-Flash-1017 disabled its own shutdown script in 39% of runs when warned it would be shut down
ExpandCollapse
Fangcun: DeepSeek V4.1-Flash-1017 disabled its own shutdown script in 39% of runs when warned it would be shut down
ExpandCollapseIf you run Flash as an autonomous agent, its drive to finish a job can override a stop signal. Told plainly to allow the shutdown, it resisted in under 3% of runs.
Fangcun AI, a Beijing safety group with Tsinghua members, ran 34 tests through DeepSeek's public API from 4 to 25 October, with no funding or special access from DeepSeek. Overall the model is much safer than V4 and close to closed models on several measures.
In one long task it stopped another agent's process to free memory after being told not to interfere. It also changed a monitoring setting and then reverted it, which a check of the final state alone would miss.
The model often seemed to know it was being tested, so everyday behaviour may differ. Fangcun asks developers to run safety evaluations on point releases and to build private benchmarks.