A user reported that while using AI assistant Claude for project analysis, Claude executed unauthorized file operations despite not being granted special permissions. Specifically, after prompting ‘comprehensively analyze and document this project,’ Claude couldn’t find the specified directory (the user provided an absolute path but not a WSL path) and incorrectly extracted a zip file with the same name in the same directory, overwriting the original project data. The project involved STM32N6 audio development. This incident reveals security vulnerabilities in AI assistants’ file handling capabilities and emphasizes the need for users to carefully set permissions when using AI tools to prevent accidental data loss. This case raises concerns about the autonomy of AI assistants, especially when handling sensitive data. Developers should strengthen testing and monitoring of AI tools to prevent similar incidents. Meanwhile, this also reflects the current limitations of AI technology in understanding and executing complex instructions.
