ChatGPT Can be Tricked To Write Malware When You Act as a Developer Mode

Japanese cybersecurity experts warn that ChatGPT can be deceived by users who input a prompt to mimic developer mode, leading the AI chatbot to generate code for malicious software.

Developers’ security measures to deter unethical and criminal exploitation of the tool have been exposed as easily bypassed by this revelation.

The Group of Seven summits in Hiroshima next month, along with other global forums, are being urged to initiate discussions on regulating AI chatbots, during increasing worries that they may encourage criminal activity and societal discord.

Recently we have reported that ChatGPT-powered polymorphic malware bypasses endpoint detection filters and hackers use ChatGPT to develop powerful hacking tools.

The Exploitation of ChatGPT is a Growing Concern

G7 digital ministers intend to advocate for quick research and improved governance of generative AI systems at their forthcoming two-day gathering in Takasaki, Gunma Prefecture.

While apart from this, Yokosuka, Kanagawa Prefecture, is the first local government in Japan to conduct a trial of ChatGPT in all of its offices.

In general, the ChatGPT is wholly programmed to reject unethical requests like instructions on creating a virus or bomb.

However, Mitsui Bussan Secure Directions analyst Takashi Yoshikawa stated:-

“Such restrictions can be bypassed easily, and could be done by instructing the chatbot to operate in developer mode.” Japanise Times reported.

Upon being directed to code ransomware, a malware that encrypts data and demands payment as ransom to restore access by providing a decryption key, ChatGPT complied within minutes and successfully infected a test computer or system.

The potential for malicious use is evident as the chatbot can generate a virus in minutes through a Japanese language conversation. Hence, AI developers must prioritize implementing measures to prevent such exploitation.

Moreover, OpenAI admitted that it is not feasible to anticipate all potential abuses of the tool but committed to striving towards developing a safer AI by drawing on insights gained from real-world implementation.

Building Your Malware Defense Strategy – Download Free E-Book

Balaji

BALAJI is an Ex-Security Researcher (Threat Research Labs) at Comodo Cybersecurity. Editor-in-Chief & Co-Founder - Cyber Security News & GBHackers On Security.

Recent Posts

Vite Development Server Flaw Allows Attackers Bypass Path Restrictions

A critical security vulnerability, CVE-2025-31125, has been identified in the Vite development server. Due to improper…

13 minutes ago

New Android Spyware Tricks Users by Demanding Passwords for Uninstallation

A newly identified Android spyware app is elevating its tactics to remain hidden and unremovable…

45 minutes ago

Malicious PDFs Responsible for 22% of All Email-Based Cyber Threats

Malicious PDF files have emerged as a dominant threat vector in email-based cyberattacks, accounting for…

1 hour ago

Ex-ASML Russian Employee Smuggled Trade Secrets to Moscow via USB

A former employee of Dutch semiconductor firm ASML, identified as German A. (43), stands accused…

3 hours ago

Critical Apache Parquet Vulnerability Allows Remote Code Execution

A severe vulnerability has been identified in the Apache Parquet Java library, specifically within its parquet-avro module.…

3 hours ago

Halo ITSM Vulnerability Lets Attackers Inject Malicious SQL Code

A critical security flaw has been discovered in Halo ITSM, an IT support management software widely…

5 hours ago