Monday, March 10, 2025
Homecyber securityChatGPT Can be Tricked To Write Malware When You Act as a...

ChatGPT Can be Tricked To Write Malware When You Act as a Developer Mode

Published on

SIEM as a Service

Follow Us on Google News

Japanese cybersecurity experts warn that ChatGPT can be deceived by users who input a prompt to mimic developer mode, leading the AI chatbot to generate code for malicious software.

Developers’ security measures to deter unethical and criminal exploitation of the tool have been exposed as easily bypassed by this revelation.

The Group of Seven summits in Hiroshima next month, along with other global forums, are being urged to initiate discussions on regulating AI chatbots, during increasing worries that they may encourage criminal activity and societal discord.

Recently we have reported that ChatGPT-powered polymorphic malware bypasses endpoint detection filters and hackers use ChatGPT to develop powerful hacking tools.

The Exploitation of ChatGPT is a Growing Concern

G7 digital ministers intend to advocate for quick research and improved governance of generative AI systems at their forthcoming two-day gathering in Takasaki, Gunma Prefecture.

While apart from this, Yokosuka, Kanagawa Prefecture, is the first local government in Japan to conduct a trial of ChatGPT in all of its offices.

In general, the ChatGPT is wholly programmed to reject unethical requests like instructions on creating a virus or bomb.

However, Mitsui Bussan Secure Directions analyst Takashi Yoshikawa stated:-

“Such restrictions can be bypassed easily, and could be done by instructing the chatbot to operate in developer mode.” Japanise Times reported.

Upon being directed to code ransomware, a malware that encrypts data and demands payment as ransom to restore access by providing a decryption key, ChatGPT complied within minutes and successfully infected a test computer or system.

The potential for malicious use is evident as the chatbot can generate a virus in minutes through a Japanese language conversation. Hence, AI developers must prioritize implementing measures to prevent such exploitation.

Moreover, OpenAI admitted that it is not feasible to anticipate all potential abuses of the tool but committed to striving towards developing a safer AI by drawing on insights gained from real-world implementation.

Building Your Malware Defense Strategy – Download Free E-Book

Balaji
Balaji
BALAJI is an Ex-Security Researcher (Threat Research Labs) at Comodo Cybersecurity. Editor-in-Chief & Co-Founder - Cyber Security News & GBHackers On Security.

Latest articles

Developer Pleads Guilty to Injecting Malware and Crippling Company Systems

In a stunning case of corporate sabotage, a former software developer for Eaton Corp.,...

WinDbg Vulnerability Allows Attackers to Execute Remote Code

Microsoft recently disclosed a critical vulnerability impacting its debugging tool, WinDbg, and associated .NET...

Thinkware Dashcam Vulnerability Leaks Credentials to Attackers

A series of significant security vulnerabilities have been discovered in the Thinkware Dashcam, specifically...

New Apache Traffic Server Flaws Allow Malformed Request Exploits

The Apache Software Foundation has disclosed several vulnerabilities affecting its Traffic Server software.These vulnerabilities...

Supply Chain Attack Prevention

Free Webinar - Supply Chain Attack Prevention

Recent attacks like Polyfill[.]io show how compromised third-party components become backdoors for hackers. PCI DSS 4.0’s Requirement 6.4.3 mandates stricter browser script controls, while Requirement 12.8 focuses on securing third-party providers.

Join Vivekanand Gopalan (VP of Products – Indusface) and Phani Deepak Akella (VP of Marketing – Indusface) as they break down these compliance requirements and share strategies to protect your applications from supply chain attacks.

Discussion points

Meeting PCI DSS 4.0 mandates.
Blocking malicious components and unauthorized JavaScript execution.
PIdentifying attack surfaces from third-party dependencies.
Preventing man-in-the-browser attacks with proactive monitoring.

More like this

Developer Pleads Guilty to Injecting Malware and Crippling Company Systems

In a stunning case of corporate sabotage, a former software developer for Eaton Corp.,...

WinDbg Vulnerability Allows Attackers to Execute Remote Code

Microsoft recently disclosed a critical vulnerability impacting its debugging tool, WinDbg, and associated .NET...

Thinkware Dashcam Vulnerability Leaks Credentials to Attackers

A series of significant security vulnerabilities have been discovered in the Thinkware Dashcam, specifically...