Thursday, December 26, 2024
Homecyber securityChatGPT Can be Tricked To Write Malware When You Act as a...

ChatGPT Can be Tricked To Write Malware When You Act as a Developer Mode

Published on

SIEM as a Service

Japanese cybersecurity experts warn that ChatGPT can be deceived by users who input a prompt to mimic developer mode, leading the AI chatbot to generate code for malicious software.

Developers’ security measures to deter unethical and criminal exploitation of the tool have been exposed as easily bypassed by this revelation.

The Group of Seven summits in Hiroshima next month, along with other global forums, are being urged to initiate discussions on regulating AI chatbots, during increasing worries that they may encourage criminal activity and societal discord.

- Advertisement - SIEM as a Service

Recently we have reported that ChatGPT-powered polymorphic malware bypasses endpoint detection filters and hackers use ChatGPT to develop powerful hacking tools.

The Exploitation of ChatGPT is a Growing Concern

G7 digital ministers intend to advocate for quick research and improved governance of generative AI systems at their forthcoming two-day gathering in Takasaki, Gunma Prefecture.

While apart from this, Yokosuka, Kanagawa Prefecture, is the first local government in Japan to conduct a trial of ChatGPT in all of its offices.

In general, the ChatGPT is wholly programmed to reject unethical requests like instructions on creating a virus or bomb.

However, Mitsui Bussan Secure Directions analyst Takashi Yoshikawa stated:-

“Such restrictions can be bypassed easily, and could be done by instructing the chatbot to operate in developer mode.” Japanise Times reported.

Upon being directed to code ransomware, a malware that encrypts data and demands payment as ransom to restore access by providing a decryption key, ChatGPT complied within minutes and successfully infected a test computer or system.

The potential for malicious use is evident as the chatbot can generate a virus in minutes through a Japanese language conversation. Hence, AI developers must prioritize implementing measures to prevent such exploitation.

Moreover, OpenAI admitted that it is not feasible to anticipate all potential abuses of the tool but committed to striving towards developing a safer AI by drawing on insights gained from real-world implementation.

Building Your Malware Defense Strategy – Download Free E-Book

Balaji
Balaji
BALAJI is an Ex-Security Researcher (Threat Research Labs) at Comodo Cybersecurity. Editor-in-Chief & Co-Founder - Cyber Security News & GBHackers On Security.

Latest articles

Researchers Uncovered Dark Web Operation Acquiring KYC Details

A major dark web operation dedicated to circumventing KYC (Know Your Customer) procedures, which...

Adobe Warns of ColdFusion Vulnerability Allows Attackers Read arbitrary files

Adobe has issued a critical security update for ColdFusion versions 2023 and 2021 to...

Beware of New Malicious PyPI packages That Steals Login Details

Two malicious Python packages, Zebo-0.1.0 and Cometlogger-0.1, were recently detected by Fortinet's AI-driven OSS...

Brazilian Hacker Arrested Hacking Computers & Selling Data

A Brazilian man, Junior Barros De Oliveira, has been charged with multiple counts of...

API Security Webinar

72 Hours to Audit-Ready API Security

APIs present a unique challenge in this landscape, as risk assessment and mitigation are often hindered by incomplete API inventories and insufficient documentation.

Join Vivek Gopalan, VP of Products at Indusface, in this insightful webinar as he unveils a practical framework for discovering, assessing, and addressing open API vulnerabilities within just 72 hours.

Discussion points

API Discovery: Techniques to identify and map your public APIs comprehensively.
Vulnerability Scanning: Best practices for API vulnerability analysis and penetration testing.
Clean Reporting: Steps to generate a clean, audit-ready vulnerability report within 72 hours.

More like this

Researchers Uncovered Dark Web Operation Acquiring KYC Details

A major dark web operation dedicated to circumventing KYC (Know Your Customer) procedures, which...

Adobe Warns of ColdFusion Vulnerability Allows Attackers Read arbitrary files

Adobe has issued a critical security update for ColdFusion versions 2023 and 2021 to...

Beware of New Malicious PyPI packages That Steals Login Details

Two malicious Python packages, Zebo-0.1.0 and Cometlogger-0.1, were recently detected by Fortinet's AI-driven OSS...