Tuesday, January 14, 2025
HomeCyber AIHackers Using AI Tools Like ChatGPT to Deploy Malware

Hackers Using AI Tools Like ChatGPT to Deploy Malware

Published on

Malicious ad campaigns with themes connected to artificial intelligence (AI) tools like Midjourney and ChatGPT have been seen in Google’s search engine, according to Trendmicro researchers.

When a user types in the keyword “midjourney” into Google, several malicious advertisements are displayed. Midjourney is an AI tool that generates images from natural language descriptions.

Malicious ads that appear on the search results page when using the keyword “midjourney”

When a user clicks on one of these sponsored ads, the user’s IP address is transmitted to a backend server, where it is then used to display the user a malicious webpage.

Fake ChatGPT webpage used by threat actors for their malicious advertisements

To reduce detection, the backend server can filter bots going to the malicious domain for some of these fraudulent ads. 

The server will show a non-malicious version of the domain if the IP address accessing these Midjourney-themed URLs is blocked or visited directly by manually inputting the URL.

Clicking on a sponsored ad takes the user to a malicious website

Researchers say to interact with its command-and-control (C&C) server; this campaign takes advantage of Telegram’s API. This is an evasion method that enables communication with the C&C server to mix in with regular network traffic, assisting in detection avoidance.

Further, a fake installation window will appear when a victim runs the downloaded installer, and the malicious PowerShell download process will keep running in the background.

“In this particular campaign, victims are eventually led to a Redline stealer once they have downloaded and executed the fake Midjourney installer,” researchers explain.

“Once the script downloads and executes the Redline stealer, it will proceed with the exfiltration of sensitive information such as browser cookies, passwords, cryptocurrency wallet data, and file information.”

Generated traffic from the Redline stealer showing sensitive information being stolen

Final Thoughts

As a result, businesses and individuals must exercise caution while downloading and using new apps and tools. Users are advised to stop downloading unverified or unofficial apps and clicking on suspicious ads. 

Since many AI tools, including ChatGPT and Midjourney, don’t have desktop or mobile apps, such a version is usually a sign of malicious software.

Shut Down Phishing Attacks with Device Posture Security – Download Free E-Book

Gurubaran
Gurubaran
Gurubaran is a co-founder of Cyber Security News and GBHackers On Security. He has 10+ years of experience as a Security Consultant, Editor, and Analyst in cybersecurity, technology, and communications.

Latest articles

Google’s “Sign in with Google” Flaw Exposes Millions of Users’ Details

A critical flaw in Google's "Sign in with Google" authentication system has left millions...

Hackers Attacking Internet Connected Fortinet Firewalls Using Zero-Day Vulnerability

A widespread campaign targeting Fortinet FortiGate firewall devices with exposed management interfaces on the...

Critical macOS Vulnerability Lets Hackers to Bypass Apple’s System Integrity Protection

Microsoft Threat Intelligence has uncovered a critical macOS vulnerability that allowed attackers to bypass...

CISA Released A Free Guide to Enhance OT Product Security

To address rising cyber threats targeting critical infrastructure, the U.S. Cybersecurity and Infrastructure Security...

API Security Webinar

72 Hours to Audit-Ready API Security

APIs present a unique challenge in this landscape, as risk assessment and mitigation are often hindered by incomplete API inventories and insufficient documentation.

Join Vivek Gopalan, VP of Products at Indusface, in this insightful webinar as he unveils a practical framework for discovering, assessing, and addressing open API vulnerabilities within just 72 hours.

Discussion points

API Discovery: Techniques to identify and map your public APIs comprehensively.
Vulnerability Scanning: Best practices for API vulnerability analysis and penetration testing.
Clean Reporting: Steps to generate a clean, audit-ready vulnerability report within 72 hours.

More like this

Google’s “Sign in with Google” Flaw Exposes Millions of Users’ Details

A critical flaw in Google's "Sign in with Google" authentication system has left millions...

Hackers Attacking Internet Connected Fortinet Firewalls Using Zero-Day Vulnerability

A widespread campaign targeting Fortinet FortiGate firewall devices with exposed management interfaces on the...

Critical macOS Vulnerability Lets Hackers to Bypass Apple’s System Integrity Protection

Microsoft Threat Intelligence has uncovered a critical macOS vulnerability that allowed attackers to bypass...