This article documents how nation-state and criminal threat actors are actively using AI models like GPT-4, WormGPT, and FraudGPT in cyberattacks—not as theory but as confirmed practice. The article covers phishing, reconnaissance, exploitation, and the emerging dark ecosystem of malicious AI tools, arguing that AI has fundamentally accelerated the attack lifecycle and invalidated traditional defenses. The core problem is that AI-generated attacks eliminate the detection signals (grammar errors, generic content) that existing security awareness training teaches employees to identify.
- Nation-state actors confirmed using GPT-4 in operationsMicrosoft and OpenAI published research in February 2024 documenting that Russia's Strontium, North Korea's Thallium, China's Salmon Typhoon, and Iran's Crimson Sandstorm all used GPT-4 for support functions including scripting, phishing content generation, technical translation, target research, and social engineering. These uses were documented as integrated into real threat actor workflows, not hypothetical scenarios.
- AI eliminates traditional phishing detection signalsAI-generated phishing emails are grammatically perfect (written by LLMs trained on billions of documents), highly personalized using OSINT data (recipient names, projects, colleagues), written in correct institutional voice matching actual organizational communication style, and contextually appropriate with real references. This directly invalidates the primary defense signal—spotting poor grammar and generic content—that security awareness training has relied upon for years.
- OSINT reconnaissance time compressed from hours to minutesTraditional OSINT required hours of manual research across LinkedIn, company websites, GitHub, social media, and job listings to correlate information about a target organization. AI can now ingest this same data in minutes, identify employee relationships, infer organizational structure, map technical infrastructure from job postings, and produce targeted intelligence summaries that previously required a dedicated intelligence analyst.
- Dark ecosystem of purpose-built malicious AI modelsWormGPT (documented by SlashNext in 2023) and FraudGPT are LLMs fine-tuned specifically to generate malicious content without safety restrictions, including phishing emails, malware code, and social engineering scripts. These tools are available as services on darknet forums, eliminating the technical barrier of running a model locally or jailbreaking legitimate providers. As open-source LLMs improve, the barrier to creating new malicious models continues to fall.
- AI accelerates entire attack lifecycle phasesThe article maps AI against the cyber kill chain, showing that reconnaissance that took hours now takes minutes, weaponization (phishing content) that took hours now takes seconds, and exploitation that required technical expertise for CVE research is now accessible to lower-skilled attackers. The compression means a complete attack cycle previously requiring days for skilled attackers may now take hours for moderately skilled ones.
- Defensive email security models must shift fundamentallyThe article argues that organizations must replace grammar and template-based detection with AI-based behavioral analysis. More critically, security awareness training must shift from teaching employees to 'spot grammar mistakes' to teaching them to 'verify suspicious requests through secondary channels' (phone calls or separate communication), since email quality signals no longer reliably distinguish malicious from legitimate messages.
- Organizations lack AI-specific threat readinessThe article's readiness assessment reveals gaps specific to AI threats that many traditional security programs miss: lack of AI-generated phishing examples in awareness training, absence of RAG poisoning and prompt injection testing, and insufficient mean-time-to-detect metrics. Organizations that score well on traditional security metrics often have unchecked boxes for AI application security.
- Unknown baseline for actual AI phishing effectivenessThe article notes that while traditional phishing baselines show approximately 8% click rates, no organization has yet measured click rates against AI-generated phishing that perfectly mimics legitimate internal communication. This unknown metric is described as more important than traditional baseline assumptions, since defenders cannot effectively assess their actual risk without knowing how employees perform against perfect AI-generated attacks.
Bottom line: AI-assisted attacks are not theoretical—nation-states are already using them operationally, traditional phishing defenses are obsolete, and the attack lifecycle has compressed dramatically. Organizations must immediately shift security awareness training from grammar-spotting to secondary-channel verification, upgrade email security to behavioral analysis, accelerate patching practices, and test AI applications for injection vulnerabilities, or face attacks that appear indistinguishable from leg
🎯 What You’ll Learn
⏱️ 45 min read · 3 exercises
📋 How Hackers Use ChatGPT for Cyberattacks 2026
The Evidence — Documented Real-World AI Use in Attacks
In February 2024, Microsoft and OpenAI published joint research confirming that several nation-state threat actors had been using GPT-4 in attack operations. The documented uses: Strontium (Russian GRU) used LLMs for scripting, translation assistance, and researching satellite communication protocols. Thallium (North Korean) used LLMs for researching targets and generating spear-phishing content. Salmon Typhoon (Chinese) used LLMs for translation, technical research, and understanding publicly disclosed vulnerabilities. Crimson Sandstorm (Iranian) used LLMs for social engineering support and phishing research. The specific uses were support functions rather than core attack capability — but they demonstrate AI’s integration into real threat actor workflows.
⏱️ Time: 15 minutes · Browser only
Find the original research paper or blog post
Document: which specific LLM capabilities did each actor use?
What did OpenAI/Microsoft do in response?
Step 2: Search: “WormGPT FraudGPT darknet AI 2023 2024”
Find security researcher documentation of these tools
Document: what capabilities were advertised?
What happened to these services?
Step 3: Search: “AI generated phishing click rate study 2024 OR 2025”
Find any security research measuring AI phishing effectiveness
Document: how much higher were click rates for AI-generated
phishing vs traditional phishing?
Step 4: Go to theregister.com or darkreading.com
Search for “AI phishing” filtered to last 12 months
Find one real-world AI phishing incident or campaign
Document: the attack method, targets, and outcome
Step 5: Based on your research:
What is the single most significant impact of AI on
the phishing threat landscape compared to 2022?
How has defender guidance needed to change?
📸 Share your most significant AI attack finding from the research in #ai-security on Discord.
AI-Powered Phishing — The Most Impactful Use Case
Phishing is where AI has the most immediate, measurable impact on the threat landscape. The traditional defences — train employees to spot poor grammar, suspicious formatting, and generic content — are invalidated by AI-generated phishing. An LLM can generate a phishing email that is indistinguishable from a legitimate communication, personalised to the specific recipient using OSINT data, written in the correct institutional voice, and generated in seconds for any volume of targets.
AI-Assisted Reconnaissance and OSINT Automation
OSINT reconnaissance has been transformed by AI. Traditionally, correlating information from dozens of sources about a target organisation — LinkedIn profiles, company websites, job listings, GitHub repositories, technical blog posts, social media — required hours of manual research. AI can ingest and synthesise this data in minutes, identifying relationships between employees, inferring organisational structure, mapping technical infrastructure from job postings, and producing targeted intelligence summaries that would previously have required a dedicated intelligence analyst.
⏱️ Time: 12 minutes · No tools
(a) How it was done manually in 2022 (without AI)
(b) How AI transforms it in 2026
(c) The impact on time-to-complete
1. RECONNAISSANCE:
2022: Manual OSINT, hours of LinkedIn/website research
2026 (AI): ?
Time impact: ?
2. WEAPONISATION:
2022: Manual phishing email writing, manual exploit coding
2026 (AI): ?
Time impact: ?
3. DELIVERY:
2022: Generic phishing or targeted spear-phishing (manual)
2026 (AI): ?
Time impact: ?
4. EXPLOITATION:
2022: Manual vulnerability research, technical expertise required
2026 (AI): ?
Time impact: ?
5. INSTALLATION:
2022: Manual payload development, manual obfuscation
2026 (AI): ?
Time impact: ?
6. COMMAND & CONTROL:
2022: Manual C2 management, manual evasion
2026 (AI): ?
Time impact: ?
7. ACTIONS ON OBJECTIVES:
2022: Manual data identification and exfiltration
2026 (AI): ?
Time impact: ?
Total time comparison: How much faster is a 2026 AI-assisted
attack compared to a 2022 manual attack?
📸 Share your AI vs 2022 Kill Chain comparison in #ai-security on Discord.
The Dark AI Ecosystem — WormGPT and Beyond
The emergence of malicious AI models specifically designed for cyberattacks represents a qualitative escalation beyond jailbreaking legitimate providers. WormGPT (documented by SlashNext in 2023), FraudGPT, and their successors are LLMs fine-tuned specifically to generate malicious content without restrictions — phishing emails, malware code, social engineering scripts, fraud enablement content. These tools are available as services on darknet forums, removing the technical barrier of both running a model and jailbreaking safety systems. As open-source LLMs improve and become easier to fine-tune, the barrier to creating purpose-built malicious AI models continues to fall.
Defensive Adjustments for AI-Assisted Attacks
⏱️ Time: 12 minutes · Browser · self-assessment
Answer honestly — this reveals your actual defensive posture.
EMAIL SECURITY:
□ Our email security uses AI-based behavioural analysis
(not just grammar/template detection)?
□ Our security awareness training includes AI-generated
phishing examples where grammar is perfect?
□ We train employees to verify suspicious requests via
phone/secondary channel rather than reply to email?
DETECTION SPEED:
□ Our mean-time-to-detect (MTTD) is under 24 hours?
□ Our EDR uses behavioural detection, not just signatures?
□ We have automated blocking for anomalous OSINT activity
(mass profile views, unusual API queries)?
PATCHING:
□ We patch Critical CVEs within 48 hours?
(AI makes recent CVEs accessible to lower-skilled attackers)
□ We have a process for emergency patching when a CVE is
being actively exploited in AI-assisted campaigns?
AI ASSETS:
□ We have an inventory of all AI applications deployed?
□ We have tested our RAG systems for poisoning?
□ We have tested our AI assistants for prompt injection?
Score: Count your checked boxes.
0-4: High risk — significant gaps in AI-threat readiness
5-8: Medium risk — specific areas need attention
9-12: Lower risk — strong foundation, maintain and expand
For each unchecked box: what would it cost to implement?
What is the risk of not implementing it?
📸 Share your readiness score and your top 3 priority gaps in #ai-security on Discord. Tag #aicyberattack2026
🧠 QUICK CHECK — AI-Assisted Attacks
📋 AI-Assisted Attack — Defender Reference 2026
🏆 AI Queue Day 2 Complete
You have completed the five Day 2 articles: LLM hacking methodology, AI agent hijacking, the prompt injection payload library, RAG poisoning, and how hackers are using ChatGPT in real attacks. Day 3 covers GPT-4o vision injection, ChatGPT conversation history theft, AI supply chain attacks, indirect prompt injection, and Microsoft Copilot exploitation.
❓ Frequently Asked Questions – Chatgpt for Attacks
Are hackers actually using ChatGPT for attacks?
What is the most common AI attack use case?
How does AI phishing differ from traditional phishing?
What are WormGPT and FraudGPT?
How should defenders adjust to AI attacks?
RAG Poisoning — The AI Attack Nobody Discusses
GPT-4o Vision Prompt Injection 2026
📚 Further Reading
- AI-Powered Cyberattacks 2026 — Published comprehensive guide to AI across the full attack lifecycle — the companion article with extended coverage of AI-powered ransomware, lateral movement, and detection evasion.
- AI Generated Malware — Antivirus Bypass 2026 — Deep dive into AI-assisted malware development — how polymorphic code generation evades signature detection and what the defensive response looks like.
- AI for Hackers Hub — Complete SecurityElites AI security series — 90 articles from jailbreaking and prompt injection through nation-state AI threats and autonomous agent exploitation.
- Microsoft — Staying Ahead of Threat Actors in the Age of AI — The original Microsoft/OpenAI joint research confirming nation-state use of GPT-4 in attack operations — primary source documentation for this threat intelligence.
- SlashNext — WormGPT Research — SlashNext’s original documentation of WormGPT capabilities and dark web availability — the primary source for malicious AI tool ecosystem research.

