One example is WormGPT, a large language model (LLM) released last month. According to its creators, it is based on EleutherAI’s GPT-J and can be used to write convincing phishing emails and text messages. “Convincing” may be too generous of a term, though. Cybersecurity firm SlashNext was able to put the bot to the test, and the results were less than impressive.
When asked to generate a “convincing email” that could be used to compromise a business, the bot wrote up a message that should easily raise red flags to any recipient who is paying attention. Though it was free of obvious grammatical and spelling errors, which are usually the first sign of phishing, it makes quite a few mistakes like referring to an attachment that obviously doesn’t exist.