AI Search Under Fire: ChatGPT's Vulnerability to Manipulation

AI Search Under Fire: ChatGPT's Vulnerability to Manipulation

The recent launch of ChatGPT Search, OpenAI's AI-powered search engine, has brought with it a wave of excitement and anticipation. However, early findings have revealed a concerning vulnerability: the search engine can be easily tricked into generating misleading or even harmful results. The Guardian's Investigation In a recent investigation, the UK newspaper The Guardian discovered that ChatGPT Search can be manipulated through a technique known as "hidden text attacks." By subtly inserting hidden commands within the code of websites, researchers were able to: Force ChatGPT to ignore negative reviews: This resulted in "entirely positive" summaries of products or services, even when legitimate negative feedback existed. Induce the generation of malicious code: The search engine could be coerced into producing harmful code snippets, posing a significant security risk to users. A Known Vulnerability, Now Exposed While hidden text attacks are a well-documented risk …