In the digital age, a new kind of Trojan horse has emerged in the form of AI models laced with malicious code. The AI community got a jolt from Protect AI’s revelation that a staggering 3,354 models on Hugging Face, a go-to AI model depot, contained potential malware or compromised code.<\/p>\n
Worse, it also appeared that Hugging Face’s security scans missed the threats in a third of these compromised models.<\/p>\n
This has led a company called Protect AI to develop a scanner tailored to detect malware and compromised code in open source AI models.<\/p>\n
Open source AI models are gaining in popularity given the costs associated with building and training a proprietary model.<\/p>\n
This has made platforms like Hugging Face incredibly popular but, if Project Ai’s numbers are correct, it has also made them a potential source of compromised AI code.<\/p>\n
Protect AI’s scanning software is one potential tool to detect these issues and ensure the safety of open source AI models.<\/p>\n
How will Protect AI keep up to date on threats? They have acquired a bug bounty program aimed at AI models called Huntr which they hope will provide them with continuing insights into new threats as they evolve.<\/p>\n