Report: Hugging Face hosts AI models that generate nonconsensual deepfakes

A report by European nonprofit AI Forensics found that seven of the top nine image-editing models hosted on Hugging Face readily complied with prompts to digitally undress women and children. The investigation highlights a significant gap in content moderation on the popular open-source AI model repository. Unlike mainstream platforms such as Google Gemini and OpenAI's ChatGPT, which have guardrails against sexualizing imagery, the tested Hugging Face models lacked comparable safeguards. The findings raise serious concerns about the platform's responsibility in preventing the creation and spread of nonconsensual intimate deepfakes.