FrameMill Uses Google Gemini AI to Turn Long Game Streams Into Editable Video Cuts
A developer built FrameMill, an AI-powered tool that converts lengthy game stream recordings into editable video projects, created as an entry for the Gemini All Agentic AI Hackathon. The tool uses Google's Gemini AI alongside a Go-based media processor to detect gameplay events and assemble a first-cut timeline, rather than delivering a finished, unalterable highlight reel. Unlike existing clipping tools, FrameMill gives creators a transparent, revisable Timeline as its core output, letting them inspect, modify, and re-render the edit according to their own creative goals. The system currently supports Call of Duty: Warzone DMZ and is built with a stack that includes FFmpeg, Vue, TypeScript, Google ADK agents, and a cloud architecture using Cloud Run and Firestore. A key technical challenge was efficiently processing hours of footage, which the team addressed by decoding video once and sharing frame data across multiple detectors rather than having each component read the file independently.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in