CLAP Audio Encoder Tested on ESC-50 Environmental Sounds via ONNX Runtime
A developer exported the CLAP audio encoder from the laion/clap-htsat-unfused model to ONNX format and evaluated it on the ESC-50 dataset, which contains 2,000 five-second environmental sound recordings across 50 classes. The experiment used a fixed one-nearest-neighbor approach, selecting two clips per class for a total of 100 clips, with no classifier training involved. Embeddings were compared using cosine similarity to assess whether recordings from the same class clustered together and whether sounds aligned with broader category groupings. The pipeline ran on an Apple Silicon CPU using PyTorch 2.8.0 and ONNX Runtime, producing normalized 512-dimensional embeddings per audio clip. The full code and reproducible environment are publicly available in the kiarina/labs repository on GitHub.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in