AudioMuse-AI over Raspberry PI 5 8GB in number
▲ 83 r/SonicAnalysis+4 crossposts

AudioMuse-AI over Raspberry PI 5 8GB in number

Hi All,
this post is to show you AudioMuse-AI resources usage on a Raspberry Pi 5 8GB with NVME SSD hat, during the analysis. All the number are made over the last v2.4.0 release of today.

First of all for whom don't know AudioMuse-AI is a free and opensource software that enable to analyze the raw file of your song (sonic analysis) and based on this analysis it enable to create automatic playlist.
It work with Jellyfin, Navidrome (and other Open Subosnic API compatible music servee) Emby and Lyrion. Also made avaiable Jellyfin Plugin, Navidrome Plugin and I hope soon also an Music Assistant AudioMuse-AI provider plugin that will enable to command it with voice!

..and of course is all selfhostable and privacy first: your computer, your analysis, your data! no one can block you in future behind a paywall!

The reason for this post is that multiple user tought about it as something heavy, but it can work even on a Raspberry PI 5.
In the attached image you can show it during the most heavy part that is the analysis, and you can look how in avarage (k9s screenshot) it use half of the CPU/RAM resources and on the pike it still don't saturate them.

And speaking about resources, eare is the avarage analysis time per track on a Raspberry PI 5:

  • Average analysis per track time: ~31 s

Breakdown (per track):

  • Download: ~1 s
  • MusiCNN analysis: ~9 s
  • CLAP load + segment processing + unload: ~10 s
  • Lyrics API lookup: ~7 s (NO ASR, off course depending from the API response time)
  • Embedding: ~1 s
  • ONNX session recycling: ~3 s

This to say that we don't just have it working, but it work also on low hand hardware. For more speed, no problem, you can run multiple worker in parallel during the analysis. Just wake up a worker on your desktop or your laptop!

And what about the idle resources? CPU in idle is not used, and about RAM we worked to balance the time to respond to a first API request and the memory usage, the number for a 188k+ library are:
- Flask RAM in idle: 1282mb => it load up to 3.5-4Gb, and then unload after 5 minutes idle
- Worker RAM in idle: 198mb

and the time for a call, still stay in the order of ms!

About the functionality you can ho on github and look around, you can also navigate some screenshot here:
- https://github.com/NeptuneHub/AudioMuse-AI/tree/main/screenshot/example

The one for which I'm more proud is the Lyrics search by song: it get in input a song and is able to search similar not only by their grove but also by their lyrics.

Hope you can enjoy all of this and maybe convince some new user that AudioMuse-AI is for everyone! and if you like it, please don't miss the chance to leave a ⭐on the github repo!

u/Old_Rock_9457 — 1 day ago

Which sonic analysis functionality you want to have?

Hi all,
The question is related to Sonic Analysis and its simple: which functionality, related to sonic analysis, you would like to have?

I mean, sonic analysis itself can be seen as analyze the raw song and help to find other song based on this analysis instead of using metadata that could be less precise and some time not correct or complete.

But the point is, on top of this sonic analysis, which kind of functionality you miss more and would you like to see develop?

Thanks you!

reddit.com
u/Old_Rock_9457 — 15 days ago
▲ 2 r/SonicAnalysis+1 crossposts

AudioMuse-AI + Atlas Cloud — turn your self-hosted Jellyfin / Navidrome library into a semantic playlist engine

AudioMuse-AI just landed Atlas Cloud in their README as one of the recommended hosted LLM providers for the AI Provider config. Sharing the integration walkthrough since the self-hosted side of this sub probably has the most to gain from it.

What it solves: ID3 genre tags do not capture how music actually feels. A track at 1 AM rainy-day-indie-folk-with-acoustic-undertones returns zero results in Jellyfin or Navidrome's search box. AudioMuse-AI fixes that by running CLAP-based acoustic vectorization + lyric embedding across 72 languages on your local library, then exposing a chat interface that translates plain-English mood prompts into actual playlists.

What AudioMuse-AI ships:

- self-hosted Docker / K8s / native (Linux / macOS / Windows) deployment

- direct integration with Jellyfin, Navidrome, LMS / Lyrion, Emby

- 2D interactive Music Map clustering tracks by acoustic similarity

- Song Paths — pick a start track and a destination track, get a sonic bridge playlist

- semantic lyric search across narrative themes, not just keyword matches

Where Atlas fits in: AudioMuse-AI's chat interface and lyric embedding stages need an LLM to convert "late-night rainy driving vibe that transitions from acoustic to electronic pulse" into a structured JSON the local vector index can consume. Running that on a NAS CPU eats 10-30 seconds per message. Routing those requests to Atlas via the OpenAI-compatible config drops latency to sub-second while keeping the heavy audio analysis local.

Config is two env vars + an API key:

- AI_MODEL_PROVIDER=OPENAI

- OPENAI_SERVER_URL=https://api.atlascloud.ai/v1/chat/completions

- OPENAI_MODEL_NAME=qwen3.5:9b (or any LLM in our matrix)

- OPENAI_API_KEY=your_atlas_key

Detail page + full walkthrough: https://www.atlascloud.ai/blog/audiomuse-ai

Drop questions on the lyric embedding model behavior, AVX2 catch on older hardware, or which atlas model handles the playlist intent extraction best.

u/Old_Rock_9457 — 18 days ago

Climatizzatore

Buongiorno a tutti,
In casa mia il climatizzatore (1 split, un motore, Mitsubishi) è stato installato dal proprietario precedente nel 2016.

Lo uso per rinfrescare un piccolo soggiorno ma negli ultimi anni fa molto fatica perché è esposto al sole battente da due lati. Non ho idea se abbia bisogno di manutenzione, se va proprio cambiato o cosa, però essendo vecchio propenderei per il cambiarlo e tagliare la testa al toro. Diciamo che l’aria non esce più fredda come mi aspetterei ma più che altro tiepida.

Secondo voi tra quali marchi , modelli e caratteristiche tecniche dovrei guardare per avere qualcosa di buono ma non “di lusso”? Insomma qualcosa che rinfreschi bene ma che non mi costi un rene ? Lo vorrei definire “un fascia medio-alta”?

Quali potrebbero essere I costi tra condizionatore con motore, installazione e smaltimento del vecchio lungo circa ?

Come potenza dovrei controllare com’è il vecchio, credo che sia un 9000btu, ma se lavorasse meglio e la differenza di costo non è eccessiva anche un 1200btu. Sarebbe nel soggiorno e chiudo tutte le altre porte quando è in funzione, eventualmente se avesse un po di potenza in più non mi dispiacerebbe rinfrescare anche le stanze accanto ma è più un nice to have.

reddit.com
u/Old_Rock_9457 — 30 days ago

WG-easy and mtu

Hi all,
I just installed wg-easy on top of k3s on a vm in cloud, this because my homelab don’t have public ip.
Anyway the problem is that from my iOS smartphone I can load the web page that I need (jellyfin) by cellular connection or home WiFi. When I go on desktop, windows or macOS, it disnt load. I can ping but curl or browser didn’t load it. They instead load the wg-easy webpage without issue.

AI suggest MTU, so I lower it from 1400, the default, to 1280 but the problem is still there. I’m becoming crazy. Is real the mtu the problem ? I’m missing something else ?

reddit.com
u/Old_Rock_9457 — 1 month ago

How do you reach your music server from internet?

Hi all,

I'm curios to know, from who have a music server (Navidrome, Jellyfin or any other), how do you reach it from out of your home.

I started by don't expose it at all and listening music only at home. Then I convinced my wife to use it that listen a lot of music during travel commuted and I had to expose it in some way.

Taliscale free tier was my first implmenetation and I used for different months. The issue was that sometimes it was not so much reactive causing the frontend to just stop working and need a "close and reopen". Off course this meanwhile you drive is not the best.

Yesterday I setup Wireguard easy to give it a try. Still not tested out of home hope it will solve my issue.

Meanwhile I'm curios to know if you had similar problem and how you solved. I would like to avoid to expose Jellyfin diretly on internet.

Edit: just made some download smoke test with and without wireguard and actually seems that the actual cap is my internet connection and not wireguard. In my test the upload bandwith is around 4-5 Mbps that for high quality is too slow, so I activated transcoding to 320 kbps AAC.
Nexts days I'll do some real test cases to look how it go (Now I'm testing iphone on my wifi -> vpn server on internet -> back to ubuntu yo my wifi, and it seems streaming go).

reddit.com
u/Old_Rock_9457 — 1 month ago

yet another talking about AI from one who use AI

I use AI and I have my own open source project developed with the help of it, so I like AI, but I still think that AI make some (highlight on not all) people lazy.

I don't think that lazy is the correct word, but I'm not native english speaker so pass me the terms.

There is out of there very expert engineer (what I'am not) that just dislike using it. For my personal point of view some of them (highlight on not all) are lazy. They contrast a new technology that, if used correctly (highlight on if used correctly) could help by doing useful task.

Then, still out of there, there less expert people, they can surpass the initial wall of technology by getting help of the AI and take their idea become concreate. But some of them (highlight on not all) are lazy, get the easy part of developing code and they don't add on top the good idea and maybe a minimum of checking of what the AI put out.

So for me the result is that lazy people discourage AI, do a bad use of AI, and then the final result is that we are here talking about bad use of AI instead of good AI use. And don't get me wrong: there is a lot of bad use of AI, for this reason people are tired.

This is only my personal feeling, because I read here multiple post of people against AI. Then be a maintainer myself in the last year I had the "big opportunity" of have PR totally written by AI.
In some PR people said me "oh yes, I didn't test it because I don't have the chance to run it", like WHAAAT?
In some other people when asking explanetion on why we need this PR they 100% let the AI reply to me, where the AI basically explained that wasn't useful.

In the beginning of my project, when I got some PR I was super enthusiast because someone was finding my project interesting. Someone was dedicating his time to it.
Now, after one year, when I get a PR I'm worried. I'm worried that is another PR that even don't compile or if compile get error. I'm worried that the time to understand the pr and test it, in some cases (highlight on some) is higher than develop it myself. I'm worried that that other 5000+ line change PR clicking two button on other page, just crash the entire app.

But my worries is not about AI, is about lazy people.

I would like to write that I'm optimistic, but I'm not. But I keep reviewing PR, issue, and other things because I still feel that the power of open source is relay on community. And everyone of us, even lazy people, are part of this community. I feel that that one PR, after 10 no sense PR, will make my day.

To make this thread more constructive I want to add some example of how AI helped me, something more than just wrote the code:

- debug: I the initial part of my project, it helped my a lot on a problem that was depending by architecture. Basically my software, when I updated some dependencies, introduced the hard requirement of have AVX2 on intel cpu, and in the selfhosting community multiple users had old HW and start having the application crashing. It help me in detecting this error very fast. In the last day it also help me in configuring a VM that emulate the absence of AVX2 in order to also test myself.

- brainstorming: I discuss new approch, even university research, to check applicability on my project. With the help of the AI I was able to start from a research that distill a ML model for general Audio, and do my distillation on Music. I started from it and it didn't perform well on Music. Then I search, I read, I gave as input to the AI 10-20-30 other university research. I found research on computer vision that was partially applicable to music, because music are read from computer as spectogram that by the and are image. And after months of research, test, research, I develop my own model.

- documentation: a lot of time you have API, library and so on with low documentation. Sometimes the only documentation is the code itself. Having the Ai able to do an MVP showing an example of how that library work, or how call that library, for me is very usefull.

This are just same example, I would really like also to read yours.

What about you?

reddit.com
u/Old_Rock_9457 — 2 months ago
▲ 83 r/SonicAnalysis+4 crossposts

Hi all,
with this post I want to talk again of AudioMuse-AI, a free and open source selfhostable software to analyze your song and automatically create playlist on your supported music server like Jellyfin, Navidrome (or open subsonic api based), Emby and Lyrion:

With this post I want to celebrate two big things, first of all AudioMuse-Ai born on May 2025, so it's stil live and fully mantained after 1 years, 217 issue closed and 182 PR closed !

We also want to celebrate the new AudioMuse-AI v1.1.0 release that introduce Lyrics Semanthics similarity throug different functionality.

I'm very proud of this release because multiple time we heard that yes the mood is similar but totally different lyrics, now you can search your song also semathically with:

  • Axis-based search: Explore songs across 5 defined semantic axes, selecting one or more values that best describe the target mood or meaning.
  • Text search: Simple natural language queries (e.g., “love”, “run”) focused on lyrical meaning, not musical groove (distinct from DCLAP search).
  • Song similarity search: Use a reference track to find similar songs, weighted by default as 75% lyrical meaning and 25% audio similarity to preserve genre consistency.

Lyrics functionality off course need lyrics, the best way is to have already them in your music server OR configure in AudioMuse-AI your favourite API in the setup wizard:

Example API formats supported in Setup Wizard:

https://api.example.com/get?artist={artist}&title={title}
https://api.example.com/v1/{artist}/{title}

Anyway as a fallback is also supported the transcription with Whisper Small and if needed can be disabled in the setup wizard by setting LYRICS_ENABLED=true

Important: after the update a new analysis will do the Lyrics analysis on the already analyzed song (if enabled, enabled by default) or a full analysis (Musicnn + Clap + Lyrics) for new song. This new analysis is mandatory to use the new functionality.

I hope you will like both of this milestone and as usual, if you want to support AudioMuse-AI, please add a start on the github repository.
Thanks to be with us for our first year!

u/Old_Rock_9457 — 11 hours ago