Little show-off of my LLM build.
Relevant Specs:
2x MI50 16GB (Capped at 150W)
Intel Xeon E5-2680 v4 14/28
32GB DDR4 RAM
Using llama.cpp with Qwen3.8-27B-UD-Q5_K_XL (MTP) i reach about ~20t/s. it can go up to ~30t/s depending on the workload, especially if i remove the Powercap.
All in all this build cost me ~650€ including case, PSU, ram, gpus, cpu and fans.
Title says most of it.
I tried enabling the 4G Decoding but it didnt help. The MI50 itself has more than sufficient power. My Mainboard is a Machinist MR9A Pro Max.
It beeps like 9 times does long beep then 4 short ones, resets my bios settings and stays on code Ab/A6. I dont have the resources to test the GPU on another PC currently. If any of you has encountered this before id really appreciate some pointers on how to debug this.
Good evening,
I've been planning to build an LLM server for running agentic coding models, and I've narrowed my options down to these two GPUs.
My plan is to add a second card of the same model in the future, but I need to start somewhere while staying within a modest budget.
My main concern is prompt processing speed, since that seems to be one of the most important factors for agentic coding workloads. I haven't been able to find any official benchmarks comparing these two cards, though. If anyone has any insights or first-hand experience, I'd really appreciate it!
Currently doing my Masters in IT, specialized in Embedded Systems development.
I have been exploring the state of high-end LLM Models like Claude and Codex, and its making me wonder. Are we still needed ? I see Opus 4.8 and Fable 5 absolutely being faster and better than me in almost any case. The only advantage i have is being able to actually touch the hardware, with some smart tooling (See https://www.reddit.com/r/embedded/comments/1twhd48/built_an_opensource_openhardware_allinone_bench/ as example), this can also be done.
The main reason for this post ist asking: What are you thoughts and experiences in this regard ?
For 2 days now i have been trying to get the GC2145 to work on the DK but no matter what i do i only get /dev/video0 but never /dev/media0
I use Buildroot with the Linux kernel on ST's Github. I have followed this guide here: https://wiki.st.com/stm32mpu/wiki/STM32MP13_V4L2_camera_overview and i have all the Kernel modules needed activated.
I know the camera is plugged in properly because the demo from ST works but theres no code or config that goes along that demo for me to find the issue, at least i could not find it.
I will attach a little bit of debug info at the bottom if its any helpful:
# dmesg | grep -i gc2145
[ 0.058299] /soc/bus@5c007000/i2c@4c006000/stmipi@14: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/gc2145@3c
[ 0.058443] /soc/bus@5c007000/i2c@4c006000/gc2145@3c: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/stmipi@14
[ 0.069826] /soc/bus@5c007000/i2c@4c006000/stmipi@14: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/gc2145@3c
[ 0.069991] /soc/bus@5c007000/i2c@4c006000/gc2145@3c: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/stmipi@14
[ 0.073727] /soc/bus@5c007000/i2c@4c006000/stmipi@14: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/gc2145@3c
[ 0.073902] /soc/bus@5c007000/i2c@4c006000/gc2145@3c: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/stmipi@14
[ 0.480790] /soc/bus@5c007000/i2c@4c006000/stmipi@14: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/gc2145@3c
[ 0.512666] /soc/bus@5c007000/i2c@4c006000/stmipi@14: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/gc2145@3c
[ 0.513049] /soc/bus@5c007000/i2c@4c006000/gc2145@3c: Fixed dependency cycle(s) with /soc/bus@5c007000/i2c@4c006000/stmipi@14
# v4l2-ctl --list-devices
stm32_dcmipp (platform:5a000000.dcmipp):
/dev/video0
I really appreciate any help!