Intel Arc Pro B70 - Looking for LLM Setup Guidance and Lessons Learned
We have embarked on the B70 journey. Since we have a spare Dell R740 this was a good candidate. Ordered and installed 1 B70 and if we can get everything working well we will likely go with 1 or 2 more. Server has plenty of memory and the absolute best Platinum CPUs for the generation. Hardware is all working well. Looking for setup guidance based on Intel's latest releases. Apparently they have a pre-compiled Ubuntu 25.04 distro that has drivers, etc., pre-installed. Also, pre-defined Dockers too. Help on next steps.
Found these sites that have a lot of the Intel development efforts:
llm-scaler/vllm at main · intel/llm-scaler
intel/llm-scaler-vllm - Docker Image
vLLM on Intel XPU | intel/ai-containers | DeepWiki
So, where to from here? Anyone else running any of this on their B70?