u/koc_Z3

I’m getting a Mac with M1 Max 64GB unified mem 10cpu and 24gpu cores very soon, omlx will give me around 10 tks, are there alternatives that could speed this up a bit?

I’m getting a Mac with M1 Max 64GB unified mem 10cpu and 24gpu cores very soon, omlx will give me around 10 tks, are there alternatives that could speed this up a bit?

The Mac-only integration follows July's regulatory approval to bring Apple Intelligence to China

By
 
[**Pareesa Afreen**](https://www.thenews.com.pk/writer/pareesa-afreen)
Published August 08, 2026


*Apple lets China Mac users connect Siri to Alibaba's Qwen*
Apple has quietly published a guide showing eligible Mac users in mainland China how to plug Alibaba's Qwen AI models into Siri and Writing Tools, extending a China-specific Apple Intelligence partnership that first cleared regulatory approval in July.
Based on the updated Chinese language document by Apple, users who choose to sign up will have access to more descriptive answers by Siri, including photo and document analyses, as well as rely on Qwen to produce texts and images based on descriptions provided.
This app extension needs a minimum of macOS 26.6 and also activation and login into a new Qwen account. According to the document by Apple, Alibaba is not allowed to use any of that information for training their models.
Apple’s Mac computer shipments were down by 9% to around 800,000 units compared to last year during the first quarter, which has Apple accounting for only 9% of the PC market, according to Omdia, a research company.
Lenovo had 31%, with its Tianxi AI assistant at the centre of its business plans, and Huawei managed to secure 16% of market share with its AI strategy that is linked to HarmonyOS. Linking Siri and writing tools to a compatible AI assistant is how Apple can narrow this gap.
For Alibaba, plugging Qwen into Apple's built-in software extends its reach well beyond its own apps and cloud platform. Alibaba has said Qwen will eventually power Apple Intelligence across iPhone, iPad, Mac and Vision Pro devices in China, though Friday's guide covers Macs exclusively.
The company released its newest model, Qwen3.8-Max, a 2.4-trillion-parameter system it describes as its most capable yet, earlier in the week, though Apple's documentation doesn't specify which Qwen version actually powers the Mac extension.

Alibaba plans to require large commercial users of the open-weight version of its Qwen3.8-Max AI model to share a portion of the revenue they generate from it, according to Reuters, citing two people familiar with the company's plans.
The company intends to roll out the measure alongside the open-weight release of Qwen3.8-Max, which Reuters reports is expected next week. The specific revenue-share rate has not been finalized, as negotiations are ongoing.

The move follows a similar licensing approach taken by Chinese AI startup Moonshot for its Kimi K3 model. Moonshot's terms require any party selling Kimi K3 as a service and generating more than $20 million in annual revenue to reach a commercial agreement with Moonshot. That agreement can include a revenue share of up to 30%, Reuters reports, citing one of the people familiar with the matter. Chinasoft International disclosed a revenue-sharing agreement with Moonshot in a regulatory filing last month, without specifying a percentage.
Until now, Alibaba has charged developers for using its models through its own cloud platform, while allowing most open-weight deployments in customers' own data centers without a fee. If implemented, the change would bring revenue expectations to commercial deployments that currently operate beyond the reach of Alibaba Cloud.
Alibaba released Qwen3.8-Max earlier this week, describing it as its most capable model to date, with 2.4 trillion total parameters and 95 billion active parameters. The release marked the first time Alibaba has open-sourced a model at this scale, with open weights planned for next week. Alibaba stock rose 4.5% in premarket trading in New York and 7% on the Hong Kong exchange following the announcement.

DigitalOcean CEO Paddy Srinivasan, whose company is among several U.S. firms that carry Kimi K3 and other Chinese AI models, acknowledged that DigitalOcean has struck a commercial arrangement with Moonshot, though he would not elaborate on its terms. "This is a tried and tested open-source 'freemium' model," Srinivasan said.
Dan Fu, vice president of kernels at Together AI, said that AI software providers find their revenue in the efficiency gains they deliver around tokens — the fundamental units that AI systems use to process queries. "At the application layer, there's value out there for how you use it, how you actually get the models and the tokens to do something useful," Fu said.

The Mac-only integration follows July's regulatory approval to bring Apple Intelligence to China

By
 
Pareesa Afreen
Published August 08, 2026


Apple lets China Mac users connect Siri to Alibaba's Qwen
Apple has quietly published a guide showing eligible Mac users in mainland China how to plug Alibaba's Qwen AI models into Siri and Writing Tools, extending a China-specific Apple Intelligence partnership that first cleared regulatory approval in July.
Based on the updated Chinese language document by Apple, users who choose to sign up will have access to more descriptive answers by Siri, including photo and document analyses, as well as rely on Qwen to produce texts and images based on descriptions provided.
This app extension needs a minimum of macOS 26.6 and also activation and login into a new Qwen account. According to the document by Apple, Alibaba is not allowed to use any of that information for training their models.
Apple’s Mac computer shipments were down by 9% to around 800,000 units compared to last year during the first quarter, which has Apple accounting for only 9% of the PC market, according to Omdia, a research company.
Lenovo had 31%, with its Tianxi AI assistant at the centre of its business plans, and Huawei managed to secure 16% of market share with its AI strategy that is linked to HarmonyOS. Linking Siri and writing tools to a compatible AI assistant is how Apple can narrow this gap.
For Alibaba, plugging Qwen into Apple's built-in software extends its reach well beyond its own apps and cloud platform. Alibaba has said Qwen will eventually power Apple Intelligence across iPhone, iPad, Mac and Vision Pro devices in China, though Friday's guide covers Macs exclusively.
The company released its newest model, Qwen3.8-Max, a 2.4-trillion-parameter system it describes as its most capable yet, earlier in the week, though Apple's documentation doesn't specify which Qwen version actually powers the Mac extension.

I wrote a skill for Hermes Agent.

This reduces errors and hallucination when configuring the config.yaml file.

Github repo here:

https://github.com/koc-Z3/hermes-docs

I assume either Qwen3-Coder-480B-A35B OR 3.5 models?

https://preview.redd.it/yw41s1jikefh1.png?width=1942&format=png&auto=webp&s=3a180ae6443c1db9f7b0ce621533a4b2aa553921

Hi,
I've been running Ollama on my Unraid server since the llama2 era. I use to be able to run qwen3.5 and then 3.6 27b with 32k context, barely but it was fitting. The other day I notice that the VRAM usage was WAY lower than I remembered.

So I kept increasing the context window, hitting 128k at 83% VRAM usage ! How ? Can I go further ?

I'm using the model in opencode right now and the token count goes up to 131072 before the awnser automatically stop (an issue I had before, but at 32k used) all this without using the system RAM and keeping a healthy 30 tok/s (sys ram would be 4 tok/s).

I'm using OLLAMA_FLASH_ATTENTION=1 and OLLAMA_KV_CACHE_TYPE=q4_0 as well.

Is this just an hallucination ?

edit : qwen3.6 Q4, or Q5 with 96K context works too!

Can’t wait for this.

Edit: Qwen4 27b/ 35b possibly?