SORbench.com thoughts? GPT 5.5 vs Deployment Agent
been seeing Mando’s SORBench whitepaper floating around on linkedin but haven’t really seen anyone talk about it here, so figured i’d share since this sub will probably have a better read on it.
for context we've internally been trying a few different AI tools for workday research / config style questions. my rough take so far:
Deployment Agent is interesting but feels more useful when you’re already inside a pretty defined workday flow. GPT 5.5 is good for explaining concepts or helping think through a problem, but for actual Workday-specific answers i still have to verify everything myself. Community's AI is useful when it surfaces the right thing... but it still feels hit or miss depending on the question (and complexity).
Mando has honestly been the one we’ve kept coming back to for research. mostly because of the reasoning ability + citations. if i ask about some random config question/tenant edge case, etc, i can actually see where the answer is coming from instead of just trusting the model. the expert-verified part is great to see the experts who validated the answer too.
The SORBench whitepaper compares GPT 5.5, Workday Deployment Agent, and Workday Community AI on real admin style questions. thought it was interesting because it lines up with a lot of what i’ve felt using these tools... especially that generic AI can sound right but isn’t always that useful without the right sources.
obviously it’s their own benchmark so i’m curious how people here read the methodology/results. has anyone else looked at it or used any of these tools in actual workday work seeing something similar?
link: https://sorbench.com/
ps- we initially had trouble accessing the whitepaper itself because it got sent to spam, check junk and you should be good