Open source conversational analytics tool for BigQuery?

Hi all,

Has anyone found a decent open source tool for asking questions in plain English on top of BigQuery? Something self hosted.

I tried Gemini in BigQuery and had a look at the conversational analytics API. The API gives you back SQL and a chart spec, so you still end up building the front end yourself, which is the part I was hoping to avoid.

My main worry is the numbers. If two people ask for revenue in slightly different words I'd like them to get the same answer, and I don't see how that works unless the metrics are defined somewhere.

The other thing is cost. I have no feel for how many queries a single question turns into once the model starts looking around the schema.

reddit.com
u/1glasspaani — 13 days ago

PMs building AI products: what does your actual workflow look like?

Curious how PMs here are approaching building AI products, whether that’s agents, copilots, or features where the AI output is core to the experience.

How do you define “good enough to ship,” and how do you know the product is getting better once people start using it?

A few things I’d love to hear about:

  • Tools: What are you using for analytics, reviewing conversations/traces, and running evals? Which tools do you personally use as a PM?
  • Metrics: Beyond adoption and retention, are you tracking task completion, how often users correct outputs, human handoffs, or cost per successful task? What actually influences your roadmap?
  • Evals: Are you writing test cases and defining scoring criteria yourself, or does engineering own that? How do real user failures make it into your eval set?
  • Shipping: What evidence makes you comfortable releasing a prompt or model change? Have you seen eval scores improve without the user experience improving?

I found a few PostHog blogs helpful, but I’d love to understand what this looks like in other teams day to day.

If you can share what you’re building and one concrete example of how feedback or an eval changed what you shipped, that would be really useful.

reddit.com
u/1glasspaani — 29 days ago
▲ 31 r/LocalLLM+1 crossposts

I'm fine-tuning a Open Weight model for Generative UI. SFT slowed it down; self-training fixed it.

I’m on the OpenUI team. We’re training a model to generate working interfaces on consumer GPUs. We started with DiffusionGemma for its speed, then worked on getting its output to actually parse.

Our first LoRA used ~700 examples generated by larger models. Training loss dropped, but benchmark performance got worse: the model wrote longer programs with broken component props and references.

Training on a single component library improved structural validity from 13% to 28.8%, but generation slowed from 1.6s to 4.3s. Outputs were longer and needed roughly twice as many denoising steps per token.

So we tried a self-training loop:

  • Generate programs with the current model.
  • Use the OpenUI Lang parser to accept valid outputs and identify defects in the rest.
  • Repair only those defects, rejecting broad rewrites. Check the survivors against their prompts with a judge.
  • Fine-tune on the accepted examples and repeat.

The median repair changed one statement. Each training pass took 1–2 hours on one A100.

Structural validity reached 57.1%, while generation fell to 1.9s, with outputs still longer than the base model’s. Timings used the same 20 light prompts on one A100 at FP8.

Repeating the recipe across 27 component libraries brought the final model, OUI-1, to 71.7%. That measures structural validity, so it doesn’t guarantee a good-looking UI or complete task fulfillment.

Blog, weights, and benchmark.

Would love to discuss if someone has done something similar.

u/1glasspaani — 1 month ago
▲ 3 r/AIToolsPerformance+2 crossposts

Looking for feedback on our Generative UI benchmark

Most Generative UI demos show a successful output. We wanted to measure a less glamorous but more practical question: across repeated runs, how often does a model produce UI that actually parses, resolves, validates, and renders?

So we built GenUI Bench.

The current benchmark includes:

- 46 screen briefs, ranging from 2 to 18 requirements

- a shared 70-component surface

- 4 attempts per brief under fixed generation settings

- 30 models tested with OpenUI

- a 6-model comparison across OpenUI Lang, Google A2UI, and Vercel's json-render

- validation using each format's own SDK, followed by the same structural completeness checks

A few important caveats:

- This measures structural reliability, not visual quality.

- It does not yet verify that every requirement in the brief was semantically satisfied.

GitHub: https://github.com/thesysdev/generative-ui-bench

u/1glasspaani — 1 month ago

I built an OSS app that generates screens in realtime based on user intent

What if there were no apps to install and no menus to learn?

You simply describe what you want, and the interface is generated on the fly: a weather dashboard, a restaurant finder with live search, a booking form, a chat thread, or whatever else fits the task.

I've been experimenting with real-time Generative UI using Cerebras models, which can stream at up to 1,800 tokens/sec. The speed makes it feel much closer to interacting with a native app than waiting for an AI to finish generating.

This is a direction similar to what Monogram AI is exploring, but would love to know what you think about it.

Link to repo https://github.com/thesysdev/appless

u/1glasspaani — 2 months ago

How it feels using Codex usage resets between intense coding sessions

Tibo to the rescue

u/1glasspaani — 3 months ago

OpenClaw OS gives you workspace to build apps, dashboards, documents and more

Your OpenClaw can already do the work. But is the work getting buried inside Telegram chat?

Meet OpenClaw OS,, an open-source workspace with:

✨ Apps that persist and connect to live data (revenue dashboard, monitor sprints)

✨ Files and documents kept as named artifacts, not buried in chat history

✨ Charts, forms, and tables in chat instead of walls of text

We would love your support on PH

https://www.producthunt.com/products/thesys?launch=openclaw-os-2

u/1glasspaani — 5 months ago

My OSS project just hit 5k stars, and the first 1k mostly came from r/SideProject. Huge thanks to this community 🙏

About a month ago, I posted a silly GIF about how Google Chrome was flagging our domain as phishing because the name was similar to a niche AI non-profit. That post somehow blew up and brought a ton of people in to try us out.

A huge thanks to everyone here for being part of this journey. The early feedback, the stars, the bug reports, all of it meant a lot.

Also, AMA if you're building OSS. Happy to share my experiences.

u/1glasspaani — 5 months ago
▲ 8 r/myclaw

Building Claude Cowork with OpenClaw

Introducing OpenClaw OS: a Claude Cowork equivalent, built as an OpenClaw plugin.

It lets you create live artifacts that connect to datasources instead of datasets. (eg: fetching Stripe data automatically)

Other tools(Paperclip, Multica) focus on task management but our vision is to build one screen that feels like the SaaS tools you already love using.

It’s OSS, so please check it out lmk

http://github.com/thesysdev/openclaw-os

u/1glasspaani — 5 months ago

OpenClaw has outgrown chat, hear me out

My OpenClaw is a month old and it's already running lot of my workflows. Drafting emails,, summarizing my Slack threads, kicking off cron jobs that run all week. By any measure, it works.

The problem is I'm having trouble managing the work.

I run OpenClaw through a Telegram, like most people seem to. Whatever the agent does ends up living in that thread. The chart it generated on Tuesday is somewhere up there. When I want to come back to something, I scroll. When I can't find it, I ask again, and the agent rebuilds it slightly differently because models drift.

I ended up hacking together my own little web dashboard for it. I'm able to build mini apps for my workflows. Nothing fancy, just for my own use. But it's been a way bigger quality-of-life jump than I expected, and it made me think this kind of thing should be a default, not something everyone has to build for themselves.

A few people are clearly thinking about this from different angles. Paperclip (paperclip.ing) frames it as a company, and you're managing the board. Multica (multica.ai) frames it as project management: agents show up in the assignee picker next to humans, basically Linear for agents+humans. Both are interesting.

We probably need a better UI or form factor for working with agents. A standard, so whatever I run my agent in (OpenClaw, Claude Code, the one who shall not be named and whatever comes next) just plugs into the same UI and I'm not starting from scratch.

Would love to know how you are dealing with this.

reddit.com
u/1glasspaani — 5 months ago

Hi, folks my team and I have working on making AI generate respond with contextual UI. With OpenUI framework, your AI Agent will respond with charts and form based on the conversation.
We open sourced the framework last month after building in this space for more than a year.
You can bring your own components (shadcn/radix), frameworks (react,vue) and models.
Please check it out and let me know your thoughts.
https://github.com/thesysdev/openui/

u/1glasspaani — 5 months ago
▲ 7 r/vercel

Can't add auth since this was meant to be a simple demo.

A few IPs were spamming the bot. Enabled Block in Vercel, requests stopped briefly, then resumed from multiple new IPs.

Any other solutions, or should I just take the agent down for now?

u/1glasspaani — 5 months ago

I have tried posting on the forum but I rarely get any engagement.
Do I need certain amount on KP to get my posts recommended to other PH users?

reddit.com
u/1glasspaani — 6 months ago

Do you use Telegram/WhatsApp, Discord, OpenWebUI, the OpenClaw UI, or a third-party like Paperclip? trying to figure out if we actually need better interfaces to manage agents, or if the existing chat apps are good enough for daily work

reddit.com
u/1glasspaani — 6 months ago

Should I build this?

Every OpenClaw is a different entity. different skills, different cron jobs, different way of talking to you.

but they all look the same.

idea: a skill that lets the Claw theme its own chat UI based on its personality.

  • chaotic Claw running 40 cron jobs → maximalist dashboard, stuff blinking, dense
  • minimalist productivity Claw → monospace, whitespace, muted palette
  • late-night-coding gremlin Claw → green-on-black terminal, too many emojis
  • the haiku one → serif type, lots of margin, single column

and because it's Claw, the theming is just another skill. it picks its own colors, type, density, motion.

drop a comment if you'd install this. enough interest and i'll ship it.

reddit.com
u/1glasspaani — 6 months ago