u/Hot_Significance4608

I had a hard transformation to make.
Pandas was too slow.
Polars looked faster.
I wanted the machine to do the work.

The built-in copilot could not carry the load.
Too small. Too careful.
No frontier models. No long leash.

I could use the Pi harness to write the code.
That part was easy.
The hard part came after.

The notebook failed.
I read the errors.
I fixed the code.
I ran it again.

After a while, I became the bottleneck.

So I asked a simple question:

Is there a better way?

There was no clean way to expose Fabric notebooks to a coding agent.
At least not officially.

But there was VS Code.
There was the Fabric CLI.
There was the SQL analytics endpoint.

That felt like enough.

So I built around them.

The CLI edits the notebooks.
The CLI runs them too.
Livy works as well, though it fights you on some lakehouse writes.

I added a custom Python tool.
Clanker generated it.
It catches cell-level execution and errors.

The harness reads the errors.
Tries again.
Runs again.
Repeats until the notebook executes cleanly.

Then the SQL endpoint checks the transformed data.

After that, I define test cases.
The harness keeps iterating until every test passes.

Closed loop.

The code is here: https://github.com/goreavin/fabric-closed-loop

It works for me.

If you find sharper edges, smoother paths, or stranger failures, change it.
Commit your edge cases.
Let the next person suffer less.

reddit.com
u/Hot_Significance4608 — 18 days ago