I have what I assume is a simple fix, but the only garage within walking distance from me couldn’t fix it. When I lived down south, it was easy to find garages that would send someone to you but I haven’t heard of that since moving up here.
Just wondering if that’s a thing up here. I’m in Carthage.
I have a premium subscription at work, which gives me webchat and full integration across my msid. My role has no access to anything genetic, it’s all webchat.
My main use for copilot is analyzing call transcripts or batches of transcripts to pull out very specific information in a very specific way, and the size of my prompts can run tens of thousands of characters. Using well made, heavily workshopped prompts has made easy work out of a lot of heavy tasks that used to take us weeks or months to complete. The only problem is sharing them with teammates who aren’t as savvy or as patient with this kind of stuff.
If I could put all those instructions and definitions and everything else into a persistent set of instructions, we would only have to drop in our unique inputs and it would be extremely intuitive. But when I put these same instructions into an agent, I almost never get a perfect response out of it. When paired with a prompt, I have never once had it mess up the format of a response unless it gets truncated. An agent with the same instructions will forget halfway through, apply random changes, or just break out of it and start commentating.
Do these webchat agents just run from a weaker model? Is there something about how it references the instructions that is not as thorough as they are when directly stated on the first turn? And is it a matter of taking a different approach, or is it just a different pipeline that isn’t suited for this level of energy going into a single turn?
I use copilot for a lot of heavy, repetitive processing tasks. I have thousands of transcript files that are batched into large text files about 100 KB, then fed with a prompt that tells it exactly how to read each one, what to look for, and which datapoints to return back. It’s very repetitive but insanely effective.
I’m on Premium through a work account and as far as I know, token use isn’t metered. I used to be able to push about 150 loaded prompts through before it would shut down and tell me to come back in an hour. That just became the workflow - max out copilot as fast as I can, do other work on the time outs, then push more batch files as soon as it’s back. If I was on point, I could run well over 10,000 transcripts a day.
Lately, there seems to be an extra layer on the rate limit, and I’m not sure how it works. While I might have gotten 150 prompts through before getting told outright “you’re doing this too much, come back later”, now I’m lucky to get 40 through. And I don’t get the same message, just “Oops! Something went wrong! Try again.” It’s like something else is tripping first now before the built in rate limit.
The policies and the capabilities of these services has always been pretty fluid and poorly defined. Terms are kept vague and I haven’t found anything within my org defining reasonable use, limitations or anything like that. Does anybody have any insight as to what this change was? Was this likely the result of a tightening restriction of the service, or was I flagged for excessive use and limited more aggressively than others?
My role has evolved into that of an analyst, but we don’t have the tools or insights that other analysts in the company have. This is a huge company and I’ve been attacking that from all sides already, but I don’t have high hopes.
When I started in this position, we pretty much just QA’ed calls and handled however many calls you could listen to during a day. 80-100 at best if we’re optimizing and running 2x speed. Over time as the dumpster fires started spreading and multiplying across all our clients, the requests started coming in harder and harder, and the stakes keep getting higher. Now we’re drowning in requests, and some of them are heavy, like give me all the calls where xxx was discussed from January to now using only metadata and phrase searching. The people making the requests clearly have no background in data, but we repeatedly tell them what our capabilities are and it hasn’t slowed them at all.
The obvious answer is to just quit, or do what I can,
but this was my first shot at an off the phones position in my entire adult life and I need to be successful and build enough experience to stay off the phones if this goes bad.
I’ve managed to put together a decent and effective workflow using just VBA, PowerShell, JavaScript and CoPilot premium. Vibe coded through and through, but I’m not an idiot and it helps. I rigged something together to scrape the transcripts from the media files, batch them into text files capped on their size (varying by the size of the workload we’re running them through), then I build highly structured prompts for CoPilot to review the batch files, and give me whatever datapoints I’m looking for in JSONL format.
We don’t have agents, and we don’t have PowerAutomate, and as far as I can find there are no hooks on the webchat to automate prompts. The best I’ve been able to do is automate the clipboard and push them through 25-50 copilot tabs back to back, paste the outputs as rows on excel, then unpack them at the end using a macro. It’s a lot of annoying work but it turns 80 calls a day into 20,000 calls a day. I get rate limited after about 150 prompts and have to wait an hour to do more, and some projects have me running thousands of batches so it’s a lot of time just waiting out cooldowns.
My assumption is that VBA, PowerShell, JavaScript, CoPilot Premium, and maybe, MAYBE Python if I’m lucky, are the only tools I’ll get my hands on. I can’t do browser extensions, or anything that requires an install or a .exe file. My department was not built for this, so I have nobody I can talk to, and nobody who understands anything about what I’m doing.
It seems like almost certain that my use of CoPilot exceeds whatever reasonable use standards are on our TOS. The throughput I’m pulling would cost thousands a week if we were paying by the token, but this is just a $24 a month flat rate subscription. This stuff is all new to me, so as this keeps evolving, I’m getting increasingly worried this is not sustainable, and somebody’s going to pull the plug on my access (or worse).
I guess my questions for anybody who actually knows the ropes for this stuff would be:
1.) Assuming access to better subscriptions or tools is off the table, are there more efficient ways to tackle this sort of analysis? Tools that are likely available that I haven’t mentioned here worth looking into? Any actual automation hooks I could use to initiate prompts and collect the outputs without the standard tracks like agents or PowerAutomate?
2.) Does this type of behavior seem like a risk, in terms of violating rules or overstepping in any way?
I’ve tried reaching out to my management and I’ve tried navigating the absolute clusterfuck of TOS and other documentation both from Microsoft and our company’s docs but I’m not really finding anything that addresses my situation.
I feel like I’m all alone in a high stakes situation. I’ve built a lot out of nothing and I’m both afraid of losing it and afraid I’m not taking the best path. I’d gladly listen to any thoughts from anyone who knows the game. Thank you for reading.
I live in the Watertown area and our healthcare situation is terrible. My girlfriend has had anxiety so bad she can’t keep food down for months. It still took us months to get in with a behavioral health place, and when we did, we went with Medicaid providers and got a revolving door of social workers, counselors and NPs who hated their lives and seemed to be reading directly from a Google search. Her health just keeps getting worse and it feels like it’s solely on us to find a way through it.
Anyway, we’re interested in trying EMDR and we don’t have any more time to get our foot in the door some place just to find out the provider is actually two kids in a giant lab coat. We’ll pay out of pocket for an experienced EMDR therapist who is good at what they do, and we will drive anywhere we can to do this sooner rather than later.
Can anybody recommend us a good quality EMDR provider in upstate ny?