u/sobomunabhi

Our twins sleep in separate rooms and I'm up half the night walking back and forth checking on both. I'd like one monitor with two cameras so I can see both rooms on one screen.

I've been looking at Vtech, Comfyer since they have a large 7 inch screen and dual-camera, but I don't know much about them. Has anyone actually used one? Any pros and cons?

Thanks guys!

we had an agent sitting at ~96% on the same eval set for months.

green builds.

model upgrades passed.

prompt changes passed.

meanwhile production incidents started looking like:

- users asking much longer multi-part questions
- new tool combinations the original dataset never covered
- policy changed but half the expected answers didn't
- new slang / weird phrasing from an audience we didn't have six months ago
- prompt injection through retrieved content
- agent using a newly-added tool in a way nobody anticipated

the model hadn't “beaten” the benchmark.

the benchmark had stopped describing production.

I think calling these things golden datasets makes people subconsciously treat them like they're supposed to be frozen forever.

but if you continuously rewrite the set, you lose comparability too.

so I'm leaning toward two layers.

small frozen core

cases that represent fundamental behavior and basically never disappear.

auth boundaries
permissions
critical business rules
known catastrophic failures
canonical happy paths

then a rolling regression set fed by production.

something breaks in prod:
sanitize it
remove PII
preserve the failure pattern
turn it into a scenario
tag the feature/failure class
run it forever or until the behavior is intentionally retired

plus periodically cluster recent failures/traffic and look for entire categories your dataset doesn't represent.

TestMu Agent Testing fits pretty naturally into this loop for us because it can generate larger scenario sets from the agent requirements and run them against the actual endpoint.

for voice/phone, production recordings can also be analysed to expose failure patterns that can feed future regression coverage.

but I definitely would not auto-promote every weird production interaction into “gold”.

someone still has to decide:

was this actually a failure?
is it important enough to preserve?
what behavior should we expect next time?

and every eval run needs ridiculous amounts of version metadata:

agent
model
prompt
tools
dataset
judge/evaluator

otherwise 94% last month vs 91% today can mean almost anything.

a frozen benchmark tells you whether you changed.

a rolling dataset tells you whether you still resemble reality.

I think you need both.

how often are people actually refreshing their agent eval datasets, and what makes a production failure worthy of entering the golden set?

run an options bot, banknifty mostly. every expiry afternoon my websocket reconnects 3-4 times during the worst possible window and my position tracking drifts.

ive done the reconnect logic, heartbeats, backoff, all of it. still happens. is this just every broker or is there one that actually stays connected when it matters. whatnow

Planning a 6-person Portugal trip.

Current division of labour:

1 person checking flights
1 person building the itinerary
2 people sending Lisbon reels
1 person saying “anything works for me”
1 person rejecting every hotel after contributing nothing

Then someone casually revealed their budget was half of everyone else’s.

Moved the working trip into Zenvoya so people could comment and vote on the same hotels/stops instead of restarting the argument in WhatsApp every night.

Only the person who created the itinerary can edit it, which honestly feels less like a limitation and more like basic public safety.

The vote currently says Lisbon + Porto.

The group chat currently says Lisbon + Porto + Algarve + Madrid “because we’re already nearby.”

At what group size do you stop pretending this is a democracy and just appoint one travel dictator?

Hey, everyone! I’m M18 and I graduated from High School, last April, this year. I decided to take a gap year and not enroll in college for a while, due to financial and personal reasons.

I have been unemployed for the last 3-4 months. Though I’m trying to look for a job—applying through online and through walk-ins, it’s really hard/rare to find one, since most of the companies (in the PH) have strict requirements.

For now, I’m helping my mom with her weekly dialysis, cleaning the house, and babysitting my niece. At first, it was nice, because I now get to help my mom with the house chores (I was sooooo busy at school). But then, as time goes by, I get exhausted and burnt out, considering the fact that I still haven’t got a job and I’m stuck in a cycle where I do the same thing everyday. I feel guilty because I really want to get a job to help my mom with her meds.

My question is, what can I do/do you do to overcome this challenges? I’m trying to distract myself by taking up hobbies, but I get bored so easily. Though, I enjoy watching vlogs and TikToks, but it makes me unproductive (doomscrolling). Any suggestions on what things I should do to not feel unmotivated or discouraged? Thank you!!