u/gerenate

What do you think of ai doing groceries for some ppl like ordering from walmart?

I'm so done with seeing AI slop. Reading AI writing feels like sniffing puke. I believe this is because of a lack of expertise, a lack of taste and a lack of individuality.

Imagine this, what if everyone was as amazing of a painter as Picasso; or could compose music like Bach. On the surface this would be nice, but now suppose some people are constantly playing an instrument and always the same Bach-like tunes.

Then we would hate Bach, Picasso...

AI agents are like this. They need individuality, they need expertise, and taste. Taste comes from individuality. That's why I'm making this community, so that everyone can contribute their own ways of doing things, their own versions of what's valuable in a given task output.

Why do you care to make better skills?

Good

- comprehensive

- frequently updated

- evals are bundled together (althought there's no space for it in skill spec lol)

# Example Eval
{
      "id": 1,
      "prompt": "Help me create a sales deck for our B2B SaaS product. We sell an employee engagement platform to HR directors at companies with 500-5000 employees. Our main differentiator is real-time pulse surveys with AI-powered insights.",
      "expected_output": "Should check for product-marketing.md first. Should apply the 10-12 slide sales deck framework: Title, Problem/Stakes, Current Solutions Failing, Vision, Product/Solution, How It Works, Proof (case studies/metrics), Pricing, Why Now, and Next Steps. Should tailor the deck to the HR director audience and employee engagement space. Should incorporate the differentiator (real-time pulse surveys + AI insights). Should provide slide-by-slide content recommendations with speaker notes. Should recommend visual direction.",
      "assertions": [
        "Checks for product-marketing.md",
        "Applies 10-12 slide framework",
        "Includes Problem, Solution, Proof, Pricing, Next Steps slides",
        "Tailors to HR director audience",
        "Incorporates stated differentiator",
        "Provides slide-by-slide content",
        "Includes speaker notes or talking points"
      ],
      "files": []
    },

Bad

- There's no script to run these evals. Also if it's running on the default harnesses (claude code or codex), how is leakage prevented lol? Regex on traces would make a more deterministic, a more comprehensive rubric would be better for scoring and give partial marks.

- I'm split on whether comprehensive skill packs are better or should people focus on one narrow task and make a really really good skill on that. Linux do one thing well vs microsoft's do all but kinda garbage is being replayed lol.

What do you guys think of this skill pack? What should I review next?

What do you guys think of methods like this?

https://microsoft.github.io/SkillOpt/

As far as I understand, they optimize in the skill prompt space as opposed to the parameters of the model. This requires one to have a robust eval.

Good parts of it are that it works across models if you have a good eval. These days I've been thinking that evals are a better thing to build, and then synthesize the skill from the eval?

Idk, is it even applicable? Building evals is somewhat difficult to get right. Getting the right difficulty is hard and preventing leakage is also hard.

[ Removed by Reddit on account of violating the content policy. ]

[ Removed by Reddit on account of violating the content policy. ]

Hey everyone! I'm u/gerenate, a founding moderator of r/skillfully.
This is our new home for all things related to making better agent skills. We're excited to have you join us!

What to Post
Post anything that you think the community would find interesting, helpful, or inspiring. Feel free to share your thoughts, photos, or questions about the agent skills you made or methods you found for making better agent skills.

Community Vibe
We're all about being friendly, constructive, and inclusive. Let's build a space where everyone feels comfortable sharing and connecting.

How to Get Started

1. Introduce yourself in the comments below.
2. Post something today! Even a simple question can spark a great conversation.
3. If you know someone who would love this community, invite them to join.
4. Interested in helping out? We're always looking for new moderators, so feel free to reach out to me to apply.

Thanks for being part of the very first wave. Together, let's make r/skillfully amazing.