AISA - AI Fluency Assessment

AISA - AI Fluency Assessment

In the last 6 months I built an AI Fluency Assessment system (called AISA) - it's currently the most sophisticated (and popular) of it's kind. Has high fidelity in what we measure to both what Anthropic and US. Dept. of Labour agree as the markers of AI fluency.

People chat with an AI agent uniquely trained to judge their AI fluency, get a detailed report and a breakdown of their AI skills, a certificate and a growth roadmap. We measure in 5 main dimensions. Prompting and Comms // Critical Thinking // Technical Understanding // Workflow Application // Safety (all which have their criteria.)

Some product-speak...

Need:
People are curious about their actual level when it comes to piloting AI well. They are also curious about seeing their gap areas, what they need to focus on to improve.

Need (b2b):
Organisations are looking to measure their employees (and their team/function/orgs) AI fluency averages. This is both to get a benchmark before they invest more into training AND to decide what type of training to invest in. Also to track how well they are doing in AI transformation.

Solution:
Build the most scientific, sophisticated and fun to experience AI Fluency Assessment system possible.

Unique differentiator:

  1. Entirely chat based. Like an expert in their field having a natural conversation with you. Not a quiz. Not a multiple choice.
  2. Build on a fixed and expert-researched rubric on what it actually measures. More about it in our methodology page for the curious.
  3. Product - founder fit. I've worked in the area of psychometric assessments, skill assessments, HR, human behaviour, led product and UX teams in large and small companies and built 5 startups before. So I'm uniquely qualified to build this.

Business Strategy:
Use B2C traffic and interest to build volume, build a moat and build further credibility, validity, legitimacy.

Use the dominant market position by being (or on the path to) the gold standard of AI fluency measurement to signup B2B deals with mid - large organisations.

Status as of today:
- 2K reports surpassed.
- B2C generated close to $1k in sales in it's own. Over $1K + MRR right now.
- 7 B2B conversations (either in POC, offer, or conversation stage - some of which are inbound leads from big (10k+) organisations. Fast potential to reach $100K ARR.
- Users are quite happy and love the product.
- DR 42 / 15k+ monthly users
- Value proposition has settled: We help you measure, prove and improve with AI.

It's not perfect and everyday I have to focus on another aspect of it to make it better. So it's more of a always hands-on full time plus, 15hr+ day type of commitment rather than "hey I've coded an app over the weekend and look easy money".

But I do have a clear vision in which AI Fluency measurement is a big deal, and am building towards it brick by brick.

Appreciate any constructive feedback if you have used the product and found something to improve.

u/Ozan_D — 6 days ago

Is geniune-baiting a thing?

It's not just AI. It seems most people who are motivated to be on Reddit have an agenda to eventually drive attention.

The days of people posting their shit and people appreciating that are over. Any WHIFF of promotional stuff gets people downvoted or ignored, or their post/comment deleted.

Hear me out;

IF people were allowed to share their stuff more openly and people weren't so negative about it, THEN the rest of the content would be more genuine, and people would trust more that it's genuine.

Because one path is blocked, now we have a congested path of genuine-baiting / faking.

These are posts that - on the surface - look and sound like they are not promoting anything but at a long tail, it's a reddit account trying to build credibility, or direct attention to somewhere else, someone getting paid with a political agenda etc...

reddit.com
u/Ozan_D — 9 days ago

Is geniune-baiting a thing?

It's not just AI. It seems most people who are motivated to be on Reddit have an agenda to eventually drive attention.

The days of people posting their shit and people appreciating that are over. Any WHIFF of promotional stuff gets people downvoted or ignored, or their post/comment deleted.

Hear me out;

IF people were allowed to share their stuff more openly and people weren't so negative about it, THEN the rest of the content would be more genuine, and people would trust more that it's genuine.

Because one path is blocked, now we have a congested path of genuine-baiting / faking.

These are posts that - on the surface - look and sound like they are not promoting anything but at a long tail, it's a reddit account trying to build credibility, or direct attention to somewhere else, someone getting paid with a political agenda etc...

reddit.com
u/Ozan_D — 10 days ago

For context - I've worked in the highest levels of recruitment. (Executive search, Tech&Product in top companies, in house, agency, wrote books on the topic, gave seminars...)

I've also been heavily involved with AI, and have an experience in Product Management and as an exited founder. Here's what I see is going to happen.

  1. CV's are documents initially designed for humans to interact with other humans. They are now a mismatched format for today's needs. Now, humans don't write them, humans don't read them.
  2. Initial matching is completely algorithmic.
  3. Final decision is human.

Based on this, the better system would be;

  1. There's an agent that represents the employer.
  2. There's an agent that represents the employee.

Both agent's have rich and full context.

There's a protocole that does the job of what a "CV" would do - establish a communication channel between to two agents, where one agent is in the role of the judge, the other is in the role of the applicant. If there's a match, humans get involved. If not, they don't.

I'm pretty sure this or a version of this is what we are going to end up with in the next 5-10 years, perpaps much sooner.

reddit.com
u/Ozan_D — 4 months ago