0:00
/
0:00

Paid episode

The full episode is only available to paid subscribers of Nate’s Substack

Nobody Can Measure AI Skills, So I Built the First AI Skill Evaluator for Everyone (+ Prompts to Level Up)

AI skills tests are stuck in the stone age. Everyone is arguing over technical skills for specific jobs—no one has a way to measure total AI fluency AND level up methodically—so I built one!

I get really tired of AI tests online. Everyone uses ChatGPT. Everyone does their best.

Everyone says they have the skills (or hopes they do and hopes you won’t check.)

Measuring AI skills is become near-impossible on job interviews, and at the same time showing those skills is brutally hard for the rest of us.

How can the most important skill in the new world of AI be this hard to measure??!

I’ve talked to hundreds of job seekers and hiring managers in the last year, and there are three big reasons why AI fluency is impossible to measure right now:

  1. The skill sets are changing so fast (like every new ChatGPT release)

  2. AI is changing the jobs themselves really fast—so what’s needed?

We lack a common vocabulary for AI skills—so who knows what’s good?

Put simply, I’m aiming to tackle all three of those with this post.

  • If you are interested in leveling up your AI skills, this tells you where you are and what you need to work on

    • This is true for engineers as much as for non-technical roles

    • It also holds true across levels

    • Why? I designed it to measure foundational AI fluency levels we all need

  • If you’re hiring for AI, this is the first foundational level, job-independent AI assessment out there

    • And yes, it’s hard to game in interviews! (I made it that way on purpose)

  • This is also the first intentionally future-proofed AI fluency assessment

    • I built it anticipating future AI developments

    • It’s designed to flex and grow with future releases

How does all this work?

Well first, I’ll explain and lay out the framework for my competency assessment. I’m measuring:

  • Prompt mastery

  • Technical understanding (NOT code)

  • Practical application ability

  • Critical evaluation ability

  • Workflow design ability

I explain how I weight those and why, and then I give you a guided, accessible assessment that walks you through the test step by step. All you have to do is have a quiet place to think and a willingness to be honest (it’s ok it gets better!)

Then I give you a comprehensive scoring prompt PLUS a custom 90 day level up prompt that will take your scores and work with you to develop a level up prompt to get you where you want to go.

In addition, I have my own notes as a seasoned AI watcher—how different fluency levels look and present in different contexts, what skills are involved, how they will evolve in the future. Super useful stuff!

I’ve even got notes for coaches and teachers here—stuff you can read as you implement this test in a classroom setting or as HR with a team.

I hope you enjoy, and best of luck leveling up on AI in this wild new world we all are living in together!

Subscribers get all these newsletters!

Listen to this episode with a 7-day free trial

Subscribe to Nate’s Substack to listen to this post and get 7 days of free access to the full post archives.