top of page

How To Interview Better With AI

Writer: Buck Paolino
Buck Paolino
Sep 4
5 min read
Do not hire the best interview. Hire the best evidence.

As a business owner I did this 5 times before I saw the pattern.

I would hire someone. They would last 3-6 months. Then they were gone. This is how it always seemed to go.

A candidate walks in polished. Good answers. Right experience on paper.

I hire them.

Three months later they still can't make a decision without checking with you first. I couldn't get any work done and they were still on week 2 of training compared to being there 90+ days.

And that's when I decided there needed to be a change to how I interviewed. Other business owners were growing teams, revenue and profit. They were bringing 3-4 rockstar hires in at at time that were staying for years. Why couldn't I do it? Because, sometimes those we hire aren't a bad employee. They just weren't the best employee for your service business.

Sometimes it's a hiring process that only tested how well someone interviews. And this was my mistake.

Most hiring mistakes don't come from picking the wrong resume. They come from an interview that never tested the thing that actually matters:

  • Ownership.

  • Follow-through.

  • What someone does when there's no clear answer.

Key Takeaways

  • A polished interview measures confidence, not competence.

  • Create interview questions with AI to help you hire better.

  • Behavior-based questions are harder to fake than hypotheticals.

  • Score candidates on a simple 1-5 rubric right after the interview, before you talk yourself into someone.

  • A short skills test catches what 45 minutes of conversation never will.

Why Great Interviews Don't Predict Great Hires

A good interviewer can sound excellent without ever having done the job well.

Charisma and competence aren't the same thing. And 45 minutes of conversation is a bad tool for telling them apart.

Unless the questions are built to surface the difference.

The Candidate Who Said All the Right Things

I once interviewed a woman I was sure would crush it.

Resume looked great. Years of specific industry experience. She said all the right things.

I was ready to hire her. But we had an entrance accounting exam, so I had her take it.

She didn't do well.

I brought her back in, because sometimes good people just test badly. I asked more specific questions about her actual experience.

Turned out she'd spent years pulling reports and organizing them. Nobody had ever taught her the accounting behind any of it.

She was genuinely great on the phone. Excellent with vendors and guests. But she didn't have the requirements for the job she'd applied for.

I gave her a few recommendations and some learning material and invited her to re-interview. Never heard from her again.

The interview alone would never have caught it. The test did.

Your Instincts Aren't the Problem. Your Questions Are.

You already know in your gut when someone won't work out. Usually within the first few weeks.

The problem isn't your read on people. It's that your interview never asked the question that would have surfaced it sooner.

Fixing that isn't a new skill. It's building better questions before you walk into the room.

Come on. You've read people better than this before. You just need the questions to prove it.

How to Build Interview Questions With AI That Test for Fit

AI isn't screening candidates for you. It's helping you write sharper questions and score answers consistently, so the decision isn't pure gut.

  1. Ask about behavior, not hypotheticals. Not "how would you handle an upset customer." Instead: "Tell me about the last time a customer was upset with you. What did you actually do?" AI is useful for turning a vague trait you want, like ownership or follow-through, into a specific question that's hard to fake.

  2. Build the scorecard before the interview, not after. For a contractor hiring a project coordinator, that might be three lines. Communicates proactively, 1 to 5. Handles ambiguity without escalating, 1 to 5. Follows through without reminders, 1 to 5. Score right after, while it's fresh.

  3. Test the skill, don't just ask about it. A short, real task beats another round of questions. If the job requires a specific skill, have them do a small piece of it.

  4. Look for the patterns across candidates. Feed your notes in and ask what stands out. Who gave specific, detailed answers and who stayed vague. That's often a better predictor than who you liked most in the room.


Ask for evidence, not a good answer. Test the skill.

What to Do Before Your Next Interview

Pick the trait that's burned you before. Someone who needed too much hand-holding. Someone who avoided ownership.

Write one behavior-based question that would surface it. Build a 1-5 score around it.

Use it in your next interview. Score it immediately after.

That's not a new HR process. That's fifteen minutes.

What This Changes About How You Hire

Hiring better isn't about finding people who interview well. It's about asking questions that show how someone actually works, then scoring it the same way every time.

And when the role requires a hard skill, test for it. Don't take the resume's word for it.

AI helps you build sharper questions. You still make the call.

The business stops owning you. You start owning it.

You take a Tuesday off, and the person you hired handles it the way you hoped.



Frequently Asked Questions

How do you interview for fit?

Ask about what someone actually did, not what they would do. Behavior-based questions force specific examples, and vague answers become obvious fast. Pair that with a short skills test and a written scorecard so you're comparing candidates on the same criteria instead of on who you enjoyed talking to.

What does a behavior-based interview question look like?

It starts with "tell me about the last time" instead of "how would you." For example: "Tell me about the last time you had to make a call without your manager available. What did you decide and what happened?" Candidates who have done it give details. Candidates who haven't stay general.

Can AI screen job candidates for you?

AI shouldn't make the hiring decision, and using it to auto-reject applicants carries real legal risk. Where it helps is upstream and downstream: writing sharper interview questions, building a consistent scorecard, and spotting patterns across your own interview notes after the fact.

Related Reading


What Can AI Do In Your Business?


Question Mark - What Can AI Do In My Business?
Still Not Sure What AI Can Do In Your Business?

Most businesses don’t need "more AI tools".


They need to know where AI will actually save them time.


What To Automate First is a free 5–10 minute business checkup. List the work you and your team do each week, and it will identify "3 places to focus first"

—including where your time and payroll may be leaking.


No guessing.

No chasing the newest AI tool.

Just a clearer place to start.




 
 
 

Comments


bottom of page