The AI pilot checklist: 20 things to settle before you start.
The short answer
An AI pilot is a short, written trial of one AI product on one real job, with measures agreed before it starts and a decision on a set date. A good pilot settles 20 things in advance: the job, the scope, the data, how it runs and how you will decide.
Tick what you have.
Your progress stays in this page. Print it to take to a vendor meeting.
What happens each week.
Map today's process, volumes and rules with the team, and agree in writing how success is measured.
Connect only the approved systems and test on real cases, including the awkward ones.
It handles real work while a person reviews every action. Mistakes are fixed and logged.
Still reviewed, now measured against today's numbers, with hand-offs and errors counted.
Stop, change or keep: decided on the date agreed
Four things to question in a proposal.
- “Works with any system”Ask which connections are tested, with which actions.
- No written scopeIf the actions and limits aren’t written down, neither are the results.
- Results before the pilotA figure promised before seeing your data is a guess.
- No way to stop itYou should be able to switch it off yourself, at once.
Frameworks behind this checklist.
- NIST AI Risk Management Framework 1.0 (January 2023)govern, map, measure and manage AI risk
- ISO/IEC 42001:2023the management system standard for AI
- Regulation (EU) 2024/1689 (the EU AI Act)transparency and human oversight duties
Last updated
Questions, answered.
Long enough to see the job done many times on real work. Six weeks suits most single-job pilots: a week to scope, a week to connect, four weeks to run and measure.
A paid pilot usually gets more attention from both sides. Ask that the fee is credited if you go on to subscribe.
The same things you measure today for that job, such as time taken, errors and hand-offs, so you can compare like with like.
Someone who does the job today. They know what a good result looks like.
A pilot that shows a product isn’t a fit has done its job. Agree in advance that stopping is a normal outcome.
Bring us one process. We’ll show you how it would run.
A 30-minute call with a specialist: what it connects to, what a pilot involves, and an honest view on fit, including when it isn’t one.
- 30 minutesOne call, one process
- No commitmentNo sales script
- 4 business hoursTypical reply time · Mon to Fri, 7:00 to 22:00 IST
- 1You get a short agenda by email.
- 2We look at one process with you and how it would run.
- 3You get an honest view on fit, and what a pilot would involve.