Home / Courses / AI Readiness: Strategy and Operational Impact
Free course · Self-paced
AI Readiness: Strategy and Operational Impact
Assess, prioritize and govern AI so your organization moves from small pilots to measurable results.
0 of 24 lessons complete
About this course
A practical, self-paced course for SME leaders on evaluating and preparing an organization for AI within an operational excellence framework. You will assess readiness across seven dimensions, audit data quality, gauge workforce capabilities, prioritize use cases, define performance metrics and set sound governance so AI initiatives scale beyond the pilot stage.
Who it is for
- Owners, general managers and operations leaders in small and mid-sized businesses
- Continuous improvement, Lean and Six Sigma practitioners asked to lead AI work
- Managers in manufacturing, distribution, energy, health care and professional services planning digital transformation
- IT and finance leads who evaluate AI business cases and vendors
What you will be able to do
- Assess your organization's AI readiness across strategy, data, skills, culture and governance
- Discover, score and prioritize AI use cases by business value and feasibility
- Audit data quality and fix data problems at the source using DMAIC
- Assess workforce capabilities and lead the people side of AI adoption
- Define tool, process and business metrics and build a sound AI business case
- Govern AI risk, run disciplined pilots and scale successful use cases into daily operations
Course structure
- Module 1: Foundations of AI Readiness (5 lessons). What AI readiness means for an SME, the main kinds of AI that matter in operations, and why so many pilots never reach the shop floor.
- Module 2: Strategy and the Use-Case Pipeline (5 lessons). How to find, score and choose AI use cases that solve real business problems, and how to decide whether to build, buy or partner.
- Module 3: Data Foundations (5 lessons). How to audit data quality, understand your data infrastructure, govern data responsibly under Canadian privacy expectations and fix data problems with DMAIC.
- Module 4: People, Skills and Culture (4 lessons). How to assess workforce capabilities, define roles for AI work, lead the human side of change and build practical AI literacy.
- Module 5: Governance, Metrics and Scaling (5 lessons). How to govern AI risk, define performance metrics, run disciplined pilots, scale to everyday operations and build a 90-day readiness plan.
Interactive labs
- AI Readiness Self-Assessment: Score your organization from 1 to 5 on seven readiness dimensions to see your maturity profile on a radar chart. Use the result to find the weakest dimension that will set the pace of your AI journey.
- AI Use-Case Prioritization Matrix: Rate each AI use case on effort or feasibility difficulty and on business value to see which are quick wins and which are strategic bets. Rename or add items to reflect your own pipeline.
- AI Use-Case ROI Calculator: Enter the manual hours, labour cost, share of work automatable and the build and running costs of an AI use case to estimate annual savings, payback and three-year ROI. Use it to test the assumptions in your business case.
How it works
- Work through 24 short lessons at your own pace. Each has key takeaways, an exercise for your own workplace and a quick knowledge check.
- Try the three interactive labs as you reach them in the course.
- Pass the 20-question final exam (70% or higher, unlimited retakes) to unlock your Chmltech certificate of completion.
- Free, with no sign-up. Your progress is saved in this browser.
What AI readiness really means
Most owners first meet artificial intelligence as a product demo: a chatbot that writes emails, or a vendor promising that a model will forecast demand. The demo works. The question that matters is different: is your organization ready to make AI work, repeatedly, inside real processes, with real staff and real data? That is what AI readiness means.
AI readiness is the combination of conditions that let an organization move from interest to dependable results. It is not a single technology purchase. It is closer to plant readiness before a new production line: the line can be excellent, but if the floor is not level, the power is wrong and nobody is trained, it will sit idle.
The four layers of readiness
- Strategic readiness – leaders know which business problems AI should help with, and why those problems matter now.
- Technical readiness – the data exists, is good enough, and can be reached by the tools that need it.
- People and cultural readiness – staff have the skills, the trust and the time to use new tools, and managers can lead the change.
- Governance readiness – there are clear rules for risk, privacy, accountability and how decisions are checked.
A gap in any one layer can stop a project. A distributor with excellent data but no executive sponsor will see its pilot drift. A clinic with an enthusiastic manager but patient data scattered across paper forms and three systems will struggle to train or feed any model.
A worked example
Imagine a 40-person fabrication shop that wants AI to quote jobs faster. Estimators currently take two days per quote. A quick readiness check shows:
| Layer | Finding | Status |
|---|---|---|
| Strategy | Owner wants faster quotes to win more work | Clear goal |
| Data | Past quotes live in spreadsheets with inconsistent part names | Weak |
| People | Senior estimator worries the tool will replace judgment | At risk |
| Governance | No rule on who approves an AI-assisted quote | Missing |
The shop is not ready to buy a quoting tool yet. It is ready to clean up its quote history, involve the senior estimator in design, and decide on an approval rule. Those steps cost little and make the eventual tool far more likely to succeed.
Why readiness first
Readiness work feels slower than buying software, but it prevents the most expensive outcome: a tool that is paid for, half-configured and quietly abandoned. In this course you will assess each layer, prioritize use cases, set metrics and build a practical plan to move beyond small pilots.
- Strategic readiness: Leaders know which business problems AI should help with and why those problems matter now.
- Technical readiness: The data exists, is good enough, and can be reached by the tools that need it.
- People and culture: Staff have the skills, trust and time to use new tools, and managers can lead the change.
- Governance readiness: Clear rules cover risk, privacy, accountability and how AI-assisted decisions are checked.
Key takeaways
- AI readiness is the set of strategic, technical, people and governance conditions that let AI deliver repeatable results.
- A weakness in any single layer can stall an otherwise good project.
- Low-cost readiness work often matters more than the choice of tool.
Apply it at work
Pick one AI idea that has come up in your organization. Write one sentence for each of the four readiness layers describing where you stand today, and mark each as clear, weak or missing.
The kinds of AI that matter in operations
"AI" covers a wide family of techniques. Leaders do not need to build models, but they do need to recognize which kind of tool fits which problem. Choosing the wrong category is one of the fastest ways to waste a budget.
Five practical families
| Family | What it does | SME example |
|---|---|---|
| Predictive analytics (machine learning) | Learns patterns in historical data to forecast or classify | Forecasting weekly demand for a distributor's top 200 items |
| Generative AI (large language models) | Produces and summarizes text, code or images from prompts | Drafting proposal sections in an engineering office |
| Computer vision | Interprets images or video | Spotting surface defects on painted parts at end of line |
| Optimization | Finds the best plan within constraints | Scheduling technicians or sequencing jobs on a machine |
| Document and process automation | Extracts data from documents and moves it between systems, often combining rules with AI | Reading supplier invoices into the accounting system |
AI is not the same as automation
Robotic process automation (RPA) and simple scripts follow fixed rules: if the field says X, do Y. AI handles variation: invoices in different layouts, free-text complaints, images taken in changing light. Many valuable SME solutions combine the two. A rule moves the data; an AI step reads the messy document first.
The distinction matters for readiness. Rule-based automation needs a stable, well-documented process. AI needs that too, plus enough representative data and a way to handle the cases where the model is wrong.
Matching the tool to the problem
Ask three questions about any proposed use case:
- What is the output? A number (forecast), a label (pass/fail), a draft (text) or a plan (schedule)?
- What does it learn from? Your historical records, general knowledge built into a vendor model, or images you collect?
- What happens when it is wrong? A slightly poor email draft is cheap. A missed safety defect is not.
Consider a clinic's intake desk. Summarizing a referral letter is a generative AI task with a human reviewing the result. Predicting no-show appointments is a predictive task trained on the clinic's own booking history. Both are "AI", but they need different data, different checks and different governance.
A word on hype
Generative AI tools are easy to try, which makes them feel like the whole story. For many operations problems, though, a modest predictive model or a well-designed optimization will deliver more measurable value. Keep the problem, not the headline technology, at the centre of your thinking.
Key takeaways
- Predictive, generative, vision, optimization and document automation solve different kinds of problems.
- Rule-based automation handles fixed logic; AI handles variation and judgment-like tasks.
- Always ask what the output is, what it learns from and what happens when it is wrong.
Apply it at work
List three AI ideas you have heard in your organization. For each, name the AI family it belongs to and answer the three matching questions: output, learning source and cost of an error.
Why AI pilots stall
Many organizations run an AI pilot, see a promising demo, and then nothing changes in daily operations. The pilot is neither killed nor scaled. Practitioners often call this pilot purgatory. Understanding why it happens is the first step to avoiding it.
Common root causes
- No owner in the business. IT or an outside vendor runs the pilot, but no operations manager is accountable for using the result.
- No baseline. Nobody measured how long the task took or how many errors occurred before the pilot, so success cannot be shown.
- Pilot data is not production data. The team hand-cleaned a sample for the test. Live data is messier, and performance drops.
- The process was never redesigned. The AI output arrives, but the workflow, roles and approvals stay the same, so the benefit is lost in handoffs.
- Integration was deferred. The pilot ran in a separate tool. Getting it into the ERP or scheduling system becomes an unplanned project.
- Trust was not built. Frontline staff were not involved and quietly work around the tool.
- No exit criteria. Nobody defined in advance what result would justify scaling or stopping.
A five-whys example
Imagine a regional distributor that piloted demand forecasting. Six months later, buyers still use their old spreadsheets. A five-whys session reveals the chain:
- Why do buyers ignore the forecast? They do not trust it.
- Why not? It was badly wrong on several promotional items.
- Why? Promotions were not flagged in the sales history used to train the model.
- Why? Promotion data sits in the marketing team's calendar, not the ERP.
- Why? Nobody mapped which data the forecast needed before the pilot started.
The root cause is a readiness gap in data and process mapping, not a weak algorithm. Swapping vendors would not have fixed it.
Designing pilots to escape purgatory
A pilot should be designed as the first stage of deployment, not as a science experiment. That means naming a business owner, measuring a baseline, using realistic data, sketching the future workflow, planning integration early and writing go/no-go criteria before the pilot begins. Later in this course you will build each of these elements.
A good pilot answers one question: should we run this in production, and what would it take?
- Pilot purgatory: IT or a vendor runs it; no business owner; No baseline, so success cannot be shown; Hand-cleaned sample data, not live data; Old workflow and approvals left unchanged; No go/no-go criteria agreed in advance
- Pilot designed to scale: A named operations owner uses the result; Baseline measured before the pilot starts; Realistic, production-like data; Future workflow and integration sketched early; Exit criteria written before launch
Key takeaways
- Pilots usually stall because of ownership, baseline, data, process and trust gaps rather than weak algorithms.
- Root-cause tools such as five whys apply to AI projects as well as to production problems.
- Design every pilot as the first stage of deployment, with exit criteria set in advance.
Apply it at work
Think of a past technology pilot in your organization that never scaled. Run a short five-whys exercise on it and identify which root cause from this lesson was most responsible.
AI and operational excellence
Operational excellence is the discipline of running processes that deliver value reliably, with waste removed and variation controlled. Lean, Six Sigma and continuous improvement are its core toolkits. AI does not replace them. It works best on top of them.
Do not automate waste
A classic Lean warning applies directly to AI: if you automate a wasteful process, you get waste faster. Before applying AI to a task, ask whether the task should exist at all. Consider a distributor whose staff re-key order details from emails into the ERP. AI could read the emails. But a Lean review might show that a simple online order form would eliminate most of the re-keying entirely, at a fraction of the cost.
Where AI strengthens Lean and Six Sigma
| Operational excellence goal | How AI can help |
|---|---|
| Reduce variation (Six Sigma) | Predict when a process is drifting before defects appear |
| Build quality in (jidoka) | Vision inspection that stops a line when a defect is detected |
| Level the workload (heijunka) | Better demand forecasts that smooth production plans |
| Reduce waiting and motion | Optimized pick routes and technician schedules |
| Standard work | Generative assistants that guide staff through current procedures |
Using familiar frameworks
The DMAIC cycle (Define, Measure, Analyze, Improve, Control) maps neatly onto an AI initiative. You define the business problem, measure the baseline and data quality, analyze root causes and whether AI is the right lever, improve by piloting the solution with a redesigned workflow, and control by monitoring model and process performance after go-live.
PDCA (Plan, Do, Check, Act) suits smaller, faster experiments such as testing a generative AI assistant with one team for four weeks.
A worked example
Imagine a metal finishing shop with a high rework rate on powder-coated parts. The owner asks about AI vision inspection. Working through DMAIC first, the team measures rework by defect type and finds that most defects trace to inconsistent pre-treatment. A simple control on bath chemistry, with a checklist, removes much of the problem. Vision inspection is still considered, but now for a smaller, better-understood set of defects, which makes it cheaper and more accurate.
The lesson is not that AI is unnecessary. It is that a stable, understood process is the right foundation for AI, and that operational excellence methods tell you where AI will add the most value.
Key takeaways
- Remove waste and stabilize a process before applying AI to it.
- AI can strengthen Lean and Six Sigma goals such as reducing variation and building in quality.
- DMAIC and PDCA provide a ready-made structure for planning and controlling AI initiatives.
Apply it at work
Choose one process where AI has been suggested. Walk through it with the people who do the work and list any steps that could be eliminated or simplified before any technology is applied.
A seven-dimension readiness framework
To assess readiness consistently, it helps to break it into dimensions that can each be scored. This course uses seven, drawn from common maturity-model practice. You will score your own organization on them in the lab that follows this lesson.
The seven dimensions
- Strategy and leadership – Is there a sponsor, a stated purpose for AI, and a link to business goals?
- Use-case pipeline – Is there a list of candidate problems, assessed for value and feasibility?
- Data quality – Is the data your processes depend on accurate, complete and consistent?
- Data infrastructure – Can data be accessed, combined and moved between systems securely?
- Skills and capabilities – Do staff and managers have the skills to use, question and maintain AI tools?
- Culture and change – Is there trust, openness to experiment and a track record of adopting change?
- Governance and risk – Are there rules for privacy, accountability, risk review and acceptable use?
A five-level maturity scale
| Score | Level | What it looks like |
|---|---|---|
| 1 | Not started | No activity or awareness |
| 2 | Ad hoc | Individual efforts, nothing repeatable |
| 3 | Defined | Documented approach, applied in some areas |
| 4 | Managed | Applied consistently, measured and reviewed |
| 5 | Optimized | Continuously improved and built into how the business runs |
How to score honestly
- Score on evidence, not intention. A policy that is drafted but not used is a 2, not a 3.
- Score with a small cross-functional group, such as operations, finance, IT and a frontline lead. Different views reveal blind spots.
- Note one piece of evidence for each score so you can track progress later.
Reading the profile
The shape of the result matters more than the average. Imagine an engineering office that scores 4 on skills, 4 on culture, but 1 on governance. Its people are keen and capable, and are probably already using public generative AI tools with client documents. Its first priority is an acceptable-use policy, not another pilot.
By contrast, a food manufacturer scoring 4 on data infrastructure but 2 on use-case pipeline has capable systems and no clear direction. Its next step is structured discovery of business problems.
The weakest dimension usually sets the pace. Readiness planning means lifting the lowest scores to a workable level before scaling, while starting small, safe use cases in the stronger areas.
Key takeaways
- Assess readiness across seven dimensions: strategy, use-case pipeline, data quality, data infrastructure, skills, culture and governance.
- Score on evidence using a five-level maturity scale, ideally with a cross-functional group.
- The weakest dimension usually limits progress, so the profile shape guides priorities.
Apply it at work
Gather two or three colleagues from different functions and complete the readiness self-assessment lab together. Record one piece of evidence for each score you agree on.
Start with business problems, not tools
The most reliable AI strategies for SMEs begin with a short list of business problems that leaders already care about. Tools come later. This sounds obvious, yet many initiatives start with "we should be using AI" and then search for somewhere to apply it.
Anchor AI to strategic goals
Begin with two or three goals from your business plan. Typical SME goals include growing revenue without adding headcount, improving on-time delivery, reducing quality costs, or freeing skilled staff from administrative work. For each goal, ask which operational problems stand in the way.
| Strategic goal | Operational problem | Possible AI role |
|---|---|---|
| Grow sales without adding estimators | Quotes take too long | Draft quotes from similar past jobs |
| Improve on-time delivery | Frequent stock-outs on fast movers | Demand forecasting |
| Reduce cost of quality | Defects found late, at final inspection | Early defect detection |
| Free nurses from admin | Long intake paperwork | Document summarization with review |
Write a clear problem statement
A good problem statement, borrowed from the Six Sigma project charter, describes what is happening, where, how much it costs and why it matters, without assuming the solution. Compare:
- Weak: "We need an AI chatbot for customer service."
- Strong: "Customer service staff spend about half of each day answering order-status questions by phone, delaying responses to complaints and returns."
The strong version opens several possible solutions: a self-serve order tracking page, automated status emails, or an AI assistant. It also suggests a metric, staff time on status calls, that can be measured before and after.
The role of the leadership sponsor
Each priority problem needs a sponsor who owns the business outcome. The sponsor approves resources, removes obstacles, and decides at go/no-go points. In a small company this is often the owner or general manager. The sponsor should not be the vendor or the IT contractor, because they do not own the operational result.
A worked example
Imagine a 60-person HVAC services company. Leaders list three goals for the year. Under "improve technician productivity", they identify that technicians make repeat visits because the right part was not on the truck. The problem statement focuses on first-time fix rate. AI might later help predict parts needed for each job type, but the team starts by measuring how often repeat visits happen and why.
Starting from problems keeps AI tied to value, makes the business case easier to write and builds credibility with staff, who see technology applied to frustrations they recognize.
Key takeaways
- Link every AI idea to a strategic goal and a specific operational problem.
- Write problem statements that describe the pain and its cost without assuming the solution.
- Each priority problem needs a business sponsor who owns the outcome.
Apply it at work
Take your top two business goals for this year. For each, write one problem statement in the strong format from this lesson, and name the person who should sponsor it.
Discovering use cases with process tools
Once you know which problems matter, you need a structured way to find specific places where AI could help. Operational excellence tools are ideal for this because they make work visible.
SIPOC for scoping
A SIPOC diagram (Suppliers, Inputs, Process, Outputs, Customers) gives a one-page view of a process. It helps the team agree on boundaries and spot where information enters and leaves. Inputs that arrive as unstructured documents, emails or images are often good candidates for AI.
Value stream mapping for pain points
A value stream map shows each step, the waiting time between steps and where information flows. Look for:
- Steps where people read, interpret or re-type information
- Decisions made by experience that could be supported by data
- Long queues caused by a single expert's availability
- Rework loops caused by errors found late
- Manual checks of large volumes where only a few items have problems
Run a discovery workshop
A two-hour workshop with frontline staff and supervisors is usually enough to build a first list. A simple agenda:
- Walk the SIPOC and current-state map for one process (30 minutes).
- Ask each participant to note tasks that are repetitive, error-prone or dependent on one person (20 minutes).
- Group the notes into themes (20 minutes).
- For each theme, describe the possible AI role and the data it would need (40 minutes).
- Agree on who will gather baseline numbers (10 minutes).
A worked example
Imagine a wholesale food distributor mapping its order-to-cash process. The workshop surfaces these candidates:
| Pain point | Candidate AI use case | Data needed |
|---|---|---|
| Orders arrive by email and PDF in many formats | Automated order extraction | Sample orders, product master |
| Buyers guess reorder quantities | Demand forecasting | Two or more years of sales history |
| Credit checks wait for the controller | Risk scoring to fast-track low-risk accounts | Payment history |
| Customers phone for delivery times | Automated status updates | Dispatch and routing data |
Notice that the last item may not need AI at all; a simple notification could solve it. That is fine. Discovery should capture all improvement ideas, then sort them.
Keep a living pipeline
Record each candidate in a shared register with the problem, the process, the sponsor, the data needed and a rough idea of value. Revisit it quarterly. A healthy pipeline means you always have the next well-understood use case ready when the current one is deployed.
Key takeaways
- SIPOC and value stream maps make work visible and reveal where AI could help.
- Look for interpretation, re-keying, expert bottlenecks, late-found errors and high-volume checks.
- Keep a living use-case register and accept that some ideas will not need AI at all.
Apply it at work
Pick one core process and sketch a SIPOC on a single page. Then list three steps where staff interpret, re-type or check large volumes of information, and note the data each would need.
Scoring value and feasibility
A good discovery workshop produces more ideas than you can act on. The next step is to score them so that the first projects are both worthwhile and achievable. The value–effort matrix is a simple, widely used tool for this, and you will use it in the lab after this lesson.
Scoring business value
Rate value from 1 (low) to 5 (high), considering:
- Hours or cost saved per year
- Revenue, capacity or customer service gained
- Quality, safety or compliance improvement
- Link to a strategic goal and an engaged sponsor
Scoring effort and feasibility difficulty
Rate effort from 1 (easy) to 5 (hard), considering:
- Data availability and quality
- Integration with existing systems
- Process change and training required
- Risk and cost of errors, including privacy concerns
- Whether proven off-the-shelf tools exist
Reading the four quadrants
| Quadrant | Value / Effort | Action |
|---|---|---|
| Quick wins | High value, low effort | Start here to build momentum and skills |
| Strategic bets | High value, high effort | Plan carefully; address readiness gaps first |
| Fill-ins | Low value, low effort | Do when capacity allows, or let staff experiment |
| Avoid or rethink | Low value, high effort | Park, or reframe the problem |
A worked example
Imagine a 50-person machine shop scoring four ideas with its leadership team:
- Generative AI to draft quote cover letters: value 2, effort 1 – a fill-in.
- Automated reading of supplier packing slips: value 4, effort 2 – a quick win.
- Predictive maintenance on the CNC fleet: value 4, effort 4 – a strategic bet, because sensor data is not yet collected.
- Full AI production scheduling: value 3, effort 5 – rethink, as routing data is unreliable.
The shop starts with packing slips, and in parallel begins collecting spindle load data so predictive maintenance becomes feasible next year.
Scoring tips
- Score as a group and discuss disagreements; they often reveal hidden risks.
- Use rough numbers where possible, such as hours per week, rather than gut feel alone.
- Re-score when readiness improves. An idea that is high effort today can become a quick win once data is cleaned.
- Frame the problem: Start from a strategic goal and write a problem statement that does not assume the solution.
- Discover ideas: Use SIPOC and value stream mapping to find steps where AI could remove pain or waste.
- Score value/effort: Rate each idea 1 to 5 for value and effort as a group, and place it in a quadrant.
- Choose the route: Decide whether to use features you own, buy a product, partner or build.
- Pilot and measure: Run a chartered pilot against a baseline and make a clear go/no-go decision.
- Re-score pipeline: As readiness improves, re-score parked ideas; a hard idea today can become a quick win.
Key takeaways
- Score each use case on business value and on effort or feasibility difficulty, from 1 to 5.
- Start with quick wins, plan strategic bets carefully and rethink low-value, high-effort ideas.
- Re-score as readiness improves, because effort depends on your data and systems.
Apply it at work
Use the matrix lab to score at least six AI ideas from your organization with two colleagues. Choose one quick win to explore further and one strategic bet whose readiness gaps you will start closing.
Build, buy or partner
Once a use case is chosen, you must decide how to deliver it. SMEs rarely need to build AI from scratch, but each route has trade-offs worth understanding.
The four main routes
| Route | What it means | Best when | Watch for |
|---|---|---|---|
| Use features already owned | Turn on AI features in your ERP, CRM or office suite | The need is common and the feature fits | Data settings, licence tiers, limited customization |
| Buy a specialized product | Subscribe to a tool built for the task, such as invoice capture | The problem is common across many businesses | Integration effort, vendor lock-in, data ownership |
| Partner to configure | Work with a consultant or integrator to tailor a platform | You need some fit to your process but not a custom model | Knowledge transfer, ongoing support costs |
| Build custom | Develop a model on your own data | The problem is specific and creates a real advantage | Skills, maintenance, monitoring burden |
Questions to ask
- Is this problem unique to us, or does every business in our sector have it?
- Do we already own software with a suitable feature?
- Who will maintain the solution after go-live?
- Where will our data be stored and processed, and who can access it?
- Can we export our data and configuration if we leave the vendor?
- What will the total cost be over three years, including subscriptions, integration and staff time?
Vendor due diligence
When buying, ask vendors for a trial on your own data, not just a demo with theirs. Ask how the tool handles errors and low-confidence results, what training is included, how pricing changes with volume, and whether your data is used to train their models. For personal information, confirm how the vendor supports your obligations under Canadian privacy law, such as PIPEDA or the applicable provincial law.
A worked example
Imagine an engineering consultancy that wants help drafting proposals. The partners consider building a custom tool. Working through the questions, they realize their office suite already includes a generative AI assistant at a modest licence cost. They choose to use it, invest instead in a library of approved proposal content and prompts, and set a rule that all drafts are reviewed by a project manager. Custom development is saved for a future idea: estimating project hours from past timesheets, which is genuinely specific to their firm.
A sensible default for SMEs is to use what you own first, buy for common problems, partner for fit and build only where the problem is truly yours.
Key takeaways
- Most SMEs should use existing features or buy proven tools before building custom AI.
- Assess total three-year cost, data ownership, exit options and who will maintain the solution.
- Test vendor tools on your own data and confirm how they handle errors and privacy.
Apply it at work
For your top-priority use case, answer the six build-buy-partner questions in writing. Check whether any software you already license offers a relevant AI feature.
Writing a practical AI business case
A business case turns a promising idea into a decision. For an SME it does not need to be long; two pages is often enough. What it must do is make costs, benefits, risks and assumptions visible so the sponsor can make an informed choice.
Structure of a two-page business case
- Problem and goal – the problem statement and the strategic goal it supports.
- Baseline – current time, cost, error rate or service level, with how it was measured.
- Proposed solution – the AI role, the route (buy, partner, build) and the redesigned workflow.
- Benefits – hours saved, errors avoided, capacity or revenue gained, with assumptions stated.
- Costs – one-time setup and integration, ongoing subscription and support, and internal staff time.
- Risks and mitigations – data, adoption, accuracy, privacy and vendor risks.
- Pilot plan and decision criteria – scope, duration and what result will justify scaling.
A worked example
Imagine an accounts payable team at a building products distributor handling supplier invoices. The team measures a baseline of 25 hours per week of manual entry at a loaded cost of $40 per hour.
| Item | Estimate |
|---|---|
| Manual hours per year (25 × 48 weeks) | 1,200 hours |
| Share realistically automatable | 60% |
| Hours saved per year | 720 hours |
| Value of hours saved at $40/hour | $28,800 |
| Setup and integration (one-time) | $12,000 |
| Subscription and support ($600/month) | $7,200 per year |
| Net annual benefit | $21,600 |
| Simple payback | About 7 months |
The case also notes non-financial benefits: fewer late-payment penalties and faster month-end close. It states that the 60% figure is an assumption to be tested in the pilot.
Be honest about benefits
Saved hours are only real value if they are redeployed to useful work or reduce overtime or hiring. Say explicitly what staff will do with recovered time. Also include the internal effort of setup, training and exception handling, which is often underestimated.
Show a range
Present a conservative, expected and optimistic scenario. If the project only works under the optimistic case, it is a risky bet. Later in this course you will use the automation ROI calculator to test these numbers for your own use case.
Key takeaways
- A short business case should cover problem, baseline, solution, benefits, costs, risks and decision criteria.
- State assumptions such as the share of work automatable, and test them in the pilot.
- Count saved hours as value only when they are genuinely redeployed or avoid cost.
Apply it at work
Draft a one-page business case for your top-priority use case using the seven headings. Leave clear placeholders where you still need baseline data, and name who will gather it.
Data as the raw material of AI
In manufacturing, poor raw material produces poor product no matter how good the machine. Data plays the same role for AI. A model learns from data, and in operation it acts on data. If either is unreliable, the results will be too.
Three ways AI depends on data
- Training data – historical records a model learns from, such as three years of sales or a library of labelled defect images.
- Operating data – the live inputs the tool uses each day, such as today's orders or a new invoice.
- Feedback data – records of whether the AI was right, such as a buyer's correction to a forecast, which allow monitoring and improvement.
Generative AI tools bought from vendors arrive already trained on general data, but they still depend on yours. An assistant that answers staff questions about procedures is only as good as the procedures it is given. If three versions of a work instruction exist, the assistant may cite the wrong one.
Map the data a use case needs
Before any pilot, list the data elements the use case requires and where each lives. A simple data inventory looks like this:
| Data element | Source system | Owner | Known issues |
|---|---|---|---|
| Sales history by item and week | ERP | Sales manager | Item codes changed two years ago |
| Promotion calendar | Marketing spreadsheet | Marketing lead | Not linked to item codes |
| Supplier lead times | Buyer's notes | Purchasing | Not recorded consistently |
| Stock-outs | Not captured | None | Missing entirely |
A worked example
Imagine a regional distributor planning demand forecasting. The inventory above reveals that stock-outs are not recorded. That matters: when an item is out of stock, recorded sales drop to zero, and a model will wrongly learn that demand fell. The team starts logging stock-outs and flags past periods where sales were limited by availability. This one change does more for forecast quality than any choice of algorithm.
Data readiness questions
- Does the data exist, and has it been recorded long enough to show patterns?
- Is it captured consistently, with the same codes and definitions over time?
- Can it be extracted from its system without manual copying?
- Does someone own it and feel responsible for its accuracy?
- Does it contain personal information that needs protection?
Answering these questions early is the cheapest risk reduction available in any AI project. The following lessons show how to audit quality, assess infrastructure and govern data well.
Key takeaways
- AI depends on training data, live operating data and feedback data.
- Build a data inventory listing each element, its source, owner and known issues.
- Missing or distorted records, such as unlogged stock-outs, can mislead a model more than a weak algorithm.
Apply it at work
For your priority use case, build a data inventory table with at least five data elements. Mark any element that is missing, has no owner or is held only in personal spreadsheets.
Auditing data quality
A data quality audit is a structured check of whether your data is fit for its intended use. It does not have to be elaborate. A focused audit of the few tables a use case depends on can be done in a few days with a spreadsheet and some patience.
Six dimensions of data quality
| Dimension | Question | Example check |
|---|---|---|
| Accuracy | Does the data reflect reality? | Compare 50 inventory records with a physical count |
| Completeness | Are required fields filled? | Percentage of work orders with a failure code |
| Consistency | Is the same thing recorded the same way? | Count spellings of one customer name |
| Timeliness | Is it recorded soon enough to be useful? | Lag between job completion and time entry |
| Validity | Does it follow the rules and formats? | Dates in the future, negative quantities |
| Uniqueness | Are there duplicates? | Duplicate supplier or part records |
How to run a quick audit
- Choose the tables and fields the use case needs, from your data inventory.
- Define a simple acceptance threshold for each dimension, for example, "at least 95% of work orders have a failure code".
- Pull a sample or the full extract and run basic counts, filters and pivot tables.
- For accuracy, compare a random sample with the physical world or source documents.
- Record the results, the gap to threshold and a suspected root cause.
A worked example
Imagine a food processor wanting to predict equipment failures from maintenance records. An audit of two years of work orders finds:
- Completeness: 1,800 work orders, of which 1,080 have a failure code (60%), against a threshold of 90%.
- Consistency: the same mixer appears under four different asset names.
- Timeliness: many orders are closed in batches at month end, so repair times are unreliable.
- Accuracy: in a sample of 30 orders checked with technicians, 6 had the wrong failure code (80% accurate).
The conclusion is clear: the data is not yet fit for predictive maintenance. But the audit also gives a precise improvement list: a mandatory failure code with a short pick list, a cleaned asset register and closing orders at the end of each job.
Make the audit repeatable
Turn the checks into a simple monthly scorecard. Data quality is not a one-time cleanup; it decays unless the process that creates the data is controlled. Watching the scores improve also shows staff that their data entry matters.
Fix the process that creates the data, not just the data itself.
- Completeness: 60 %
- Accuracy: 80 %
- Acceptance threshold: 90 %
Key takeaways
- Audit data against six dimensions: accuracy, completeness, consistency, timeliness, validity and uniqueness.
- Set acceptance thresholds and compare a sample with reality to test accuracy.
- Turn audit checks into a recurring scorecard and fix the processes that create bad data.
Apply it at work
Choose one table your priority use case depends on. Measure completeness and consistency for two key fields, and check accuracy on a random sample of 20 records against source documents or the physical world.
Data infrastructure and integration
Good data that cannot be reached is almost as limiting as bad data. Data infrastructure is the set of systems, connections and storage that let data be captured, combined, secured and delivered to the tools that need it.
A typical SME data landscape
- An ERP or accounting system holding orders, inventory and finances
- A CRM for customers and sales activity
- Line-of-business tools: maintenance, scheduling, electronic medical records, project management
- Shared drives and email holding documents and spreadsheets
- Machine controllers or sensors on the shop floor
- Many personal spreadsheets that quietly run key processes
Infrastructure maturity levels
| Level | Description | Implication for AI |
|---|---|---|
| Islands | Data trapped in separate systems and spreadsheets, combined by hand | Every AI project starts with manual data gathering |
| Connected | Key systems can export data or offer APIs; some integrations exist | Pilots are feasible; production needs integration work |
| Consolidated | A central reporting database or data warehouse refreshes automatically | Models can be trained and fed reliably |
| Managed | Defined data pipelines, access controls, backups and monitoring | AI can scale across several use cases |
Key questions for your IT partner
- Which of our systems have APIs or scheduled exports?
- Where would an AI tool read data from, and where would it write results?
- Is our data stored in Canada or elsewhere, and does that matter for our contracts or sector?
- Who has access to which data, and how is access controlled and logged?
- How are backups and security updates handled?
A worked example
Imagine a 30-person engineering office whose project hours sit in a timesheet tool, budgets in accounting software and scope in proposal documents on a shared drive. Leaders want AI to estimate hours for new projects. The infrastructure review shows that both systems have exports, but proposals use inconsistent file naming. The first step is modest: a scheduled export of both systems into a single reporting database, plus a standard proposal template with a structured scope summary. That foundation supports the estimator and also improves ordinary project reporting.
Do not over-build
SMEs do not need an enterprise data platform before the first AI project. Build the infrastructure the next two or three priority use cases require, using secure cloud services where they make sense. Each project should leave the data foundation a little stronger than it found it.
Key takeaways
- Data infrastructure determines whether good data can actually reach AI tools.
- Move from data islands toward connected, consolidated and managed systems step by step.
- Build only the infrastructure your next few priority use cases require.
Apply it at work
Draw a simple diagram of the systems your priority use case would need to read from and write to. Mark each connection as manual, export-based or API-based, and identify the weakest link.
Data governance, ownership and privacy
Data governance is the set of roles, rules and routines that keep data trustworthy, secure and used appropriately. For an SME it can be light, but it cannot be absent, especially once AI tools begin using personal or confidential information.
Core governance roles
| Role | Responsibility | Typical SME holder |
|---|---|---|
| Data owner | Accountable for a data domain, its quality and who may use it | Department manager, such as the controller for financial data |
| Data steward | Day-to-day upkeep of definitions, codes and quality checks | Experienced coordinator or analyst |
| Privacy officer | Oversees handling of personal information and privacy requests | Designated manager, often in operations or HR |
| IT or security lead | Access control, backups and protection | Internal IT or managed service provider |
Canadian privacy basics
In the private sector, Canada's federal privacy law, PIPEDA, applies to personal information handled in commercial activity, while some provinces, including British Columbia, Alberta and Quebec, have their own private-sector laws, and health information is often covered by separate provincial rules. This is general guidance, not legal advice, but the principles behind these laws are familiar and practical:
- Be clear about the purpose for collecting and using personal information.
- Obtain appropriate consent and use the information only for that purpose.
- Collect and keep only what you need.
- Protect it with safeguards suited to its sensitivity.
- Be accountable, including for data processed by vendors on your behalf.
What changes with AI
AI raises specific questions. Is customer or patient data being pasted into a public generative AI tool? Does a vendor use your data to train its models? Could a model's output reveal personal details? Is a new use of existing data consistent with the purpose it was collected for? These should be checked before a tool goes live, ideally with a short privacy impact review.
A worked example
Imagine a physiotherapy clinic that wants AI to summarize intake forms for practitioners. Before the pilot, the clinic's privacy lead confirms where the vendor stores and processes data, that the data is not used to train the vendor's models, that only clinical staff can see the summaries, and that the clinic's notice to patients covers this use. A practitioner reviews every summary before it enters the record. These steps take a few days and remove the largest risks.
Keep governance proportional
Start with a one-page data governance charter: list key data domains, name an owner for each, set basic access rules, and state how AI tools may use each domain. Review it annually or whenever a new AI use case is approved.
Key takeaways
- Assign data owners, stewards and a privacy lead, even in a small organization.
- Apply core privacy principles: clear purpose, consent, minimal collection, safeguards and accountability.
- Check how AI tools and vendors store, use and expose your data before going live.
Apply it at work
Draft a one-page data governance charter for your organization. List your four or five main data domains, name an owner for each, and note whether each contains personal information that AI tools must handle with care.
Fixing data problems with DMAIC
When a data audit shows gaps, the temptation is a one-time cleanup: someone spends a weekend correcting records. Within months the problems return, because the process that creates the data has not changed. Six Sigma's DMAIC cycle offers a better approach: treat poor data as a process defect.
DMAIC applied to data
| Phase | Data quality focus |
|---|---|
| Define | Which data, for which use case, and what quality level is required? |
| Measure | Run the audit; establish baseline scores for each quality dimension |
| Analyze | Find root causes: unclear fields, no time to enter data, poor system design, no feedback |
| Improve | Redesign entry screens, add pick lists, train staff, automate capture |
| Control | Monthly scorecard, owner reviews, standard work for data entry |
Common root causes of poor data
- Free-text fields where a pick list would work
- Fields that the person entering data does not understand or value
- Data entered long after the event, from memory
- Duplicate entry in two systems, leading to differences
- No feedback when data is wrong, so errors are never noticed
A worked example
Imagine a fabrication shop whose job records are needed for an AI quoting assistant. The audit shows that actual hours per job are only 70% complete and often entered at week end.
- Define: actual hours by operation for every job, at least 95% complete and entered on the same day.
- Measure: 70% complete; median entry delay of four days.
- Analyze: a fishbone session finds that the only terminal is in the office, operators do not see why hours matter, and the job codes list is long and confusing.
- Improve: a tablet at each work cell, a shortened code list, a five-minute explanation at the morning huddle of how hours feed quoting.
- Control: the supervisor checks a daily completeness report; the monthly scorecard is posted on the visual board.
After a few months the shop has reliable data, and the quoting assistant can be trained on recent jobs with confidence.
Clean the history wisely
Fixing the process protects future data. For history, clean only what the use case needs, such as the most recent two years of a key table, and document what was changed. Sometimes it is better to start training on a shorter period of good data than a longer period of poor data.
One-time cleanups treat symptoms. Process control prevents recurrence.
Key takeaways
- Treat poor data as a process defect and use DMAIC to fix its root causes.
- Common causes include free-text fields, delayed entry, duplicate entry and lack of feedback.
- Clean only the history a use case needs, and control the process so problems do not return.
Apply it at work
Pick the worst data quality gap from your audit. Hold a 30-minute fishbone session with the people who create the data and list at least three root causes and one process change for each.
Assessing workforce capabilities
AI changes what people do, not just what software does. A readiness plan must know what skills exist today, which ones each priority use case needs and how to close the gap. A skills matrix, already familiar from cross-training in Lean operations, is a practical tool for this.
Four groups of AI-related capability
- Leadership capability – setting direction, judging business cases, sponsoring change and asking the right risk questions.
- User capability – using AI tools effectively, writing good prompts, recognizing poor output and following review rules.
- Process and data capability – mapping processes, managing data quality, defining metrics and redesigning workflows.
- Technical capability – configuring tools, integrating systems, managing security and monitoring performance, whether in-house or through a partner.
Building a simple AI skills matrix
List roles down the side and capabilities across the top. Rate each on a four-point scale: 0 = no exposure, 1 = aware, 2 = can do with support, 3 = can do independently and teach others.
| Role | Use AI tools safely | Judge output quality | Map processes | Manage data quality | Configure / integrate |
|---|---|---|---|---|---|
| Operations manager | 1 | 2 | 3 | 1 | 0 |
| Inside sales lead | 2 | 1 | 1 | 1 | 0 |
| Controller | 1 | 2 | 2 | 3 | 1 |
| IT partner (external) | 2 | 1 | 0 | 1 | 3 |
Reading the matrix
Look for single points of failure, where only one person has a capability, and for gaps against your priority use cases. In the example, nobody internally can configure or integrate tools, so the business depends heavily on its IT partner. Process mapping strength sits with the operations manager alone.
A worked example
Imagine a 70-person distributor whose first use case is automated order entry. The matrix shows the inside sales team will be the main users, yet their ability to judge output quality is low. The plan includes a half-day training on reviewing AI-extracted orders, a clear checklist of fields to verify, and pairing each user with a "super user" who reached level 3 during the pilot.
Close gaps in the right way
- Train for widely needed skills, such as safe tool use.
- Develop champions who learn deeply and support colleagues.
- Hire only when a capability is needed continuously and is strategic.
- Partner for specialized, occasional skills such as model development or complex integration.
Revisit the matrix every six months. It becomes evidence for the skills dimension of your readiness assessment.
Key takeaways
- AI readiness needs leadership, user, process and data, and technical capabilities.
- A skills matrix reveals gaps and single points of failure against priority use cases.
- Close gaps by training broadly, developing champions, hiring selectively and partnering for specialist skills.
Apply it at work
Build an AI skills matrix for five to eight key roles in your organization using the 0–3 scale. Highlight any capability held by only one person and any gap that would block your priority use case.
Roles and accountability for AI initiatives
AI initiatives cross departmental lines. Operations owns the process, IT owns the systems, finance owns the budget and frontline staff do the work. Without clear roles, decisions stall and problems fall between chairs. A RACI chart is a simple way to make accountability explicit.
Key roles in an SME AI initiative
- Executive sponsor – owns the business outcome, approves resources and makes go/no-go decisions.
- Product or process owner – a manager who owns the process the AI supports and will live with the result daily.
- Project lead – coordinates the work, schedule and communication; may be an internal improvement lead.
- Data owner and steward – ensure the right data is available and fit for use.
- Technical lead – configures and integrates the tool, internally or through a partner.
- Super users – frontline staff who test, give feedback and coach peers.
- Privacy or risk reviewer – checks privacy, security and other risks before go-live.
A RACI for an AI pilot
R = Responsible (does the work), A = Accountable (one person who owns the decision), C = Consulted, I = Informed.
| Activity | Sponsor | Process owner | Project lead | Technical lead | Super users |
|---|---|---|---|---|---|
| Approve business case | A | C | R | C | I |
| Measure baseline | I | A | R | I | C |
| Configure tool | I | C | C | A/R | C |
| Redesign workflow | I | A | R | C | R |
| Go/no-go decision | A | R | R | C | C |
Rules for a useful RACI
- Exactly one A per activity.
- Avoid too many Cs; every consultation adds time.
- Check that the process owner is accountable for operational outcomes, not the vendor or IT.
A worked example
Imagine a home care agency piloting AI-assisted scheduling for its care workers. Initially the IT contractor led everything. After building a RACI, the agency makes its scheduling manager the process owner, accountable for the workflow and for the final schedule. Two senior schedulers become super users. The executive director is the sponsor. The change clarifies that the AI suggests schedules and the scheduling manager approves them, which also helps with trust and with responsibility toward clients.
In small organizations one person may hold several roles. That is fine, as long as each role is consciously assigned and nobody assumes someone else is handling it.
Key takeaways
- Name a sponsor, process owner, project lead, data owner, technical lead, super users and risk reviewer.
- Use a RACI chart with exactly one accountable person per activity.
- The process owner, not the vendor or IT, should be accountable for operational outcomes.
Apply it at work
Draw a RACI chart for your priority AI use case covering at least five activities from business case to go/no-go. Check that each activity has exactly one A and that a business manager owns the process outcome.
Leading the human side of change
Technology projects rarely fail because the software cannot do the job. They fail because people do not adopt it, or adopt it in ways that undermine its value. AI adds particular concerns: fear of job loss, doubts about accuracy and worries about being monitored. Established change models help leaders address these deliberately.
ADKAR for individuals
The ADKAR model describes five outcomes each person needs for a change to stick:
| Element | Question for the person | AI example |
|---|---|---|
| Awareness | Why is this change happening? | Explain the business problem the AI addresses |
| Desire | What is in it for me, and do I want to take part? | Show how it removes tedious work, and be honest about role changes |
| Knowledge | How do I do this? | Training on the tool and the new workflow |
| Ability | Can I actually do it in my real work? | Practice with real cases and super-user support |
| Reinforcement | What keeps me doing it? | Recognition, metrics shared, old workarounds retired |
Kotter for the organization
Kotter's eight-step approach is useful at the organizational level. For SMEs, a condensed version works well: create urgency around a real business problem, form a small guiding coalition including respected frontline voices, communicate a clear vision of how work will improve, remove obstacles, deliver visible short-term wins and anchor the new way of working in standard procedures.
Address fears directly
- Job security: be specific about what will happen to freed time. Vague reassurance damages trust.
- Accuracy: show how errors will be caught and that people retain final judgment where it matters.
- Monitoring: be clear about what the tool records and how that data will and will not be used.
- Competence: recognize that experienced staff may feel their expertise is devalued. Involve them as designers and testers.
A worked example
Imagine a 45-person manufacturer introducing AI vision inspection. The quality inspectors are anxious. The plant manager meets them early, explains that defect escapes to customers are the problem, and commits that inspectors will move to root-cause analysis and supplier quality work. Inspectors label the training images, set the rules for when parts are sent for human review, and present early results at a plant meeting. Adoption is strong because the people most affected helped shape the change.
Use an ADKAR check during your pilot: ask super users where each colleague is on the five elements and target support at the first element that is missing.
- Awareness: People understand the business problem the AI addresses and why change is needed now.
- Desire: People see what is in it for them and their concerns, such as job security and monitoring, are addressed openly.
- Knowledge: People know how to use the tool, when to trust its output and when to check or escalate.
- Ability: People can apply it in real work, with practice time, coaching and support close at hand.
- Reinforcement: Leaders recognize good use, track adoption and fix problems quickly so people do not drift back.
Key takeaways
- ADKAR addresses individual adoption: awareness, desire, knowledge, ability and reinforcement.
- A condensed Kotter approach builds organizational momentum through urgency, coalition, vision and quick wins.
- Address fears about jobs, accuracy, monitoring and expertise openly, and involve affected staff in design.
Apply it at work
For your priority use case, list the groups of people it affects. For each group, note the ADKAR element most likely to be missing today and one action to address it.
Building AI literacy and responsible use
Generative AI tools are now inside many products staff already use, and many people try public tools on their own. An organization is therefore using AI whether or not leaders have planned it. AI literacy and a clear acceptable-use policy turn this informal use into a safe, productive capability.
What AI literacy means for staff
- Understanding broadly how generative and predictive tools work, and that they can be confidently wrong
- Writing clear prompts with context, constraints and examples
- Checking outputs for accuracy, especially facts, numbers, citations and calculations
- Knowing which data may and may not be entered into which tools
- Knowing when human judgment must remain in control
Elements of an acceptable-use policy
| Section | What it covers |
|---|---|
| Approved tools | Which AI tools are approved, and on which accounts or licences |
| Data rules | What may not be entered: personal information, client confidential material, trade secrets, unless in an approved tool |
| Review rules | Which outputs need human review before use, and by whom |
| Disclosure | When to tell clients or colleagues that AI assisted the work |
| Prohibited uses | For example, making final decisions about people without human review |
| Reporting | How to report errors, incidents or concerns |
A traffic-light approach
Many SMEs find a simple three-tier rule easy to communicate:
- Green: public or non-sensitive content in approved tools, such as drafting a generic job advertisement.
- Amber: internal business information in approved enterprise tools, with review before use.
- Red: personal health information, client confidential data or decisions about individuals, which need a specifically approved solution and process.
A worked example
Imagine a 25-person engineering office. Leaders discover that several staff use free chatbots to polish reports. Rather than banning AI, they license an enterprise assistant with data protections, issue a two-page policy with traffic-light rules, run a 90-minute training session with examples from real project work, and nominate two champions who share good prompts in a monthly lunch session. Use becomes visible and safer, and good practices spread.
Keep it alive
Review the policy every six months, as tools change quickly. Collect examples of good and poor use and fold them into training. Literacy is not a one-time course; it is a habit of thoughtful use.
Key takeaways
- Staff are likely already using AI, so literacy and clear rules make that use safe and productive.
- An acceptable-use policy covers approved tools, data rules, review, disclosure, prohibited uses and reporting.
- A traffic-light rule makes data handling expectations easy to remember.
Apply it at work
Draft a one-page AI acceptable-use policy for your organization using the six sections in this lesson. Add three concrete green, amber and red examples from your own work.
AI governance and risk management
Governance is how an organization makes sure AI is used in ways that are effective, safe, fair and accountable. Large enterprises may have AI committees and dedicated staff. An SME needs something lighter, but it still needs clear decision rights, a risk review and ongoing oversight.
Useful reference frameworks
Several established frameworks can guide your approach without being adopted in full. The NIST AI Risk Management Framework organizes activity into four functions: govern, map, measure and manage. ISO/IEC 42001 sets out requirements for an AI management system. In Canada, the federal government has published a voluntary code of conduct for organizations developing and managing advanced generative AI systems. Borrow the principles that fit your size and risk.
A simple AI risk register
| Risk | Example | Typical mitigation |
|---|---|---|
| Accuracy | Forecast badly wrong for new products | Confidence thresholds; human review of exceptions |
| Bias and fairness | Screening tool disadvantages some applicants | Avoid automated decisions about people; test outcomes across groups |
| Privacy | Personal information exposed or misused | Privacy review, data minimization, vendor terms |
| Security | Unauthorized access to data through a new integration | Access controls, logging, vendor security review |
| Transparency | Staff cannot explain why a recommendation was made | Record inputs and reasons; keep humans accountable |
| Dependency | Vendor changes pricing or stops the product | Data export rights, documented process fallback |
Tiering by impact
Not every use case needs the same scrutiny. A practical approach classifies each one:
- Low impact: internal drafting or summarizing with human review. Light approval by the process owner.
- Medium impact: outputs that affect customers, costs or operations, such as forecasts or quote drafts. Risk register, defined review rules and sponsor approval.
- High impact: outputs affecting people's health, safety, employment, credit or legal rights. Full risk review, human decision-making retained, and specialist advice where needed.
Human in the loop
Decide explicitly where a person reviews, approves or can override AI output. Common patterns are reviewing everything during a pilot, then moving to reviewing only low-confidence or high-value cases once performance is proven.
A worked example
Imagine a staffing agency considering AI to rank job applicants. Its governance review classifies this as high impact, because it affects people's employment. The agency decides that AI may help summarize résumés against posted requirements, but recruiters make all shortlisting decisions, outcomes are reviewed periodically for unfair patterns, and candidates are told AI assists the process. A lower-impact use, drafting job advertisements, is approved quickly with simple review rules.
Keep a short AI register listing each tool in use, its owner, impact tier and review date. It becomes the backbone of your governance readiness.
Key takeaways
- Frameworks such as the NIST AI RMF and ISO/IEC 42001 offer principles an SME can adapt.
- Keep a risk register covering accuracy, bias, privacy, security, transparency and dependency.
- Tier use cases by impact and define where humans review, approve or override AI output.
Apply it at work
Create an AI register listing every AI tool or feature currently used in your organization, formally or informally. Assign each an owner and an impact tier, and flag any high-impact use without a clear human review step.
Defining performance metrics for AI
If you cannot measure an AI initiative's effect, you cannot defend it, improve it or decide whether to scale it. Good metrics connect the technical performance of a tool to the operational and financial results the business cares about.
Three levels of metrics
| Level | What it measures | Examples |
|---|---|---|
| Model or tool performance | How well the AI does its task | Extraction accuracy, forecast error, defect detection rate, false alarm rate |
| Process performance | How the workflow changes | Cycle time, touch time per transaction, first-pass yield, adoption rate |
| Business outcome | What the organization gains | Cost per order, on-time delivery, inventory turns, customer complaints, margin |
All three are needed. A forecast model can be accurate, yet if buyers ignore it, inventory will not improve. Equally, a business outcome can improve for unrelated reasons, so tool and process metrics help show cause.
Leading and lagging indicators
Lagging indicators, such as annual savings, confirm results but arrive late. Leading indicators, such as the share of orders processed through the new workflow, signal early whether results are likely. Track both.
Setting good metrics
- Define each metric precisely: formula, data source, frequency and owner.
- Measure a baseline before the pilot using the same definition.
- Set a target and a minimum acceptable level for go/no-go decisions.
- Include at least one guardrail metric to catch harm, such as error rate or customer complaints.
A worked example
Imagine a distributor deploying AI to extract order details from emailed purchase orders. Its metric set:
- Tool: field-level extraction accuracy; baseline not applicable; target at least 97%.
- Process: minutes of staff time per order; baseline 6 minutes; target 2 minutes.
- Process: share of orders going through the new flow; target 80% by month three.
- Business: order errors reported by customers per 1,000 orders; baseline 8; target 4.
- Guardrail: same-day order cut-off met; must not fall below baseline.
With about 1,500 orders a month, saving 4 minutes each frees about 100 staff hours monthly. The team uses the automation ROI calculator to convert these figures into annual savings and payback, then checks them against actual results each month.
Report simply
Put the metrics on a one-page visual board or dashboard reviewed at a regular operations meeting. Metrics that are seen and discussed drive behaviour; metrics buried in a report do not.
Key takeaways
- Measure AI at three levels: tool performance, process performance and business outcome.
- Define each metric with a formula, source, owner, baseline, target and minimum acceptable level.
- Track leading indicators and guardrail metrics alongside lagging financial results.
Apply it at work
Define five metrics for your priority use case: one tool metric, two process metrics, one business outcome and one guardrail. Then enter your estimates into the automation ROI calculator lab to test the value.
Running a disciplined pilot
A pilot is a controlled test of whether an AI solution works in your real environment and is worth scaling. Designed well, it produces a clear decision. Designed poorly, it produces a nice demonstration and a stalled project.
The pilot charter
Write a one-page charter before starting. It should include:
- Objective: the problem and the question the pilot must answer.
- Scope: which process, location, product line or team, and what is out of scope.
- Duration: typically six to twelve weeks, long enough to see normal variation.
- Metrics: baseline, target and minimum acceptable values.
- Roles: sponsor, process owner, project lead, super users and technical support.
- Risk controls: human review rules, fallback to the old process, privacy checks.
- Decision criteria: what result means scale, adjust or stop.
Use PDCA inside the pilot
- Plan: configure the tool, redesign the workflow, train super users.
- Do: run on real work at a controlled volume.
- Check: review metrics and user feedback weekly; analyze errors by type.
- Act: adjust prompts, rules, training or workflow, and repeat.
Go/no-go criteria
| Outcome | Criteria example | Decision |
|---|---|---|
| Scale | Targets met; users confident; integration path clear | Plan rollout |
| Adjust | Minimums met but targets missed; causes understood | Extend pilot with specific changes |
| Stop | Minimums missed with no clear fix, or unacceptable risk | Close and record lessons |
Stopping is a legitimate, valuable result. A pilot that shows an idea will not work, at modest cost, has saved the business from a larger failure.
A worked example
Imagine a clinic piloting AI to draft referral letters from practitioners' notes. The charter limits scope to one practice area and eight weeks, with every draft reviewed. The target is to cut letter preparation time in half, with a guardrail of zero clinically significant errors reaching the final letter. Weekly checks show time savings on track, but drafts often miss medication details. The team adjusts the template prompt and adds a checklist item. By week eight, targets are met and the sponsor approves rollout to two more practice areas.
Pilot with production in mind
Use real data, real users and, where possible, the real integration path. A pilot that relies on hand-cleaned samples or a separate tool nobody will use in production cannot answer the go/no-go question honestly.
Key takeaways
- Write a one-page pilot charter with objective, scope, duration, metrics, roles, risk controls and decision criteria.
- Run weekly PDCA cycles during the pilot and analyze errors by type.
- Set scale, adjust and stop criteria in advance, and treat stopping as a valid outcome.
Apply it at work
Write a one-page pilot charter for your priority use case using the seven headings in this lesson. Have your sponsor review and agree the go/no-go criteria before any work begins.
Scaling from pilot to everyday operations
A successful pilot proves that a solution can work. Scaling makes it part of how the business runs every day: integrated, supported, monitored and improved. This step is where many organizations underestimate the effort.
What changes when you scale
| Area | In the pilot | In production |
|---|---|---|
| Users | A few motivated super users | Everyone in the process, including sceptics |
| Data | A controlled set, closely watched | Full live volume, including unusual cases |
| Integration | Workarounds tolerated | Reliable, secure connections to core systems |
| Support | Project team on hand | Defined help desk, owner and vendor support |
| Procedures | Informal | Updated standard work and training materials |
The control plan
Borrowing again from Six Sigma, a control plan keeps performance from slipping after handover. For each key metric it lists the target, how and how often it is measured, who reviews it and what action follows if it goes out of range.
Monitoring AI after go-live
AI performance can change over time even if nothing in the software changes. Customer mix shifts, new products appear, suppliers change document formats. This is often called drift. Monitor:
- Tool accuracy on a regular sample of reviewed cases
- The share of cases sent to human review or overridden
- User feedback and reported errors
- Business outcomes against the original business case
Set a trigger, for example "if more than one in ten extractions need correction for two weeks running, the process owner and vendor review the configuration".
A rollout sequence
- Update standard work, training and the RACI for production roles.
- Complete production integration and security checks.
- Roll out in waves by team or site, with super users supporting each wave.
- Retire old workarounds and duplicate processes once each wave is stable.
- Hand over to the process owner with the control plan in place.
- Review results against the business case at three and six months.
A worked example
Imagine a manufacturer scaling vision inspection from one line to four. The plant updates inspection procedures, trains operators on each line, and sets a weekly review of false rejects and escapes. On the third line, a different paint supplier causes a rise in false rejects. Because monitoring is in place, the team notices within days, adds new labelled images and restores performance.
Build reusable capability
Each scaled use case should leave behind reusable assets: cleaner data, integrations, templates, trained champions and governance routines. That is how an SME moves from one-off projects to a repeatable AI capability.
- Update standard work: Revise procedures, training and the RACI for production roles.
- Integrate and secure: Complete reliable, secure connections to core systems and run security checks.
- Roll out in waves: Go live team by team or site by site, with super users supporting each wave.
- Retire workarounds: Remove old workarounds and duplicate processes once each wave is stable.
- Hand over to owner: The process owner takes over with a control plan and drift monitoring in place.
- Review results: Compare outcomes with the business case at three and six months.
Key takeaways
- Scaling requires production integration, support, updated standard work and broad training.
- Use a control plan and monitor for drift with clear triggers for action.
- Roll out in waves, retire old workarounds and capture reusable assets for the next use case.
Apply it at work
Draft a control plan for your priority use case covering at least three metrics. For each, state the target, measurement frequency, reviewer and the action to take if it goes out of range.
Wrap-up: your 90-day AI readiness plan
You now have the building blocks of AI readiness: a framework to assess where you stand, tools to find and prioritize use cases, methods to audit and fix data, approaches for people and change, and the governance, metrics and pilot discipline needed to scale. The final step is to turn them into a practical plan.
A 90-day structure
| Period | Focus | Key outputs |
|---|---|---|
| Days 1–30 | Assess and align | Readiness assessment with evidence, sponsor named, acceptable-use policy issued, use-case discovery workshop held |
| Days 31–60 | Prioritize and prepare | Scored value–effort matrix, one quick win chosen, data audit completed, business case and pilot charter approved |
| Days 61–90 | Pilot and learn | Pilot running with baseline and weekly PDCA, skills plan under way, data fixes in progress for the next strategic bet |
Plan for the weakest dimensions
Return to your readiness assessment. For each dimension scoring 1 or 2, write one action that will lift it by one level within 90 days. Keep actions small and specific, such as "name data owners for sales and inventory data" rather than "improve data governance".
A worked example
Imagine a 55-person industrial distributor. Its assessment scores governance at 1, data quality at 2 and use-case pipeline at 2, with stronger culture and infrastructure. Its 90-day plan:
- Week 2: issue a two-page AI acceptable-use policy and an AI register.
- Week 4: run a discovery workshop on order-to-cash; build the pipeline.
- Week 6: score eight ideas; choose order extraction as the quick win and demand forecasting as the strategic bet.
- Week 8: complete a data audit on sales history; begin logging stock-outs.
- Week 9: approve the business case and pilot charter for order extraction.
- Weeks 10–13: run the pilot with weekly reviews; reassess readiness at day 90.
Keep the cycle going
- Reassess readiness every six months and compare the radar chart shape.
- Refresh the use-case pipeline quarterly.
- Review the AI register and policies at least twice a year.
- Share results openly, including stopped pilots and lessons learned.
Readiness is not a gate you pass once. It is a capability you build with every use case.
Complete the final exam to earn your Chmltech certificate of completion. Then put the first two weeks of your plan on the calendar today, while the ideas are fresh.
- Days 1–30 (Assess and align): Readiness assessment with evidence; Sponsor named; Acceptable-use policy issued; Use-case discovery workshop held
- Days 31–60 (Prioritize and prepare): Scored value–effort matrix; One quick win chosen; Data audit completed; Business case and pilot charter approved
- Days 61–90 (Pilot and learn): Pilot running with baseline and weekly PDCA; Skills plan under way; Data fixes for the next strategic bet; Readiness reassessed at day 90
Key takeaways
- Structure the next 90 days as assess and align, prioritize and prepare, then pilot and learn.
- Target one specific action for each readiness dimension scoring 1 or 2.
- Reassess readiness, refresh the pipeline and review governance regularly to build lasting capability.
Apply it at work
Write your own 90-day AI readiness plan using the three-period structure. Include at least one action for each low-scoring dimension, name an owner for each action and book the first two actions in your calendar.
AI Readiness Self-Assessment
Score your organization from 1 to 5 on seven readiness dimensions to see your maturity profile on a radar chart. Use the result to find the weakest dimension that will set the pace of your AI journey.
AI Use-Case Prioritization Matrix
Rate each AI use case on effort or feasibility difficulty and on business value to see which are quick wins and which are strategic bets. Rename or add items to reflect your own pipeline.
AI Use-Case ROI Calculator
Enter the manual hours, labour cost, share of work automatable and the build and running costs of an AI use case to estimate annual savings, payback and three-year ROI. Use it to test the assumptions in your business case.
Final exam: AI Readiness: Strategy and Operational Impact
20 questions covering the whole course. Score 70% or higher to pass and unlock your certificate of completion. You can retake it as often as you like, and wrong answers come with explanations.
Your certificate of completion
Enter your name as you want it to appear, then print or save it as a PDF.
Certificate of completion
This certifies that
Your name
has successfully completed the free Chmltech course
AI Readiness: Strategy and Operational Impact
24 lessons · 3 interactive labs · final exam passed
Keep learning