Performing an AI Capability and Maturity Assessment — and the Strategic Benefits
- Feb 24
- 6 min read
Updated: May 14
1. Insight
As AI adoption accelerates, many organisations find themselves grappling with the question:
"How Mature Is Our AI Capability?"
For many leaders, this question is difficult to answer with confidence — not because AI is unfamiliar, but because activity can grow faster than organisational visibility, coordination and control, creating an AI Confidence Gap. An AI Capability and Maturity Assessment provides a structured, evidence-based view of an organisation’s current AI capability and control across key dimensions including technology, people, data, governance and leadership.
It establishes a transparent, evidence-based view of the current state, creating a common reference point for leadership and a practical means of measuring progress over time.
It also provides an approval gateway for investment. It helps leaders test whether AI business cases are realistic against current maturity and controls. Where ambition exceeds readiness, investment can be sequenced — deferred until maturity improves or approved only alongside a clear maturity uplift plan.
Within the Orr Consulting AI Transformation Process, AI Capability and Maturity Assessment sits firmly in the Discover stage.
Its purpose is to establish an honest, evidence-based baseline of current capability and control before decisions are made about prioritisation, strategy or investment.
2. Why This Matters
Many organisations already have AI in place — often introduced incrementally, opportunistically or through individual teams.
What is far less common is a joined-up understanding of:
What AI capabilities actually exist
How effectively they are being used
Where constraints and risks sit
What is realistically achievable next
Without this understanding, organisations often:
Over-estimate readiness
Under-estimate delivery and governance risk
Pursue AI initiatives that struggle to scale
Discover critical constraints too late
Make poor investment decisions
An AI Capability and Maturity Assessment replaces assumption with evidence. It allows leaders to make decisions based on where the organisation is today, not where it hopes or assumes it might be.
Its purpose is to make those gaps visible, measurable and actionable — creating the clarity required for deliberate improvement.
3. Assessment and Benefits
The assessment examines organisational readiness across five core capability pillars. Together, these provide a balanced view of both enablers and constraints.
Each pillar is assessed using a clear 0–5 maturity scale, producing transparent scores supported by qualitative evidence and rationale.
3.1 AI Capabilities
Assesses the AI capabilities currently in place and how effectively they are being used.
Assesses:
Which types of AI are present (e.g. Generative AI, Predictive AI etc)
Where and how they are deployed
Alignment to business priorities
Evidence of impact and realised benefit
Benefits:
Provides an honest view of existing capability
Highlights under-utilisation and duplication
Identifies where AI is — and is not — delivering value
3.2 Education and Training
AI capability is inseparable from workforce capability.
Assesses:
AI awareness across leadership, managers and staff
Confidence in using AI appropriately and responsibly
Availability of structured education and guidance
Reliance on informal or unsupported learning
Benefits:
Identifies skills gaps that constrain adoption
Reduces operational and reputational risk
Supports safer, more effective AI use
3.3 Governance and Assurance
As AI use increases, so does accountability.
Assesses:
Existence and clarity of AI policies and standards
Ownership, accountability and oversight
Risk management and assurance processes
Ethical considerations and responsible use controls
Benefits:
Surfaces governance weaknesses early
Supports defensible, auditable AI adoption
Reduces regulatory and reputational exposure
3.4 Data Readiness
AI capability is fundamentally constrained by data capability.
Assesses:
Data quality, accessibility and consistency
Data governance and ownership
Suitability of data for AI use cases
Integration across systems and functions
Benefits:
Grounds AI ambition in data reality
Identifies dependencies that limit feasibility
Informs prioritisation and sequencing
3.5 Strategy and Culture
Even where technical capability exists, organisational readiness may not.
Assesses:
Clarity of AI vision and intent
Leadership alignment and sponsorship
Cultural openness to change and experimentation
Trust, transparency and communication around AI
Organisational change and strategic delivery capability (the ability to lead and sustain AI-enabled transformation)
Benefits:
Reveals leadership and cultural constraints
Tests the organisation’s ability to translate intent into sustained change
Improves adoption and sustainability
Supports realistic planning, sequencing and change management
3.6 Maturity Scoring (0–5)
Each capability pillar is assessed using the same maturity logic, reflecting the degree of intentionality, structure and control applied to that capability.
0 — Informal Little to no formal capability exists. Activity, where present, is informal, inconsistent or opportunistic. Capability is driven by individuals or local teams, with no consistent structure, ownership or governance.
1 — Incidental Very limited capability exists. Early experimentation or isolated activity is evident, but practices are inconsistent, oversight is minimal and reliance on individual effort remains high.
2 — Limited Capability exists in pockets but remains immature. Awareness is increasing and some structures or controls are emerging, but significant gaps constrain reliability and impact.
3 — Emerging Capability is functioning and repeatable in defined areas. Roles, processes and controls exist and are understood, though consistency and coverage remain uneven.
4 — Leading Capability is strong, well-governed and consistently applied. Controls are effective, risks are actively managed and the capability delivers measurable value.
5 — Best Practice Capability is mature, embedded and continuously improving. Assurance is robust and the capability can be benchmarked against peers or industry leaders.
3.7 Overall Maturity Score (0–25)
Organisational maturity reflects how consistently and repeatably capability and control are applied across functions, rather than the existence of isolated pockets of advanced activity.
The five pillar scores are summed to produce an Overall AI Maturity Score out of 25.
3.8 Maturity Brackets
These brackets describe how consistently AI capability and controls are applied across the organisation.
0–5 Incidental Capability
AI capability is largely informal or incidental. Little formal capability exists. Activity is ad hoc and inconsistent, with no clear ownership or governance. Shadow AI use is common.
6–10 Limited Capability
AI capability exists in pockets. Some activity is underway, but it is inconsistent and locally driven. Visibility controls and governance are limited.
11–15 Emerging Capability
AI capability is developing. Adoption is increasing and some structure exists, but consistency and controls are still uneven across the organisation.
16–20 Leading Capability
AI capability is becoming consistent. Capability and controls are established in most areas, with growing visibility, governance and assurance.
21–25 Best Practice
AI capability is embedded and assured. Capability and controls are consistently applied, well governed and continuously improved across the organisation.
3.9 Strategic Benefits
The Overall AI Maturity Score is not an end in itself, but a transparent baseline — a shared, evidence-based view of current capability and control.
It does not close the AI Confidence Gap, but makes it visible, measurable and actionable so improvement can be planned and tracked over time.
The Overall AI Maturity Score provides the following strategic benefits:
A clear, executive-level view of the current maturity and consistency of AI capability and control
A defensible baseline against which improvement and progress can be tracked over time
A practical mechanism for setting realistic target maturity levels aligned to strategy and risk appetite
An executive approval gateway for AI investment, validating business cases against current maturity and controls
A defensible evidence base for governance, audit and emerging regulatory expectations — helping leaders demonstrate how AI capability, controls and maturity are understood, monitored and improved over time
Once a baseline is established, the assessment can be repeated periodically to track progress and recalibrate priorities.
4. Risks if Not Addressed
Organisations that proceed without a clear understanding of AI maturity face predictable risks:
Over-ambitious initiatives that exceed readiness
Delivery failures caused by hidden constraints
Governance gaps discovered only after AI is live
Loss of confidence among leaders, staff or regulators
Investment in AI initiatives the organisation is not ready to adopt
These risks rarely arise because of the technology itself — they arise when readiness is assumed rather than assessed.
5. Mitigating Actions
An AI Capability and Maturity Assessment can be used in several ways:
As a standalone diagnostic
As a baseline and target-setting exercise
As a periodic health check to confirm progress and course-correct
In each case, the goal is the same: a clear baseline, practical actions and a repeatable way to evidence progress.
6. Final Thoughts
An AI Capability and Maturity Assessment is not about judging how “advanced” an organisation is. It is about establishing a clear, honest baseline that leaders can confidently act upon.
Done well, it provides:
A realistic view of current AI capability
Clarity on gaps in skills, data, governance and technology
A sound basis for prioritisation and planning
A repeatable way to track progress over time
Most importantly, it gives leaders confidence that AI adoption is progressing in a controlled, measurable and strategically aligned way, rather than through disconnected or ad-hoc initiatives.
The outputs of the assessment directly inform the Design stage of the AI Transformation Process. Specifically, AI Strategy and Roadmap development and Governance and Assurance design — ensuring improvement efforts are structured, proportionate and aligned to organisational objectives.
This Insight is part of the Orr Consulting AI Insights Library — structured thinking for AI transformation leaders and decision makers.
7. Call to Action
If AI is already present within your organisation — formally or informally — establishing a clear, evidence-based baseline of AI capability and control is often the most valuable first step.
If you would like to explore how an assessment could support your organisation, please get in touch.
Baseline clearly. Prioritise confidently. Improve deliberately.
Subscribe to Orr Consulting to receive occasional emails with practical AI Insights and updates.