Pilot Purgatory to BAU
AI Strategy LuminateCX Business Transformation AI Governance Enterprise AI Responsible AI OpenAI May 1, 2025 10:53:12 PM Steven Muir-McCarey 13 min read

Introduction
When OpenAI released its AI in the Enterprise guide, it offered a compelling blueprint for AI adoption. The seven lessons—drawn from companies like Klarna, BBVA, and Morgan Stanley—are instructive and well-articulated.
But for most enterprises, especially in regulated industries or mid-market environments, getting from AI pilot to business-as-usual (BAU) requires more than inspiration. It calls for a structured path, organisational readiness, and a mindset shift. This article offers a strategic reflection on OpenAI's lessons, adding context, caution, and concrete steps. The goal: help enterprises move from experimentation to embedded capability.
1. Start with Evals — but Choose Metrics That Matter
OpenAI recommends: Start with systematic evaluation processes to measure how AI models perform against use cases.
Why it matters
Morgan Stanley's early success with generative AI stemmed from carefully structured model evaluations (OpenAI, 2024). By rigorously assessing summarisation, translation and relevance, they created confidence to scale.
LuminateCX Insight: Many enterprises over-index on model benchmarks without linking them to operational impact. A model might hit 95 percent accuracy and still fail to change outcomes. Without alignment between eval metrics and business KPIs, evals create false confidence.
Actionable step: Develop eval frameworks that blend technical benchmarks with real-world metrics—such as cycle time, task completion rate, or reduction in manual effort. Include compliance and safety as explicit criteria.
2. Embed AI in Products — but Rethink the Journey Too
OpenAI recommends: Embed AI into your products to create smarter, more responsive customer experiences.
Why it matters
Indeed's use of AI to explain job matching improved engagement and conversion, driving a 20 percent increase in applications started (OpenAI, 2024).
LuminateCX Insight: Too often, enterprises layer AI features onto existing tools without rethinking the broader experience. This leads to confusion or degraded UX. The AI feature may be technically impressive but not functionally useful.
Actionable step: Use AI to redesign the workflow, not just add a feature. Co-design with users. Pilot with human-in-the-loop controls. Make it easier, not just more advanced.
3. Start Early — but Only If You're Ready
OpenAI recommends: Invest and start early to gain compounding value.
Why it matters
Klarna's early investment led to an AI assistant now handling two-thirds of customer chats, delivering a projected $40 million in efficiency gains (OpenAI, 2024).
LuminateCX Insight: Some organisations start before governance, security, or alignment is in place. Samsung's data leak via ChatGPT use by engineers led to an internal ban and reputational risk (TechCrunch, 2023).
"Starting early is not the same as starting recklessly.
Actionable step: Begin AI adoption early—but with sandbox environments, policy frameworks, and risk assessments in place.
4. Fine-Tune When Necessary — but Don't Default to It
OpenAI recommends: Customise and fine-tune models for specific use cases.
Why it matters
Lowe's improved product tagging accuracy by 20 percent through fine-tuning GPT models (OpenAI, 2024).
LuminateCX Insight: Fine-tuning increases operational complexity. It creates maintenance overhead, locks in assumptions, and limits flexibility when base models evolve. Fine-tuned models can also become outdated quickly and require constant retraining (OpenAI Community Forum, 2024).
Actionable step: Use prompt engineering and retrieval-augmented generation first. Only fine-tune if performance gains justify long-term cost and effort. Maintain documentation for versioning and compliance.
5. Empower Experts — but Ensure Support Structures Exist
OpenAI recommends: Put AI in the hands of the people closest to the process.
Why it matters
BBVA enabled over 125,000 employees to create their own GPT-powered apps. This decentralised innovation accelerated adoption and surfaced unexpected value (OpenAI, 2024).
LuminateCX Insight: Giving people access to AI doesn't mean they will use it effectively. Many teams lack training, support, or incentives. AI tools without enablement lead to inconsistent adoption.
Actionable step: Provide onboarding, training, guardrails, and coaching. Launch internal AI Champion programs to ensure AI literacy and responsible use across departments.
6. Unblock Developers — and All Other Stakeholders
OpenAI recommends: Automate software development processes to accelerate AI delivery.
Why it matters
Mercado Libre built a platform (Verdi) that allowed over 17,000 developers to accelerate AI-enabled applications, improving inventory, fraud detection, and customer experience (OpenAI, 2024).
LuminateCX Insight: Bottlenecks rarely exist in development alone. Security, legal, procurement, and compliance often delay deployment—especially in regulated industries.
Actionable step: Establish an AI Delivery Council that includes compliance, security, and operations early in the design process. Map AI delivery friction points across the organisation, not just in code.
7. Set Bold Automation Goals — but Stay Grounded
OpenAI recommends: Aim high with AI. Don't limit yourself to low-hanging fruit.
Why it matters
Ambitious automation can transform processes and free capacity. OpenAI automated internal support workflows, increasing efficiency (OpenAI, 2024).
LuminateCX Insight: Overpromising AI potential without operational discipline leads to failed projects and executive fatigue. Not all processes are ready for automation.
Actionable step: Use a value-risk framework to prioritise automation. Start with rule-based, repetitive tasks with measurable ROI. Keep humans in the loop where judgment is required.
From Pilot to BAU: What It Really Takes
Moving AI into BAU doesn't just mean deploying it. It means:
- Clear ownership and accountability
- KPIs linked to operational or customer outcomes
- Change management and communication
- Ongoing model monitoring, retraining, and compliance review
LuminateCX Insight: AI in production must meet the same standards as any enterprise system: secure, supported, and sustainable.
LuminateCX BAU Readiness Checklist
Before scaling an AI use case, ask:
Is this project aligned to business KPIs, not just experimentation goals?
Do we have compliance and risk controls in place?
Has the impacted team been trained and consulted?
Do we have the infrastructure to monitor and retrain this model?
Is there a fallback plan or human override mechanism?
If the answer to any of the above is "no," the project may not be ready to move to BAU.
Conclusion
OpenAI's seven lessons are a valuable starting point. But AI adoption doesn't succeed through vision alone. It requires readiness, execution discipline, and clarity on what "good" looks like post-pilot.
"For enterprise leaders, the challenge is not in launching AI pilots—it's in embedding AI in ways that are safe, valuable, and scalable.
For enterprise leaders, the challenge is not in launching AI pilots—it's in embedding AI in ways that are safe, valuable, and scalable. That's what separates AI as hype from AI as a lever for transformation.
Next Step: Turn Insight Into Action
LuminateCX works with enterprise and government leaders to assess readiness, design governance-aligned AI roadmaps, and embed AI capabilities responsibly.
- Schedule a Pulse consultation to assess where you sit on the BAU maturity curve.
- Or engage in an Ignite workshop to build a full operationalisation plan.
References
- OpenAI. (2024). AI in the enterprise: Lessons from seven frontier companies. Retrieved from https://openai.com/business/
- Weill, P., Woerner, S., & Kiron, D. (2025). What's your company's AI maturity level? MIT Sloan Management Review. Retrieved from https://mitsloan.mit.edu/ideas-made-to-matter/whats-your-companys-ai-maturity-level
- TechCrunch. (2023, May 2). Samsung bans use of generative AI tools like ChatGPT after internal data leak. Retrieved from https://techcrunch.com/2023/05/02/samsung-bans-use-of-generative-ai-tools-like-chatgpt-after-april-internal-data-leak/
- OpenAI Community Forum. (2024). Fine-tuning myths and usage guidance. Retrieved from https://community.openai.com/t/fine-tuning-myths-openai-documentation/133608