
The Trolley Problem
Mental Models for IT
The Trolley Problem presents a scenario where a runaway trolley is heading toward five people tied to the tracks. The driver or a bystander can pull a lever to divert the trolley onto another track, where one person is tied.
The decision to act, or not act, forces a moral choice between two harmful outcomes. It challenges decision-makers to weigh the morality of actions versus their consequences, often revealing the complexity of real-world choices.
It is particularly relevant in modern technologies like Artificial Intelligence and autonomous cars.
The Trolley Problem is a vital model for IT leaders, offering a framework to navigate complex decisions where trade-offs are inevitable. By systematically evaluating competing risks and outcomes, leaders can ensure decisions align with ethical, strategic, and operational priorities.
The Trolley Problem presents a scenario where a runaway trolley is heading toward five people tied to the tracks. The driver or a bystander can pull a lever to divert the trolley onto another track, where one person is tied. The decision to act, or not act, forces a moral choice between two harmful outcomes. It challenges decision-makers to weigh the morality of actions versus their consequences, often revealing the complexity of real-world choices. It is particularly relevant in modern technologies like Artificial Intelligence (see the section on AI Ethics & Regulations) and autonomous cars. The Trolley Problem is a vital model for IT leaders, offering a framework to navigate complex decisions where trade-offs are inevitable. By systematically evaluating competing risks and outcomes, leaders can ensure decisions align with ethical, strategic, and operational priorities.
It was first introduced by philosopher Philippa Foot in 1967 as a thought experiment to explore ethical dilemmas, and was later dubbed as “the trolley problem” by Judith Jarvis Thomson. You find situations as AI technologies and autonomous cars continue to advance. In 2016 the German federal government appointed a commission to study the ethical implications of autonomous driving. The commission adopted 20 rules to be implemented in the laws that will govern the ethical choices that autonomous vehicles will make.
See link: Trolley problem – Wikipedia

Diagram of the Trolley Problem, Original: McGeddon Vector: Zapyon – This SVG diagram includes elements from this icon, shown here as per CC BY-SA 4.0 licensing.
IT Decision-Making Scenarios
In IT, the Trolley Problem manifests in decisions where trade-offs between competing risks are inevitable. For example, an IT leader might face a choice between deploying a new, untested cloud platform (risking system instability) or sticking with an outdated, legacy system (risking security vulnerabilities). Another scenario could involve allocating a limited budget between cybersecurity investments (to prevent breaches) and innovation initiatives (to drive growth). Both choices involve weighing immediate and long-term consequences, mirroring the ethical tension in the original dilemma.

Artificial Intelligence & Ethics
For IT leaders and CXOs, the Trolley Problem isn’t just a philosophical puzzle—it’s a powerful operational framework for building and governing ethical AI systems. Here’s how it directly applies to Explainable AI (XAI) and AI Risk & Regulatory Frameworks:
1. For Explainable AI (XAI): Making the “Lever Pull” Auditable
The core of the Trolley Problem is justifying whyy ou chose to divert (or not divert). In AI, this translates directly to the need for explainability.

- The “Black Box” is the Unexplained Lever Pull: If an autonomous vehicle’s AI decides to swerve, or a loan-approval AI denies an application, and you cannot articulate the reasoning (e.g., “It prioritized minimizing total harm based on Feature X, Y, Z”), you have an unexplainable, and therefore ungovernable, system.
- XAI as the Justification Log: XAI tools (LIME, SHAP, etc.) are the technical means to produce the “decision rationale.” They answer: “Which ‘track’ (data feature, model parameter) did our AI ‘pull the lever’ on, and why?” This is essential for:
- Internal Audits: Validating that the AI’s logic aligns with corporate ethics and safety protocols.
- External Scrutiny: Demonstrating to regulators, customers, and affected individuals that the decision wasn’t arbitrary or discriminatory.
- Debugging & Improvement: Understanding failure modes to retrain models responsibly.
You cannot have ethical AI without explainable AI. XAI is the proof that your system’s “moral choice” was based on reasoned, pre-defined criteria, not hidden biases or random noise.
2. For AI Risk & Regulatory Frameworks: Institutionalizing the Trolley Problem
Regulations (like the EU AI Act, NIST AI RMF, ISO/IEC 42001) force organizations to systematize the Trolley Problem before deployment.
- Pre-Defining the “Tracks”: Frameworks require you to document your risk tolerance and ethical principles upfront. This is the act of designing the tracks. For example:
- “Our autonomous driving system will be programmed to prioritize minimizing overall harm, with a specific weighting that gives higher value to human life over property.”
- “Our hiring AI will be prohibited from using demographic proxies, even if they correlate with performance, to avoid disparate impact.”
- Establishing the “Lever Pull” Protocol: Frameworks mandate impact assessments, human oversight, and redress mechanisms. This formalizes who gets to pull the lever and how.
- High-Risk AI (e.g., in healthcare, critical infrastructure) often requires a human-in-the-loop for final decisions, mirroring the “bystander must act” scenario with accountability.
- Risk Assessments are the pre-incident analysis of potential outcomes on all “tracks.” You must ask: “If our AI diverts in direction A, who gets harmed? What is the severity? What is the probability?”
- Post-Incident Review & Liability: When an AI causes harm, the framework dictates the investigation. This is the after-action review of the Trolley Problem. Did the AI follow its programmed ethics? Was the risk assessment flawed? Who is liable—the developer, the operator, the organization?
Regulatory frameworks ensure you don’t wing the Trolley Problem. They compel you to:
- Proactively define your ethical trade-offs (your “tracks”).
- Build systems (XAI, testing, oversight) that can execute and justify choices.
- Document everything to prove due diligence and assign accountability.
The Trolley Problem teaches that inaction is also a programmed choice (e.g., choosing not to implement XAI, or to ignore a known bias). Modern AI ethics frameworks force you to make that choice consciously, transparently, and accountably.You must champion a process where engineers, ethicists, legal, and business units collaborate to answer the Trolley Problem for every high-stakes AI use case.
A governed AI system is where:
- Its ethical “rules” are documented (the lever-pulling policy).
- Its specific decisions are explainable (the lever-pull log).
- Its risks are managed per a recognized framework (the safety protocol).
By applying this lens, you move from reacting to AI failures to systematically engineering ethical resilience into your technology portfolio—turning a profound moral dilemma into a manageable operational and regulatory requirement. This is how you build trustworthy AI that aligns with both your values and your bottom line.
IT & Business Services Examples
In IT and business services, the Trolley Problem might arise when choosing between a cost-effective vendor with a history of compliance issues or a more expensive partner with a proven track record of ethical practices. Similarly, a company might need to decide between automating customer service (improving efficiency but risking job losses) or retaining human agents (preserving jobs but increasing costs). These decisions require balancing operational efficiency with ethical and social responsibilities.
IT Services
In IT services, the Trolley Problem emerges when managing third-party vendors or in-house teams. For instance, a company may need to choose between outsourcing a critical function to a vendor with lower costs but questionable data privacy practices or retaining in-house teams with higher expenses but greater control over compliance. The decision-maker must weigh the risk of data breaches against the financial burden of maintaining internal expertise. This dilemma is exacerbated by the global nature of IT services, where legal and cultural differences complicate ethical choices. Another example is the prioritization of service-level agreements (SLAs) versus customer satisfaction. A strict SLA might ensure technical performance but alienate users who experience delays. Here, the Trolley Problem becomes a framework for evaluating trade-offs between technical excellence and human-centric outcomes. IT leaders must also consider the long-term implications of their choices, such as vendor lock-in or the erosion of organizational agility. By applying the Trolley Problem model, leaders can systematically assess risks, align decisions with organizational values, and ensure that ethical considerations are not sidelined in pursuit of efficiency.
Enterprise FinOps
In Enterprise FinOps, the Trolley Problem is evident when optimizing IT spend across the entire technology stack, not just the cloud. For example, a leader might face the choice of reallocating funds from on-premises infrastructure to cloud services, which could reduce upfront costs but increase dependency on third-party providers. Alternatively, maintaining on-premises systems might preserve control but limit scalability. This decision requires evaluating not just immediate financial metrics but also long-term strategic goals, such as innovation capacity or regulatory compliance. Another scenario involves balancing short-term cost savings (e.g., reducing software licenses) against the risk of stifling innovation by limiting access to essential tools. FinOps leaders must navigate these dilemmas by integrating ethical considerations into financial planning, ensuring that cost optimization does not compromise the organization’s ability to adapt or meet stakeholder expectations. This model encourages a holistic view of spend, where trade-offs are evaluated through the lens of both financial and ethical impact.
IT Operations
In IT Operations, the Trolley Problem often surfaces during incident response. For instance, a system outage may require a choice between a quick fix (which risks introducing new bugs) or a slower, more thorough resolution (which prolongs downtime). Similarly, a security vulnerability might demand a decision between patching immediately (potentially causing service interruptions) or delaying the fix (increasing exposure to threats). These scenarios force IT leaders to balance operational continuity with risk mitigation. The ethical dimension arises when considering the impact on end-users, such as prioritizing customer experience over system stability. By applying the Trolley Problem model, IT operations teams can systematically evaluate trade-offs, ensuring decisions align with both technical and ethical priorities.
Business Strategy
In business strategy, the Trolley Problem is relevant when choosing between aggressive expansion (high risk, high reward) and cautious growth (low risk, limited gains). For example, a company might face a decision to enter a new market with unproven demand or focus on refining its core offerings. Similarly, investing in AI-driven innovation could disrupt existing workflows but position the company for future leadership. These choices require weighing immediate opportunities against long-term sustainability, often involving trade-offs between stakeholder interests (e.g., shareholders vs. employees). The Trolley Problem model helps leaders frame these decisions as ethical choices, ensuring that strategic moves are not driven solely by profit but also by alignment with organizational values.
Operations Management
In operations management, the Trolley Problem arises when optimizing processes. For instance, automating a critical workflow might increase efficiency but displace workers, while maintaining manual processes preserves jobs but increases costs. Leaders must weigh these outcomes, considering not just productivity metrics but also the human impact. Another example is the choice between centralized control (for consistency) and decentralized operations (for agility). These decisions require balancing efficiency with flexibility, ensuring that operational strategies align with broader organizational goals.
Innovation
Innovation decisions often mirror the Trolley Problem. For example, a company might choose between investing in a risky, transformative technology (e.g., quantum computing) or maintaining existing systems (ensuring stability). The dilemma lies in balancing the potential for disruption against the risk of obsolescence. Leaders must evaluate these trade-offs through the lens of long-term impact, ensuring innovation aligns with ethical and strategic priorities.
Customer Experience
In customer experience, the Trolley Problem might involve choosing between rapid feature rollouts (risking bugs) or thorough testing (delaying delivery). Leaders must balance speed with quality, ensuring decisions align with customer expectations and ethical standards.
Transformation
During transformation, the Trolley Problem emerges when choosing between rapid change (disrupting operations) or gradual evolution (missing opportunities). Leaders must weigh the cost of disruption against the risk of stagnation, ensuring transformation aligns with ethical and strategic goals.

Illustrative Case Study: Healthcare IT Transformation
A healthcare provider faced a dilemma during a digital transformation: adopt a new electronic health records (EHR) system (high cost, potential disruption to staff and patients) or upgrade existing systems (limited functionality, ongoing inefficiencies). Using the Trolley Problem model, leadership evaluated trade-offs, prioritizing long-term patient care over short-term costs. The decision involved extensive stakeholder engagement, ensuring ethical considerations were central to the transformation.




