AI and the Social Contract
Learning Objectives
After completing this L5 lecture, senior federal AI leaders, Chief AI Officers, and SES-level executives will be able to: first, articulate the traditional social contract theories of Hobbes, Locke, Rousseau, Rawls, and more recent authors such as Martha Nussbaum and Danielle Allen, and explain how each frames the duties a government owes its citizens in an age of pervasive AI; second, translate these classical frameworks into concrete obligations a federal agency assumes when it deploys AI, including the obligations enshrined in the due process and equal protection clauses of the Fifth and Fourteenth Amendments, the Administrative Procedure Act at 5 USC 551, the Privacy Act of 1974, the Civil Rights Act, and more recent frameworks such as the OSTP AI Bill of Rights and OMB M-24-10; third, explain the specific ways that opaque, biased, or unilaterally-imposed AI systems undermine the social contract and produce measurable loss of public trust, drawing on survey research from Pew Research Center, Edelman Trust Barometer, and the Partnership for Public Service Federal Trust Index; fourth, diagnose when an AI deployment risks violating the enduring duties of the state and prescribe governance measures that preserve legitimacy; fifth, speak and write publicly about federal AI in a way that honors the social-contract tradition without retreating into technical jargon or partisan framing; and sixth, model the personal leadership practices that keep the federal AI profession anchored to its civic purpose over a career.
Key Topics Covered
The capstone covers seven topics. First, the classical social contract: Hobbes's Leviathan, Locke's Second Treatise, Rousseau's Social Contract, and their framing of the duties of the sovereign. Second, modern extensions: Rawls's Theory of Justice and the original position; Nussbaum's capabilities approach; Allen's work on democratic equality. Third, specifically American contract theory: the Declaration of Independence, the Federalist Papers, the due process and equal protection jurisprudence of the 20th and 21st centuries, and the civil rights statutes. Fourth, how AI systems intersect with each of these: the obligations to procedural fairness, substantive equality, explainable state action, and durable institutions. Fifth, empirical evidence on public trust: Pew, Edelman, Partnership for Public Service, Stanford HAI AI Index, Knight Foundation Trust in Technology surveys. Sixth, case studies of AI-era social contract strain: the Arkansas Medicaid algorithm, the Michigan unemployment fraud algorithm, the Dutch childcare benefits scandal, the Toronto Privacy Commissioner investigations, and U.S. federal cases including certain DHS and CBP biometric deployments. Seventh, leadership practices that preserve the contract, including deliberative public engagement, appealable decisions, third-party audit, and sunset clauses.
Why This Matters for Government
The social contract is not a metaphor or a flourish. It is the foundational premise on which federal service rests. Citizens pay taxes, obey laws, and accept the authority of the state in exchange for protection of rights, provision of collective goods, and fair procedures when the state acts on them. When a federal agency deploys AI, it is exercising state power, and every deployment is a touch on the contract. A well-designed deployment honors the contract and can even strengthen it, demonstrating that the state can use new tools to serve the public better. A poorly-designed deployment weakens the contract, sometimes visibly and sometimes invisibly, and the losses compound across government.
The empirical record of the last decade should concentrate the mind of any federal AI leader. The Arkansas Medicaid algorithm that in 2016 unilaterally cut home-care hours for disabled beneficiaries produced a federal court ruling against the state for due process violations. The Michigan MiDAS unemployment fraud algorithm falsely accused tens of thousands of workers of fraud and was later found to have made decisions in 93% of cases without human review. The Dutch toeslagenaffaire, where an automated fraud system wrongly accused thousands of parents of childcare benefits fraud, brought down a government. Each of these was nominally a technical project. Each was, at bottom, a violation of the social contract: the state acted unilaterally on people, without transparent reasons, without meaningful appeal, and without accepting accountability when things went wrong. These are not outliers; they are what happens when AI is deployed without the contract in mind.
Trust, once lost, is expensive to regain. Pew's Research Center's 2023 survey on Americans' views of AI found deep concern about government use of AI in particular, and the Partnership for Public Service's Federal Trust Index has shown declining baseline trust in federal institutions for two decades. Against this backdrop, each new federal AI deployment is either a deposit in the trust account or a withdrawal. A CAIO who proceeds without attention to contract-honoring design is making withdrawals their agency cannot afford. A CAIO who builds in appeal, transparency, auditability, and deliberative public engagement is making deposits that will compound. This is not philosophy; it is an operational design choice with measurable effects on downstream adoption, litigation exposure, congressional relations, and workforce morale.
Finally, the social contract is a frame that holds across administrations. Political leadership changes. Statutes and regulations evolve. What endures is the basic compact that the state treats citizens with due process, equal respect, and humility about its own fallibility. A senior federal AI leader who anchors their work to this enduring compact provides their agency with a moral and political compass that stays valid when other anchors move. This is one of the quietest but most consequential forms of institutional stewardship, and it is the subject of this capstone.
The Classical and Modern Social Contract
A senior federal AI leader should be literate in five strands of social contract thinking. First, Hobbes's Leviathan (1651) establishes the baseline trade: citizens accept the sovereign's authority in exchange for security. For AI, the Hobbesian question is whether the state's new technical capabilities are being used to deliver security or to become dangerous in new ways. Mass surveillance, facial recognition, and predictive policing are directly Hobbesian, and the state's obligation is to ensure new powers are bounded by law and constrained by accountability.
Second, Locke's Second Treatise (1689) centers on consent, limited government, and natural rights that predate and constrain the state. For AI, the Lockean questions are whether citizens have meaningfully consented to being governed by an AI system, whether state power is genuinely limited, and whether natural rights, now instantiated in constitutional rights, are respected. Third, Rousseau's Social Contract (1762) frames the state as an expression of the general will, which sits in tension with technocratic rule. For AI, the Rousseauan question is whether algorithmic governance bypasses democratic deliberation, substituting expert judgment for collective decision.
Fourth, Rawls's Theory of Justice (1971) introduces the original position and the difference principle, asking how institutions would be designed behind a veil of ignorance about one's own position in society. For AI, the Rawlsian question is whether the system would be acceptable to someone who did not know whether they would be the subject of a correct or mistaken AI decision. This is a powerful test for fairness under risk. Fifth, contemporary authors such as Martha Nussbaum and Danielle Allen extend the contract to capabilities (Nussbaum) and to the equal standing of democratic citizens (Allen). For AI, these extensions ask whether deployments expand or contract the capabilities of marginalized citizens and whether they treat every person as an equal participant in democratic life.
No single framework is the 'correct' one, and senior leaders will benefit from the full set. The discipline is to check any AI deployment against each lens and to catch the concerns that one framework surfaces and another misses. A facial recognition deployment might look secure from a Hobbesian angle and still fail the Rawlsian test. A benefits triage system might sail through the Rawlsian test and still fail Nussbaum's capability test for a subset of beneficiaries. The frameworks together constitute a richer checklist than any one alone.
The American Constitutional Frame
American social contract theory has been instantiated in specific statutes and jurisprudence that federal AI leaders must know. The Due Process Clause of the Fifth Amendment and the Due Process and Equal Protection Clauses of the Fourteenth Amendment constrain how the federal government may act on citizens. The Administrative Procedure Act at 5 USC 551 requires that agency action be neither arbitrary nor capricious and that adversely-affected parties have notice and opportunity to be heard. The Privacy Act of 1974 constrains how the government may collect, use, and disclose personal information. Title VI of the Civil Rights Act prohibits discrimination in federally-funded programs. Section 504 of the Rehabilitation Act prohibits discrimination against people with disabilities.
For federal AI, these authorities translate into concrete obligations. A rights-impacting AI decision must be explainable to the affected person in terms they can understand, so that notice and opportunity to be heard are meaningful. An AI system that produces disparate impact across protected classes must be evaluated for whether it satisfies both Title VII's and Title VI's doctrinal frameworks, which are not identical. An AI system that affects benefits eligibility must preserve the due process protections that Goldberg v. Kelly (1970) and subsequent cases establish. The OSTP AI Bill of Rights (2022) and OMB M-24-10 (2024) do not create new rights but operationalize these existing authorities for AI deployments.
A practical framework for federal AI leaders: before deploying any rights-impacting system, answer six questions drawn from this constitutional and statutory frame. First, what rights or interests are affected? Second, what process is the affected person entitled to? Third, how will the affected person know the decision and the reasons for it? Fourth, how can the affected person contest the decision? Fifth, how will disparate impact across protected classes be monitored and remedied? Sixth, who is ultimately accountable for each decision, and how is that accountability documented? A system that cannot answer these questions should not be deployed, because it cannot honor the federal social contract as expressed in American constitutional and statutory law.
Empirical Trust and Case Studies of Contract Strain
Empirical research from Pew Research Center, Edelman Trust Barometer, Stanford HAI AI Index, and the Partnership for Public Service documents a consistent pattern: public trust in institutions is declining across the democratic world, and AI deployments in government are viewed with particular skepticism. A 2023 Pew survey found that a majority of Americans are more concerned than excited about the role of AI in daily life, and the concerns are concentrated in government use cases. These data do not mean AI should be avoided; they mean that federal AI deployments carry a trust premium that must be earned rather than assumed.
Four case studies anchor the lesson. Arkansas's Medicaid home-care algorithm cut beneficiary hours beginning in 2016, and a class action led to a federal court finding that the state had violated due process. The algorithm itself was held not confidential from affected parties, establishing a precedent federal systems increasingly cite. Michigan's MiDAS unemployment fraud algorithm falsely accused more than forty thousand workers of fraud between 2013 and 2015, operating with over 90% automation and no effective appeal. The state has paid out more than twenty million dollars in remediation, with broader reputational harm that will take a generation to repair. The Dutch toeslagenaffaire, roughly 2013 to 2019, falsely accused thousands of parents, disproportionately immigrants, of childcare benefits fraud; the scandal forced the government's resignation in 2021. The UK's post-office Horizon case, while not an AI system per se, produced analogous dynamics: automated outputs treated as authoritative, wrongful prosecutions of hundreds, and a decades-long public reckoning now unfolding.
The common pattern across these cases is not bad technology; it is bad social-contract design. The state deployed automated decision systems that acted on people unilaterally, without transparency, without effective appeal, and without accepting accountability until forced. The remediations, in every case, took the form of restoring the social contract: transparency, explanation, appeal, independent review, documented accountability. Federal AI leaders who build these design elements in from the start avoid the pathway that produces these crises. Leaders who treat these elements as overhead, and deploy without them, recreate the pattern. The case studies are not cautionary tales from far away; they are the map of what is already happening to agencies that treat AI deployment as a technical problem.
Leadership Practices That Preserve the Contract
Six leadership practices, applied consistently, keep federal AI within the envelope of the social contract. First, deliberative public engagement for rights-impacting deployments. Before deploying, the agency engages affected communities, civil society, and subject-matter experts in a documented process that produces both input and record. This is not a press release strategy; it is a substantive engagement that changes the design. The FTC's Magnuson-Moss rulemaking and many agency civil rights reviews offer templates. Second, appealable decisions with meaningful human review. Every rights-impacting AI decision has a defined path for the affected person to challenge, including access to the decision, the reasons for it, and a human reviewer empowered to reach a different conclusion. Third, third-party audit for high-stakes deployments, with auditor selection, scope, and reporting terms made public. Fourth, sunset clauses that require affirmative re-authorization after a defined period, forcing the deployment to justify itself periodically rather than accumulating inertia. Fifth, documentation that meets FOIA-era transparency norms, including model cards, decision logs, evaluation results, and incident histories. Sixth, leadership modeling, in which the senior leader publicly describes the limits of the system alongside its benefits.
These practices are mutually reinforcing. Public engagement informs what decisions most need appeal paths. Appeal paths generate data that informs third-party audits. Audits generate findings that motivate sunset-clause design. Sunset clauses create the forcing function for re-engagement. Documentation supports each of the others and supports the inevitable congressional, IG, and judicial review. An agency that institutionalizes all six builds a resilient AI capability whose legitimacy compounds over time. An agency that treats them as discretionary builds a capability that is always one incident away from losing the social-contract argument entirely.
Finally, contract stewardship requires personal leadership. A senior leader models what they expect. When the leader talks publicly about AI, they do so with intellectual honesty about what the technology can and cannot do, what the agency does and does not yet understand, and what the agency will do differently next. They use the frameworks of this capstone not as philosophical ornament but as an operating system. They name the contract as an anchor when other anchors are pulling them. And they invest in the next cohort so the contract has stewards beyond their own tenure. This is what it means to lead federal AI as a public servant, not as a technologist who happens to be paid by the state.
Related Lectures
L5 5.1.1 Building and Maintaining Public Trust. L5 5.1.3 International AI Diplomacy. L5 5.5 Personal Leadership: Leading Through Complexity. L4 4.4.2 Civil Rights and AI Systems.
Skill.re