James Madison and The Federalist

Listen to today’s episode

Subscribe to the podcast

Join The American Idea’s Listener Email list – get news about upcoming episodes and a chance to offer questions for them, too!

More Than a Convention Delegate

James Madison arrived at the Constitutional Convention in Philadelphia in 1787 better prepared than almost anyone in the room. He had spent months studying the histories of prior republics and confederacies, much of the material supplied by Thomas Jefferson from Paris. The Virginia Plan, which set the convention’s agenda from the opening days, was largely his work. He spoke as often as any delegate and helped drive the proceedings forward alongside Gouverneur Morris and James Wilson.

So why not simply call him the Father of the Constitution on the basis of his convention work alone?

Because Madison lost. He lost on proportional representation in the Senate, his preferred model, and the compromise that replaced it, giving Wyoming the same Senate representation as California. He lost on his proposal for a congressional veto over state laws, a mechanism he believed essential to controlling the factional chaos that plagued the states. He went into the convention with a coherent constitutional scheme and came out with something meaningfully different.

He then spent the next several year defending a constitution he had not entirely wanted, writing alongside Alexander Hamilton and John Jay to persuade the citizens of New York, and the country, to ratify it. The result was the Federalist Papers, and within them, a string of essays that would define how Americans understood their own government for centuries.

The Disease Madison Was Trying to Cure

To understand what Madison accomplished in the Federalist, you first have to understand the problem he was trying to solve. Madison called it faction: the tendency of human beings to divide into competing groups organized around shared interests, passions, or opinions, and to use political power to advance those groups at the expense of others or the common good. Faction was not a new concern; political philosophers had wrestled with it for centuries. But Madison approached it the way a scientist approaches a recurring experimental failure: by isolating the variable.

He looked at the history of republics and noticed a pattern. Small republics tended to be destroyed either from the outside, swallowed by empires, or torn apart from the inside by factional conflict. The received wisdom held that a healthy republic required a small, homogeneous population: people who shared the same beliefs, the same economic circumstances, the same basic vision of the good life. Trust required similarity. Without trust, self-government collapsed.

Madison’s answer, laid out in Federalist No. 10, was that this received wisdom had it exactly backwards. A small, homogeneous republic was not safer from faction. In fact, it was more vulnerable because it made majority tyranny easier. When most people share the same interests and passions, it is far easier for a majority to organize, seize power, and use it to oppress whoever is left.

The cure, Madison argued, was size. A large republic, spread across an enormous and diverse geography, made the formation of durable, tyrannical majorities structurally difficult. No single faction could easily become a national majority. Coalitions would have to be built, and building them required compromise. Congress would be messy, slow, and frustrating, and that was precisely the point. When people complain today that it takes forever for Congress to pass anything significant, they are, in Madison’s framework, observing the system working as designed.

Maintaining What You’ve Built

Federalist No. 10 is the essay most Americans encounter, typically in a high school or college classroom. However, it is in numbers 39, 49, and 51 where Madison’s thought reaches its full depth.

No. 39 takes up a foundational question that the Anti-Federalists raised loudly: Is this proposed constitution even republican? Madison’s answer required him to define republicanism with precision: a government deriving its power from the great body of the people. He then had to demonstrate that the new Constitution met the standard. The underlying argument of No. 37, which introduces this section of the Federalist, is that every government in history has required “energy” and stability, but this government was attempting something unprecedented: combining those qualities with the demands of republican principles. It had never been done. The Constitution, Madison was saying, was a genuine political innovation, not just a tweaked version of something that had come before.

No. 49 contains one of the most surprising moments in the entire Federalist: Madison’s quiet but direct rebuke of Thomas Jefferson, his closest political ally. Jefferson had proposed, in his Notes on the State of Virginia, that whenever two of the three branches of government agreed there was a constitutional crisis, a new constitutional convention should be called. Let the people sort it out. Madison had none of it.

His objection cut to the heart of what constitutionalism actually requires. A constitution is not just a legal document; it is a focal point for public attachment and reverence. People obey and respect a constitution not only because it is rationally well-designed, but because it has the weight of time behind it, because it has become woven into the fabric of national identity. Jefferson’s proposal, however democratically appealing, would have the opposite of its intended effect: it would teach citizens that constitutions are contingent and revisable under pressure, and that lesson, once learned, tends to undermine the very idea of constitutionalism. The logical endpoint of that road, Madison suggested, was not more democracy but less, with the eventual turn toward the rule of one person.

No. 51 is where Madison turns from diagnosis to design. The famous formula — “ambition must be made to counteract ambition” — is often taught as a quaint expression of human nature. It is actually something more radical: a theory of institutional engineering. Madison’s argument is that you cannot rely on the virtue of officeholders to maintain the separation of powers. You have to build institutions that make it in each department’s interest to defend its own constitutional turf. Give each department a will of its own. Make the president want to use the veto. Make the Senate want to resist executive overreach. Harness self-interest in service of the public good, and do it by design, not by hoping for virtuous leaders.

A dense and often-overlooked sentence in No. 51 that hints at something even more specific: a “qualified connection” between the president and the Senate, a kind of institutional partnership meant to strengthen the executive against legislative encroachment without sacrificing republican principles. The early Senate’s confidential executive journal, which was closed to the House and shared only with the president on matters of treaties and nominations, may have been the practical expression of exactly that relationship.

The Genius That Doesn’t Sparkle

Jefferson was the more brilliant writer. Madison himself would have acknowledged as much. Jefferson’s prose sparkles; Madison’s does not. Reading a Madison essay on trade policy, and a surprising share of his output dealt with trade policy, is an exercise in patience. He was not building to an epigram. He was building to a conclusion, and getting there required following the argument wherever it led.

That analytical rigor is precisely what makes Madison irreplaceable. Thomas Jefferson could not have written Federalist No. 51. Alexander Hamilton could not have written No. 37. John Adams could not have written No. 49. There is something in these essays that is distinctly, recognizably Madison. It is the same quality that made Jefferson, for all his own brilliance, turn to Madison when he had a deep theoretical question he couldn’t crack himself.

The distinction matters because it clarifies what Madison actually contributed. It was not rhetoric. It was not charisma. It was not the ability to move crowds. It was the capacity to think through a problem with unusual rigor and clarity, and to translate that thinking into arguments that could persuade a skeptical public.

The Constitution We Almost Didn’t Get

In the spring of 1788, ratification was in genuine doubt. Hamilton, who had co-authored the Federalist and was as committed to ratification as anyone alive, was willing to accept a compromise: allow states to ratify conditionally, on the promise that amendments would follow. It was a pragmatic position. It might have gotten the votes needed.

Madison said no. Not because he was being rigid, but because he saw clearly what Hamilton did not: if different states ratified different documents with different conditions attached, there was no Constitution. There was a collection of state-specific agreements. The entire enterprise of a unified national government, which had been the whole reason for the convention in the first place, would have been lost before it started.

That episode is, in miniature, the story of Madison’s contribution to the American Founding. He was the person who understood most clearly what the Constitution was for, what it required to function, and what had to be protected even in a moment of crisis. He lost some important battles along the way. He defended a document he had not fully wanted. He argued against his closest friend in public, in writing, under a pseudonym.

And when the vote finally came, the Constitution was ratified — intact, undivided, and with the capacity to endure. The father’s name is well earned.