<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Me, Myself, and AI]]></title><description><![CDATA[Idle thoughts about AI, the economy, society at large. ]]></description><link>https://maniksurtani.substack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!s0dw!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fmaniksurtani.substack.com%2Fimg%2Fsubstack.png</url><title>Me, Myself, and AI</title><link>https://maniksurtani.substack.com</link></image><generator>Substack</generator><lastBuildDate>Sat, 06 Jun 2026 04:15:59 GMT</lastBuildDate><atom:link href="https://maniksurtani.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Manik Surtani]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[maniksurtani@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[maniksurtani@substack.com]]></itunes:email><itunes:name><![CDATA[Manik Surtani]]></itunes:name></itunes:owner><itunes:author><![CDATA[Manik Surtani]]></itunes:author><googleplay:owner><![CDATA[maniksurtani@substack.com]]></googleplay:owner><googleplay:email><![CDATA[maniksurtani@substack.com]]></googleplay:email><googleplay:author><![CDATA[Manik Surtani]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Open at the Sponsor’s Pleasure]]></title><description><![CDATA[Why most &#8220;open&#8221; AI today is one strategic-priority shift away from being closed]]></description><link>https://maniksurtani.substack.com/p/open-at-the-sponsors-pleasure</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/open-at-the-sponsors-pleasure</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Thu, 28 May 2026 13:55:51 GMT</pubDate><content:encoded><![CDATA[<p><a href="https://maniksurtani.substack.com/p/yes-china-is-subsidising-the-worlds">My previous post</a> argued that Chinese open weight models are the only thing preventing a US proprietary oligopoly becoming the global default - and that Western policy is moving, investigation by investigation, to shut that infrastructure out of the American market. That&#8217;s the geopolitical layer.</p><p>This post is about the structural layer underneath it. Of all the &#8220;open&#8221; AI work happening anywhere right now, how much of it is actually <em>structurally durable</em> - and how much is one strategic-priority shift away from being recaptured?</p><p>The answer jumped out at me in Bill Gurley&#8217;s<a href="https://p3institute.substack.com/p/from-open-source-software-to-open"> piece</a>, in the difference between two of his examples. I should have made the distinction sharper in my own<a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-five-open"> post on Open Source as Structural Defence</a>. Let me fix that now.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><h3>Android was not Kubernetes</h3><p>Android and Kubernetes were both Google open source plays. Both were strategically brilliant. Both worked. They are not the same, and the difference is everything.</p><p>Android launched in 2007 through the Open Handset Alliance - a coalition of handset makers and carriers determined to prevent Apple from dominating&#9; mobile the way Microsoft dominated PCs in the 1990s. The Alliance never moved Android into a neutral foundation. No referee. No independent governance. And so, over time, Google &#8220;recaptured&#8221; Android by tying access to Google Play, Maps, Gmail, and YouTube to a Google-approved build. Ship a competing version? Lose the apps that matter. Android today is open in name and Google&#8217;s in practice everywhere except China.</p><p>Kubernetes - the software that runs most of the world&#8217;s cloud applications today - was different. Google open-sourced it in 2014 and almost immediately donated it to the newly-formed Cloud Native Computing Foundation, a neutral body sitting under the Linux Foundation. No single company controls it. AWS - the very company Kubernetes was designed to commoditise - now contributes to it actively, because its customers demanded Kubernetes support. The architecture made unilateral capture impractical.</p><p>Same company. Same era. Both open source. Wildly different structural outcomes.</p><p>The lesson is sharp: <em>the presence or absence of a neutral foundation is what determines whether &#8220;open&#8221; stays open.</em> Without a referee, open is conditional. Revocable.</p><div><hr></div><h3>The recapture risk we keep pretending isn&#8217;t there</h3><p>Now apply that test to every open-weight AI model released in the last three years.</p><p>Llama - once marketed as America&#8217;s leading open-weight model - was Android. Released by a single company, on a license that company controls, with the strategic posture maintained as long as it served that company&#8217;s interests. Then Llama 4 underperformed. Llama 4 Behemoth got shelved.<a href="https://about.fb.com/news/2024/07/open-source-ai-is-the-path-forward/"> Zuckerberg confirmed in July 2025</a> that Meta would no longer release superintelligence-capable models openly. Meta Superintelligence Labs released Muse Spark - their first frontier-class model - closed. Their 2024 manifesto titled <em>Open Source AI is the Path Forward</em> reads very differently today.</p><p>This was always going to happen. Not because Zuckerberg is bad, but because the architecture made any other outcome economically irrational. There was no foundation. There was no referee. There was no structural defence against the single company shifting its strategic priorities. The &#8220;open&#8221; was conditional from day one.</p><p>Gemma is in the same position. Mistral too. So are DeepSeek, Qwen, GLM, Kimi - same structural pattern, just headquartered somewhere else and with a national government as the strategic sponsor.</p><p><strong>There is currently no Kubernetes-equivalent for frontier AI weights.</strong> Not in the US. Not in China. Not in Europe. Every open-weight frontier model in existence today is held by a single sponsor whose continued openness is a matter of ongoing choice, not architectural commitment.</p><p>That&#8217;s the gap. That&#8217;s what&#8217;s missing. The entire open-weight ecosystem sits on Android-style infrastructure - open until somebody decides it isn&#8217;t.</p><div><hr></div><h3>The toll booth, revisited</h3><p>In my last post, I argued that open doesn&#8217;t have to win the race - just circumvent the toll booth. The market is already settling that question in open&#8217;s favour, with Chinese models doing the heavy lifting.</p><p>But there&#8217;s a second question hiding underneath: <em>who owns the road that the toll booth sits on?</em></p><p>Linux works as infrastructure because no single company can revoke it. Kubernetes works because no single company can revoke it. The reason these projects make their respective layers non-rentable is not that they exist as open source - it&#8217;s that they exist as open source <em>under a structure that prevents recapture</em>. The foundation isn&#8217;t a nice-to-have. <strong>The foundation is the entire point.</strong></p><p>Open weights released by single companies don&#8217;t pass this test. They&#8217;re toll booths in waiting. Useful today because their sponsors find openness strategically convenient. But the road belongs to the sponsor, and the sponsor can put up a toll booth whenever the economics change.</p><p>&#8220;Llama is open&#8221; was always a present-tense statement, not a structural one. The same is true of every other open-weight frontier model in 2026.</p><div><hr></div><h3>Autonomous vehicles: the test case</h3><p>Gurley devotes a long section to autonomous vehicles, and it&#8217;s worth<a href="https://p3institute.substack.com/p/from-open-source-software-to-open"> reading in full</a>. His argument is that AVs are the cleanest possible candidate for an Open Source Strategy play. Waymo, owned by Alphabet (Google&#8217;s parent), is the runaway leader. Tesla has a parallel proprietary stack. Cruise burned $10 billion and folded. Argo went to zero.</p><p>But there are fifty-plus companies - every global automaker, every ride-hailing platform, every delivery and logistics company, every retailer with a fleet - whose business depends on AV technology and who cannot individually win the proprietary path. The capital math is brutal. An open AV consortium under a neutral foundation is the only economically rational move for the rest of the industry.</p><p>This argument is almost tautologically convincing - because it makes concrete one specific instance of the broader displacement story from my<a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-three"> post on what comes after the jobs disappear</a>. Among the many sectors AI will reshape, with AVs, the abstract debate about open infrastructure becomes a physical question about who controls the safety logic of vehicles operating in our cities.</p><p>If the AV stack stays proprietary, we get a world where two or three companies set the implicit value-of-a-life calculus for every road in the West - regulator-by-trade-secret, with no other vendor able to inspect or improve on the safety logic. We&#8217;ve seen this before. Social media platforms have spent the last fifteen years setting their own implicit calculus on the cost of harm to children against the value of engagement - calculations that only became public when<a href="https://en.wikipedia.org/wiki/Facebook_Papers"> Frances Haugen leaked Meta&#8217;s internal research in 2021</a>. Proprietary stacks, proprietary tradeoffs, no external audit until the whistleblower arrives. The AV version of that pattern operates with metal and momentum.</p><p>Gurley&#8217;s argument is that the non-Waymo, non-Tesla players have every strategic reason to run Google&#8217;s own playbook against Alphabet - Waymo&#8217;s parent. And, critically, that an open AV stack done right would be Kubernetes-shaped, not Android-shaped - because the consortium of also-rans is large enough, well-capitalised enough, and aligned enough to put it under a neutral foundation from day one.</p><p>Whether anyone has the chutzpah to actually do it is the open question. Gurley&#8217;s word, not mine. But it&#8217;s the right word.</p><div><hr></div><h3>The agentic layer is next</h3><p>Here&#8217;s what comes after AVs.</p><p>The same structural argument applies to the agentic coordination layer - the protocols and infrastructure that let AI agents discover, trust, and transact with each other. If you take Gurley&#8217;s framework seriously, this layer is exactly where the next leader&#8217;s moat will compound: a small number of frontier vendors will define how agents authenticate, how they exchange value, how they delegate tasks, how they resolve conflicts. Whoever owns those protocols owns the toll booth on every agent-to-agent interaction in the global economy.</p><p>This is the<a href="https://p3institute.substack.com/p/from-open-source-software-to-open"> Overture-equivalent</a> for AI - the layer where neutral foundation work needs to happen now, not in five years when recapture is already complete. It&#8217;s exactly why<a href="https://aaif.io/"> we started AAIF</a>.</p><p>The pattern recurs at every layer: weights, vehicles, agents. The question is never whether open is <em>possible</em> at that layer. The question is whether open is <em>structurally durable</em> at that layer - and that depends entirely on whether a neutral foundation gets there before the leader&#8217;s moat finishes forming.</p><div><hr></div><h3>The convergence</h3><p>Gurley wrote the corporate-strategy version. I&#8217;ve been writing the political-economy version. The two arguments converge on the same single prescription: <strong>build the foundation now - before the moat hardens</strong>.</p><p>This is rare. Most policy fights pit public interest against incumbent interest and get settled by lobbying budgets. Open AI infrastructure is the unusual case where the public interest aligns with the strategic interest of roughly fifty of the world&#8217;s largest non-frontier companies. That alignment is the most underexploited political resource in this entire debate.</p><p>Gurley&#8217;s piece should be on every Fortune 500 CEO&#8217;s desk this quarter. The political-economy version should be on every legislator&#8217;s. They&#8217;re the same argument.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Me, Myself, and AI! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Yes, China Is Subsidising the World's Access to AI ]]></title><description><![CDATA[And Western policy is actively trying to shut it down]]></description><link>https://maniksurtani.substack.com/p/yes-china-is-subsidising-the-worlds</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/yes-china-is-subsidising-the-worlds</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Fri, 22 May 2026 13:09:59 GMT</pubDate><content:encoded><![CDATA[<p>Last week, Bill Gurley published <em><a href="https://p3institute.substack.com/p/from-open-source-software-to-open">From Open Source Software to Open Source Strategy</a></em> - a sweeping piece on how the world&#8217;s most sophisticated companies have spent fifteen years using open source not just as a development model, but as a corporate weapon. Android against Apple. Kubernetes against AWS. Open Compute against data centre hardware vendors. Each time, the same playbook: take a layer where one incumbent has a structural lead, rally the also-rans under a neutral foundation, commoditise the bottleneck.</p><p>It&#8217;s a brilliant piece, and I want to spend two posts responding, expanding on <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-five-open">my political-economy version</a> of Gurley&#8217;s corporate-strategy analysis. The arguments converge in ways that are unexpected and important. That convergence is unusual and it matters.</p><p>Most policy fights are zero-sum between public interest and incumbent interest. Workers want one thing, capital wants another. Citizens want one thing, platforms want another. The two sides line up against each other and the fight gets settled in the favour of whoever has more lobbying budget. Open AI infrastructure is one rare case where the public-interest argument and the corporate-strategy argument point to the same prescription - because they&#8217;re driven by the same underlying economics. That alignment is an underexploited political resource in this debate - and it shows up in how badly Western policy is currently misreading China.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><h4><strong>The follower&#8217;s weapon</strong></h4><p>Gurley&#8217;s sharpest observation lands an almost throwaway line: <em>&#8220;when you are the follower in a technology race, open source is your most powerful weapon.&#8221;</em> He calls it the <em>follower&#8217;s weapon</em>, and it&#8217;s the whole story of RISC-V. China couldn&#8217;t buy ARM licenses, couldn&#8217;t access advanced US silicon, and couldn&#8217;t credibly out-innovate Intel. So they embraced an open instruction set that no one can sanction - because the project itself is governed in Switzerland, and the spec is, well, open. Gurley quotes an analyst calling RISC-V &#8220;sanction-proof.&#8221;</p><p>DeepSeek, Qwen, Kimi, GLM, MiniMax. The Chinese open-weight frontier is real, improving fast, and <a href="https://p3institute.substack.com/p/from-open-source-software-to-open">enshrined in two consecutive national Five-Year Plans</a>. As Demis Hassabis, CEO of Google DeepMind, <a href="https://www.youtube.com/watch?v=JNyuX1zoOgU">points out</a>, Chinese models are leading in open source. Anysphere built Cursor&#8217;s Composer 2 on Kimi. Airbnb&#8217;s customer service agent runs on Qwen. Brian Chesky calls Qwen &#8220;very good&#8221;, &#8220;fast and cheap&#8221;. He picked Qwen for AirBnB, not to make a geopolitical statement, but because the economics made sense.</p><p>This is the follower&#8217;s weapon, working exactly as Gurley&#8217;s framework predicts.</p><div><hr></div><h4><strong>Commoditise your complement</strong></h4><p>The cleanest way to read China&#8217;s open-weights strategy is <a href="https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/">microeconomic</a>, not ideological. When the price of a complement to your product falls, demand for your product rises. So if you want to grow a market, drive the price of its complements toward zero.</p><p>Every major open source play in Gurley&#8217;s piece is running this playbook. Google made Android open source to commoditise the complement to search and ads - phones got cheap, search queries multiplied, ad revenue followed. IBM put a billion dollars into Linux to commoditise the complement to its services and hardware businesses - operating systems got free, IBM&#8217;s consulting business flourished.</p><p>China is now running the same play at a national-policy scale. The complement to an AI model is the value-added application built on top of it - every product, every service, every workflow, every agent. By making frontier-grade models freely available, China is driving the price of that complement toward zero <em>for its entire economy</em>. Every Chinese startup, every Chinese enterprise, every Chinese researcher gets to build on a stack without a rent floor.</p><p>And once the foundations of your application layer have no rent floor, you don&#8217;t just dominate at home - you export. Chinese AI-powered services, built on free Chinese models, competing in global markets against Western services built on metered API calls to a handful of proprietary vendors. That&#8217;s not just domestic industrial policy, that&#8217;s a global trade strategy. And China has been playing that game for a long time.</p><p>It&#8217;s also why the public-interest argument and the corporate-strategy argument converge. Cheap inputs grow the market for everyone who <em>uses</em> the input. Expensive inputs concentrate the market for everyone who <em>sells</em> the input. That&#8217;s not politics. That&#8217;s economics. And it works.</p><div><hr></div><h4><strong>The Crypto Wars, again</strong></h4><p>We&#8217;ve been here before. In the early 1990s, the US government tried to lock down strong cryptography on national-security grounds. Phil Zimmermann&#8217;s release of <a href="https://en.wikipedia.org/wiki/Pretty_Good_Privacy">PGP</a> in 1991 made strong encryption freely available worldwide. In response, the US government classified cryptographic software as a munition under <a href="https://en.wikipedia.org/wiki/International_Traffic_in_Arms_Regulations">ITAR</a>, threatened Zimmermann with a federal investigation, and pushed the <a href="https://en.wikipedia.org/wiki/Clipper_chip">Clipper Chip</a> - a government-backdoored encryption standard intended to become the default for commercial communications. The framing was familiar: terrorists, child predators, foreign adversaries. The actual effect: American companies were locked out of foreign markets where strong crypto was already freely available, while the US public was offered weakened encryption with a built-in government key that never really took off to begin with.</p><p>The <a href="https://en.wikipedia.org/wiki/Crypto_Wars">Crypto Wars</a> ended around 2000 with the open ecosystem winning decisively. Unenforceable export controls collapsed - and PGP and foreign-made crypto were already everywhere. The Clipper Chip died because no one trusted it. And every secure thing you do online today - banking, encrypted messaging, e-commerce, password managers - exists because that fight was won.</p><p>Now revisit  the AI policy debate of 2026 with that history in mind. The closed-stack incumbents - what Eric S. Raymond <a href="http://www.catb.org/~esr/writings/cathedral-bazaar/cathedral-bazaar/">called &#8220;Cathedrals&#8221;</a> in his 1997 essay on why open development always beats proprietary development - have powerful incentives to use China-hawk framing to push regulators toward restricting open competition. Because if you can&#8217;t beat the open ecosystem on quality and price, you have to beat it in Washington. <a href="https://www.semafor.com/article/04/29/2026/house-committee-probes-cursor-parent-airbnb-over-chinese-ai">On April 29, 2026, two House committees sent letters to Anysphere and Airbnb</a> demanding information about their use of Chinese open-weight models. The companies chose those models on pure price-performance grounds. That didn&#8217;t matter. The fight isn&#8217;t actually about national security. It&#8217;s about whether American companies are allowed to use cheap, capable, open alternatives to the domestic proprietary vendors.</p><p>The Crypto War playbook, dusted off thirty years later.</p><div><hr></div><h4><strong>The uncomfortable reframe</strong></h4><p>A simple, if inconvenient, conclusion follows: <strong>Chinese open-weight models are currently the only thing preventing a US proprietary oligopoly from becoming </strong><em><strong>the global default</strong></em><strong>.</strong></p><p>Not Mistral. Capable, but a tier below the absolute frontier, and a single European company carrying the entire Western open-weight load.</p><p>Not Llama. <a href="https://about.fb.com/news/2024/07/open-source-ai-is-the-path-forward/">Zuckerberg confirmed</a> Meta would no longer release superintelligence-capable variants openly. Meta&#8217;s 2024 manifesto on open AI reads very differently today.</p><p>And not Gemma. Gurley&#8217;s piece <a href="https://p3institute.substack.com/p/from-open-source-software-to-open">is clear-eyed on this</a>: Gemma is open only at small sizes, with Gemini firmly closed at the frontier. There&#8217;s also a Google-shaped precedent for what happens when this company runs an &#8220;open&#8221; project without a neutral foundation governing it - read Gurley on how Android got quietly recaptured. Treating it as structurally different from Llama because it has Google&#8217;s brand name on it is naive.</p><p>If you remove the Chinese open frontier from the picture, what&#8217;s left of the open-weight ecosystem capable of running an actual economy? Almost nothing. The follower&#8217;s weapon is working - but it&#8217;s working for <em>every follower around the world</em>, not just China. Every European nation. Every African and Southeast Asian government. Every Latin American startup. Every academic lab. Every American developer who can&#8217;t afford OpenAI&#8217;s enterprise pricing. They are all riding on infrastructure that Chinese labs are paying to develop and openly releasing - and Western policy is increasingly geared towards  shutting that infrastructure down.</p><p>If Washington bans Chinese open weights on national security grounds, the models will still exist and still get used everywhere outside the US. Six billion people - three-quarters of the planet - will still pick the stack that&#8217;s free, capable, self-hostable. The US will end up technologically isolated from the majority of the world&#8217;s AI users, with a handful of proprietary models serving the domestic market. Those proprietary models may well sit at the top of the leaderboards. But that won&#8217;t matter - because the global infrastructure layer will have been built on someone else&#8217;s stack. <strong>An historically epic own-goal.</strong></p><div><hr></div><h4><strong>The framing</strong></h4><p>Press and analyst coverage frames the open weights debate as &#8220;<em>can open beat closed at the frontier?</em>&#8220; - but that&#8217;s the wrong question. The market doesn&#8217;t need open to beat closed at the frontier. It needs open to be good enough that closed can&#8217;t charge rent. The market is already settling this question in open&#8217;s favour. Chesky didn&#8217;t pick Qwen because it beats GPT-5.5. He picked it because it&#8217;s good enough and it&#8217;s cheap. Anysphere didn&#8217;t pick Kimi because it&#8217;s the world&#8217;s best model. They picked it because it&#8217;s the world&#8217;s best model <em>for their price point</em>.</p><p><strong>Open doesn&#8217;t have to win the race. It just has to circumvent the toll booth.</strong></p><p>That&#8217;s the entire game. Linux didn&#8217;t beat Windows on consumer desktop, and it didn&#8217;t need to. It made operating-system infrastructure non-rentable, and the world&#8217;s economy now runs on top of it. Kubernetes didn&#8217;t beat AWS on cloud market share, and it didn&#8217;t need to. It made container orchestration non-rentable, and even AWS now contributes to it. The bar isn&#8217;t outperformance. The bar is preventing one company owning the layer everyone depends on. Then commoditise the complement, grow the surrounding economy, let the value capture happen at a different layer.</p><p>Apply that to AI. Open weights don&#8217;t need to outperform GPT-5.5 or Mythos. They need to exist in a form capable enough, cheap enough, and self-hostable enough that no proprietary oligopoly can charge platform-tax rent on the entire global economy. That bar is much lower than &#8220;beat the frontier.&#8221; That bar is already being cleared - by Chinese labs, mostly - and Western policy is actively trying to shut them out of the American market on grounds the Crypto Wars showed us, three decades earlier, were unenforceable and self-defeating.</p><div><hr></div><h4><strong>The choice</strong></h4><p>There is a version of the next decade in which America protects four companies and loses the global architecture. There is another in which it recognises that the follower&#8217;s weapon is <em>also</em> America&#8217;s weapon - that the open ecosystem is the only thing keeping its own startups, researchers, and developers from being permanent renters of someone else&#8217;s AI infrastructure.</p><p>That choice is still open. But <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-three">the window is closing</a>.</p><p>In the next post: why who owns the bottleneck is the question that ultimately governs the economic benefits of AI - and why most of what&#8217;s being called &#8216;open&#8217; today is only open&#8230; until it isn&#8217;t.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/p/open-at-the-sponsors-pleasure&quot;,&quot;text&quot;:&quot;Read Part 2&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/p/open-at-the-sponsors-pleasure"><span>Read Part 2</span></a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Me, Myself, and AI! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Going All In]]></title><description><![CDATA[I left my role at Block to become CTO of the Agentic AI Foundation.]]></description><link>https://maniksurtani.substack.com/p/going-all-in</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/going-all-in</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Wed, 13 May 2026 12:16:53 GMT</pubDate><content:encoded><![CDATA[<p>I left my role at Block to become CTO of the Agentic AI Foundation. Here&#8217;s why.</p><div><hr></div><h3><strong>The short version</strong></h3><p>Over the past few months, I&#8217;ve been writing a <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">series on the structural risks of AI</a> - economic concentration, geopolitical weaponisation, the cautionary tale of social media, and the case for governed open infrastructure as the defence. Each post followed the argument one step further.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><p>I walked away from a role I loved, at a company I deeply respect, working with people I&#8217;d built genuine trust with over many years (a quarter of my life, in fact). That wasn&#8217;t easy. But the argument kept arriving at the same place: the most important layer in AI - the protocols governing how AI agents communicate, coordinate, and act across systems, including the underlying infrastructure and tools - is being built right now. Whether that layer ends up open or captured will shape the next generation of technology, and the economy that runs on it. The window to get this right is finite. And it&#8217;s a layer I might know a little bit about.</p><p>Block - and my entire career - wouldn&#8217;t have been possible without the open infrastructure that others chose to build. Every system my coworkers and I built, every product we shipped, ran on foundations that existed because someone, years earlier, chose sharing over rent-seeking and control.</p><p>Open source has been part of my work from the start - I&#8217;ve contributed to and led projects in that space all my professional life. What&#8217;s new is the urgency. The agentic layer of AI is where those same principles need to land now.</p><p>In the last post, I asked engineers and companies building with AI to choose openness, and to demand it. This is me taking my own advice.</p><div><hr></div><h3><strong>What the work looks like</strong></h3><p>The <a href="https://aaif.io/">Agentic AI Foundation</a>, housed under the <a href="https://www.linuxfoundation.org/">Linux Foundation</a>, is the place for open, vendor-neutral standards infrastructure, and tooling for AI agents. As CTO, I&#8217;ll be helping shape the technical direction - working with member companies, growing the contributor community, fostering ideas, innovation, collaboration - and setting up the governance scaffolding that protects what matters: freedom of choice, transparency, broad access, and healthy, open competition.</p><p>It&#8217;s hands-on work. The kind that doesn&#8217;t show up in headlines and probably never will. When infrastructure does its job, you stop noticing it. Nobody thinks about the protocols that make email work, or the standards that let you switch cloud providers. How often do you think about Linux kernel maintainers? That&#8217;s the goal.</p><p>The space is moving fast, and what we&#8217;re building today will evolve. Priorities will shift, projects will change, the technical landscape will look different in a year. That comes with working at the frontier of a new layer. What stays the same is the mission: keeping this layer open, governed, and hard to capture.</p><div><hr></div><h3><strong>How to get involved</strong></h3><p><strong>If you&#8217;re an engineer:</strong> contribute to open agentic infrastructure. Choose open protocols, open standards, and open implementations in what you build. In fact, demand them off your vendors. And give back to the commons. You&#8217;re following in the footsteps of the people who gave us Linux, open internet protocols and web standards, and much, much more.</p><p><strong>If you&#8217;re a company building with AI:</strong> become a <a href="https://aaif.io/">member</a>. Participate in governance. Open standards mean the whole industry moves faster. Ideas circulate, trust is earned through transparency, and you compete on what you actually build, not on who captured the plumbing first.</p><p><strong>If you want to follow along:</strong> I&#8217;ll be writing more. About what we&#8217;re building, what we&#8217;re learning, and where the hard parts are. Follow me here. </p><p>This isn&#8217;t the end of the conversation. It&#8217;s the beginning of the work. Come build with us.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Me, Myself, and AI! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Biggest Fears with AI, Part Six: What Must Be Done]]></title><description><![CDATA[This is Part 6 of a series.]]></description><link>https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-six-what</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-six-what</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Thu, 09 Apr 2026 23:41:53 GMT</pubDate><content:encoded><![CDATA[<p><em>This is Part 6 of a series. Start with <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">Part 1</a> if you&#8217;re new here, or continue from <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-five-open">Part 5</a>.</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><p>There&#8217;s a particular kind of decision that isn&#8217;t really a decision - where you&#8217;ve followed an argument far enough that there&#8217;s only one conclusion available to you. This is that post.</p><div><hr></div><h3><strong>Where we are</strong></h3><p>Most AI today is call-and-response. You type a prompt, you get an answer. But AI is rapidly moving toward systems that <em>act</em> - that plan, delegate, and execute across multiple services and tools on your behalf. This is <em>agentic AI</em> - AI that has agency. In this world, the critical question isn&#8217;t which AI is best. It&#8217;s whether the systems those AIs operate in are transparent, open, and built on shared foundations - or whether they become an incomprehensible monolith that no one else can fathom, inspect, or leave.</p><p>Think about email. The protocols that make email possible are open. No one owns it. Gmail, Outlook, and Proton Mail all implement it differently and compete on speed, privacy, features, and user experience. You can switch between them without losing your contacts or your history. The standard is shared. The implementation is where the value lives.</p><p>Now think about social media. No shared protocol. No portability. No choice. The social media corporations own the layer, and everyone else plays by their rules.</p><p>The agentic layer of AI - the protocols governing how AI agents talk to each other, delegate tasks, work across systems, and take real-world actions - is being built right now. Whether it looks like email or social media is still an open question. But not for long.</p><div><hr></div><h3><strong>Why this has to happen now</strong></h3><p>Imagine two futures.</p><p>In the first, the agentic layer becomes a commons - like Linux, like the internet protocols. Companies compete on the quality of their agents, their applications, their services. The best products win because customers choose them, not because switching is impossible. Anyone can run AI on their own terms, on their own infrastructure. Transparency is preserved because the protocols are open and inspectable. Governments can regulate what they can see. New entrants can build without asking permission. The value AI creates flows to whoever delivers the most benefit - not whoever captured the infrastructure first.</p><p>In the second, one or two companies set the standards before anyone else can. The coordination layer becomes proprietary. Agent interoperability exists only on the gatekeeper&#8217;s terms. The benefits of AI productivity compound upward into the hands of whoever captured the infrastructure first. The governance arguments from this series become moot - not because they were wrong, but because the architecture was already locked before anyone acted on them. The social media outcome, at larger scale, with higher stakes. In Post 2, I wrote about Leo Szilard - a man with the right instincts about governing a transformative technology, outmanoeuvred by the logic of national competition. That&#8217;s what failure looks like.</p><p>The classic tragedy of the commons is that shared resources get overexploited because everybody acts in their own self interest. The tragedy here is even worse: the commons never gets built in the first place, and the resource is captured before anyone realises it should have been shared. Unless we actively choose to build this, the default isn&#8217;t neutrality. It&#8217;s concentration. Momentum alone will carry us toward a company-dominated outcome - not through conspiracy, but through the same financial incentives that turned photo filter apps into machines for harvesting attention.</p><p>The question isn&#8217;t whether AI transforms the world. It will. <em>The question is whether the transformation concentrates power - or distributes it so that all of humanity benefits</em>. That question has an infrastructure answer. But infrastructure doesn&#8217;t build itself.</p><div><hr></div><h3><strong>What can be done</strong></h3><p>It can be tempting to think this is a problem for someone else - for governments, for tech executives, for people closer to the machinery. But if you&#8217;re reading this, you likely have more influence than you think.</p><p><strong>If you follow this space closely,</strong> you have a responsibility that goes beyond awareness. A few concrete things you can do today:</p><p><em>Choose with intention.</em> Use platforms built on open standards. When you move away from closed ones, make the reason visible.</p><p><em>Talk to people in your orbit.</em> Colleagues, founders, investors - most of them haven&#8217;t thought about infrastructure lock-in. You can change that.</p><p><em>Amplify the right signals.</em> Share writing that names the problem clearly. Engage with it publicly. The window on AI infrastructure openness is still being set - and public discourse shapes what decision-makers think is politically and commercially viable.</p><p><strong>If you&#8217;re an engineer,</strong> your choices carry structural weight. When you architect AI into your products, choose interoperability. Evaluate vendors on whether their systems use open standards or proprietary ones. Contribute to open protocol design. The engineers who built the internet&#8217;s open protocols chose resilience over proprietary control, and that choice shaped the next fifty years. <em>Choose openness. Demand it.</em></p><p><strong>If you&#8217;re a company building with AI,</strong> open standards are in your interest. Proprietary lock-in feels like a moat <em>until the company on the other side of it is bigger than you</em> - and then it&#8217;s a cage. Open, vendor-neutral standards mean you compete on the quality of what you build, not on who captured the plumbing first. The way web browsers compete today. That&#8217;s a market that rewards the best product, not the most entrenched.</p><p>The <a href="https://aaif.io/press/linux-foundation-announces-the-formation-of-the-agentic-ai-foundation-aaif-anchored-by-new-project-contributions-including-model-context-protocol-mcp-goose-and-agents-md/">Agentic AI Infrastructure Foundation</a> exists to build exactly this - open, vendor-neutral standards for agent communication and coordination, housed under the <a href="https://www.linuxfoundation.org/">Linux Foundation</a>. The same institutional home that governs Linux and the open cloud infrastructure that the technology industry already depends on. Open to contributors from any jurisdiction. Structured to resist capture by any single company or government. <a href="https://aaif.io/">Get involved.</a></p><div><hr></div><h3><strong>Following the argument</strong></h3><p>This series began with David Ricardo - an economist who built the framework for technological optimism, looked at it more carefully, and arrived somewhere uncomfortable. He followed the argument even when it led to an inconvenient conclusion.</p><p>That&#8217;s the spirit in which I&#8217;ve approached this problem - not just in writing about it, but in building the infrastructure to address it. I co-founded AAIF because the gap I kept writing about - the ungoverned layer above the models, the tier that social media proved was the most dangerous to leave undefended - is a gap I can help close. Not because I have all the answers. But because the structural foundation matters, the window to build it is finite, and the cost of getting it wrong is a world where the most powerful technology in human history is owned by the few and rented to the rest.</p><p>I followed the argument. It led here. And going forward, I&#8217;ll be getting more deeply involved - in the foundation, in advocacy, and in the work of making sure this layer stays open.</p><p>More on that - and my new role - in the next post.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/p/going-all-in&quot;,&quot;text&quot;:&quot;Part 7&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/p/going-all-in"><span>Part 7</span></a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading my idle thoughts. Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Biggest Fears with AI, Part Five: Open Source as Structural Defence]]></title><description><![CDATA[This is Part 5 of a series.]]></description><link>https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-five-open</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-five-open</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Mon, 30 Mar 2026 11:29:41 GMT</pubDate><content:encoded><![CDATA[<p><em>This is Part 5 of a series. Start with <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">Part 1</a> if you&#8217;re new here, or continue from <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-four-weve">Part 4</a>.</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><p>In 1991, a Finnish student <a href="https://groups.google.com/g/comp.os.minix/c/dlNtH7RRrGA/m/SwRavCzVE7gJ">posted a message</a> to a mailing list: &#8220;I&#8217;m doing a (free) operating system (just a hobby, won&#8217;t be big and professional like gnu).&#8221; That hobby now runs the majority of the world&#8217;s servers, all Android phones, and almost all of the cloud infrastructure on earth.</p><p>Post 4 ended with a claim: the open foundation that social media never got can still be built for AI. It&#8217;s not theoretical - this pattern has been working for decades, in plain sight.</p><div><hr></div><h3><strong>What open infrastructure actually achieved</strong></h3><p>Two precedents. Different problems.</p><p>The first is the open internet. The protocols beneath every website, every email, every online service are open standards that no one owns. That&#8217;s why you can switch email providers and keep your history. That&#8217;s why a startup can build a website without asking permission. The power of open infrastructure isn&#8217;t that it&#8217;s <a href="https://en.wikipedia.org/wiki/Gratis_versus_libre">free - free as in speech, not free as in beer</a>. It&#8217;s that no one can take it away from you.</p><p>The second is the <a href="https://www.linuxfoundation.org/">Linux Foundation</a>. What it built isn&#8217;t just an operating system - it&#8217;s a governance model that removed core computing infrastructure from the competitive battlefield. Every company, government, and individual builds on the same foundation. Competition happens <em>above</em> it. The foundation itself is a global commons.</p><p>Together, these precedents address the risks explored earlier in this series. Open protocols preserve choice and prevent economic capture. Governed foundations prevent geopolitical weaponisation - and the anarchy of openness without accountability. Applying both principles higher up the stack - to applications and services - reduces the risk of the outcomes we saw with social media.</p><p>There&#8217;s an irony worth sitting with. The internet protocols were born as a US military project. <a href="https://en.wikipedia.org/wiki/ARPANET">ARPANET</a> was funded by the Department of Defense in the late 1960s - the same institution that later tried to force Anthropic to remove ethical guardrails from its AI. The DoD inadvertently built the most open, globally shared infrastructure in human history. It wasn&#8217;t designed to become a commons. It became one because the engineers who built it chose resilience over proprietary control - and by the time anyone thought to capture it, the architecture was already open.</p><p>Architecture, established early enough, can outlast the intentions of its creators. That&#8217;s a promise when the architecture is open - and a warning when it isn&#8217;t.</p><p><em>That choice is available to every engineer building AI infrastructure today - and to every engineer consuming it. Choose openness. Demand it.</em></p><p>The <a href="https://www.cncf.io/">CNCF</a> extended this logic up the stack, building shared open infrastructure that means AWS, Azure, Google Cloud, Alibaba Cloud, and Tencent Cloud all compete on price and performance rather than lock-in. The infrastructure most of the technology industry depends on exists because of governance choices made when the technology was still young and malleable enough.</p><div><hr></div><h3><strong>Open source and AI: what&#8217;s already working</strong></h3><p>The software and model layers of AI are already trending toward openness.</p><p><a href="https://arxiv.org/abs/2501.12948">DeepSeek&#8217;s R1</a>, released in January 2025, demonstrated near-frontier capability at a fraction of the assumed cost. What followed was a wave of open models competing directly with proprietary systems: Z.ai&#8217;s <a href="https://huggingface.co/zai-org/GLM-4.7">GLM</a> rivals Claude on coding benchmarks, and Alibaba&#8217;s <a href="https://huggingface.co/Qwen">Qwen</a> pushes boundaries in reasoning and code. The gap between open and proprietary is roughly half a generation, closing further with every release cycle.</p><p>The most striking signal: NVIDIA has <a href="https://www.wired.com/story/nvidia-investing-26-billion-open-source-models/">committed $26 billion over five years</a> to developing open models, and <a href="https://nvidianews.nvidia.com/news/nvidia-launches-nemotron-coalition-of-leading-global-ai-labs-to-advance-open-frontier-models">launched the Nemotron Coalition</a> to build them collaboratively. When the dominant hardware company invests that heavily in openness, the momentum is hard to reverse.</p><p>The entire toolchain used to <em>create</em> these models is already open source - the infrastructure every lab, including the proprietary ones, uses to train and deploy AI. And AI labs across the world - including Chinese ones - are converging on shared standards for how software talks to AI models, meaning no single provider is irreplaceable. Switching costs are collapsing.</p><p>Any company can run a competitive open model on its own infrastructure today, without asking permission from the company that built it. That was unthinkable two years ago. The open source defence at the software layer isn&#8217;t a hope. It&#8217;s a fact on the ground.</p><div><hr></div><h3><strong>Where it gets harder</strong></h3><p>None of this means the problem is solved. As we saw with social media, open foundations don&#8217;t prevent capture at the layers above - but they do make alternatives possible. Open foundations are the floor, not the ceiling. Necessary, but not sufficient.</p><p>There are challenges that open source alone doesn&#8217;t resolve. Manufacturing concentration: you can open-source a chip design, but someone still has to fabricate it - and right now that means TSMC in Taiwan, a single point of failure in one of the most geopolitically contested regions on earth. The physical layer: robots don&#8217;t copy at zero marginal cost. And a frontier capability gap, driven by funding asymmetry and financial incentives that currently favour proprietary development. These are real constraints. But they don&#8217;t invalidate the model. They demand answers that build on open foundations and go beyond them.</p><div><hr></div><h3><strong>What a more robust defence looks like</strong></h3><p>Tristan Harris, in his <a href="https://www.ted.com/talks/tristan_harris_why_ai_is_our_ultimate_test_and_greatest_invitation">2025 TED talk</a>, frames AI&#8217;s future as a choice between chaos and dystopia - decentralisation without responsibility versus centralisation without accountability. The narrow path runs through governed open infrastructure: open enough to prevent capture, governed enough to prevent chaos.</p><p>Governance is one half. But what about the financial incentives? The same forces that turned social media into an attention-harvesting machine are present in AI. Open infrastructure doesn&#8217;t change the profit motive. It changes <em>where </em>profit can be extracted. If the protocol layer is a commons, you can&#8217;t make money by owning the gate - you have to provide value. This isn&#8217;t anti-business. It&#8217;s pro-competition. The companies that build the best products, that deliver the most value, should win - because customers <em>choose</em> them, not because switching is impossible. Open infrastructure preserves transparency and choice.</p><p>That doesn&#8217;t <em>eliminate</em> bad incentives. It makes them <em>contestable</em>. And contestable is the precondition for everything else - regulation, competition, transparency, accountability - to work. You can&#8217;t regulate what you can&#8217;t see. You can&#8217;t enforce portability on a proprietary protocol. You can&#8217;t hold a system accountable if one company controls the entire stack.</p><p>Public compute - the equivalent of public roads for AI - is one piece. Antitrust applied to the AI stack is another. But the most urgent gap is in the protocols governing how AI agents talk to each other, delegate tasks, and work across systems - what technologists call the agentic coordination layer. This is where enormous value will flow. The standards aren&#8217;t set. The layer is still young enough to shape. This is the CNCF moment for AI - except the stakes are higher and the window is shorter.</p><p>If this layer gets captured before open standards take hold, we&#8217;re back to lock-in seen with social media. If it becomes a governed commons, we preserve the structural defence that open source built for computing - and extend it into the tier that social media proved was the most dangerous to leave undefended.</p><p>This is why I co-founded the <a href="https://aaif.io/press/linux-foundation-announces-the-formation-of-the-agentic-ai-foundation-aaif-anchored-by-new-project-contributions-including-model-context-protocol-mcp-goose-and-agents-md/">Agentic AI Infrastructure Foundation</a>.</p><p>The hobby Linus Torvalds posted about in 1991 became the foundation the world builds on. Just like Linux, when this work succeeds, it becomes invisible - and nobody goes to war over it. That invisibility is the achievement. And the aspiration.</p><p>In the next post: what the AAIF is building, and why.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com&quot;,&quot;text&quot;:&quot;&#128679; Part 6 Coming Soon &#128679;&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com"><span>&#128679; Part 6 Coming Soon &#128679;</span></a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading my idle thoughts. Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Biggest Fears with AI, Part Four: We’ve Seen This Movie Before]]></title><description><![CDATA[This is Part 4 of a series.]]></description><link>https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-four-weve</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-four-weve</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Mon, 23 Mar 2026 20:01:11 GMT</pubDate><content:encoded><![CDATA[<p><em>This is Part 4 of a series. Start with <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">Part 1</a> if you&#8217;re new here, or continue from <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-three">Part 3</a>.</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><p>For most people today, AI is just a chatbot. That&#8217;s accurate&#8230; for now. But Facebook was once just a campus directory, and that evolved into something much more consequential. The choices made in those early years of social media locked in outcomes that are proving nearly impossible to reverse. What can we learn from social media, and apply to AI?</p><div><hr></div><h3><strong>It was just a photo filter app</strong></h3><p>Facebook launched as a way for college students to connect. YouTube was a place to share home videos. Twitter was a way to tell people what you were having for lunch. That&#8217;s all these platforms were, at their inception.</p><p>No one intended what they became, their goals evolving in line with simple financial incentives like <em>get people to sign up, keep them engaged, sell ads</em>. But each of those simple goals compounded. Engagement optimisation became attention capture. Attention capture became behavioural manipulation. The dangerous emergent behaviour - anxiety, polarisation, the erosion of shared reality - wasn&#8217;t part of a dastardly plan. It was the logical outcome of simple incentives operating at scale with no structural accountability.</p><p>Each platform was designed as a proprietary walled garden, optimised to keep you hemmed in. Your followers, your content, your social graph - none of it portable. You couldn&#8217;t take your Instagram audience to a competitor any more than you could take your WhatsApp contacts to a different messaging app. The walls were the product, and there was <a href="https://www.eff.org/deeplinks/2021/08/facebooks-secret-war-switching-costs">no practical way to opt out</a>. Your friends were there. Your photos were there. Your professional network was there. Leaving meant losing all of it. As Cory Doctorow <a href="https://doctorow.medium.com/facebooks-war-on-switching-costs-27fa4aeb7978">put it</a>: network effects attract users, switching costs take them hostage.</p><p>The business model that grew inside those platforms - free to use, funded by ads - produced the attention economy, one of the most consequential emergent forces of the last twenty years. When revenue depends on time spent rather than value provided, the incentive is to trigger compulsion, not satisfy need. The algorithm doesn&#8217;t care whether the hour spent made you feel better or worse, or helped you achieve your goals. It just cares that you spent the hour.</p><p>Most people reading this have felt the dismal effects. The app you open without deciding to. The argument that left you angry for hours. The moment you looked up and realised forty minutes had simply disappeared. What we imagine as personal failings are, in fact, a system doing its job.</p><div><hr></div><h3><strong>They knew. It didn&#8217;t matter.</strong></h3><p>Even when the builders of these systems recognised the problem, the architecture made it nearly impossible to fix. Tristan Harris, a former Google design ethicist who co-founded the <a href="https://www.humanetech.com/">Center for Humane Technology</a>, has documented how platforms exploit psychological vulnerabilities to capture attention - and awareness alone has failed to produce structural change. His <a href="https://www.ted.com/talks/tristan_harris_why_ai_is_our_ultimate_test_and_greatest_invitation">2025 TED talk</a> makes an argument strikingly similar to this series: that we need to learn from social media&#8217;s failures before repeating them with AI. He&#8217;s right - and this series is an attempt to take that argument one step further, from diagnosis and a highly compelling call for awareness to infrastructure and governance.</p><p>Harris&#8217;s work, alongside the revelations of <a href="https://en.wikipedia.org/wiki/Frances_Haugen">Meta whistleblower Frances Haugen</a>, made clear that people inside these companies understood exactly what they were doing to teenagers, to democracy, to public health - and kept building anyway, because the architecture made any other choice economically irrational. The problem was never awareness. It was structure.</p><p>In 2022, Instagram&#8217;s Adam Mosseri stood on a <a href="https://www.ted.com/talks/adam_mosseri_a_creator_led_internet_built_on_blockchain">TED stage</a> and argued that blockchain-enabled technologies could remove platforms as middlemen, letting creators own their relationships with audiences directly. It was the most concrete vision anyone at Meta had offered for decentralising the platform. Less than a year later, Meta <a href="https://techcrunch.com/2023/03/13/meta-winds-down-support-for-nfts-on-instagram-and-facebook/">shut down the entire initiative</a>. The explanation: they needed to &#8220;focus on other ways to support creators&#8221; - which boiled down to ads on Reels.</p><p>Mosseri&#8217;s talk was sincere. But decentralisation undermines the walled garden, where the revenue lives. The walls don&#8217;t come down because someone gives an inspiring talk. They come down when the incentives change. For social media, they never have.</p><div><hr></div><h3><strong>Now imagine it replaces you</strong></h3><p>There&#8217;s a distinction between a technology that mediates human experience and one that substitutes for it. Social media was the former - it sat between you and the world. AI is the latter. It doesn&#8217;t sit between you and the world. It replaces pieces of the world itself.</p><p>The doctor-influencer you followed online is now the AI giving you a tailored diagnosis. The creative work you watched artists make is now generated on demand. The expertise you paid a lawyer for is replaced by a  conversation with AI. Each genuinely valuable. Cheaper access to expertise, healthcare - real goods, especially for those who previously couldn&#8217;t afford them.</p><p>The problem isn&#8217;t the substitution. It&#8217;s who owns the system doing the substituting. Social media captured your attention, your time, and it turned out, much more. AI captures your <em>function</em>. When a proprietary system replaces what you do, what you create, what you know - the leverage isn&#8217;t behavioural. It&#8217;s existential. Same script, bigger explosion.</p><div><hr></div><h3><strong>The walls are going up again</strong></h3><p>Decisions being made today about ownership of AI&#8217;s foundational infrastructure are this generation&#8217;s equivalent of the social media story. Except that the technology is more powerful, the transition faster, the concentration risk higher.</p><p>Without deliberate structural intervention, AI will follow the same path. Not because the people building it are malicious. Because there is too much money to be made building walls. The same incentives that turned a photo filter app into a machine for harvesting attention are present in AI, at a larger scale, with higher stakes.</p><p>Awareness hasn&#8217;t fixed social media. Good intentions haven&#8217;t fixed it. Congressional hearings haven&#8217;t fixed it. What was never built, when there was still a chance, was structural intervention - open infrastructure, portable data, shared governance, business models where you pay for the service rather than being the product. Think email: you can switch providers, keep your history, and no one owns the protocol. The same can&#8217;t be said for any of your social media feeds.</p><p>It can still be built for AI. I wouldn&#8217;t be writing this series if I didn&#8217;t believe the possibility of intervention exists. There&#8217;s  a decades-long track record of it in computing, it&#8217;s already being applied to AI, and I&#8217;ve put my own career behind it. The answer starts with open infrastructure: systems no single company or government can capture, that anyone can build on, and that provide the transparency and choice that social media&#8217;s architecture never had. But open infrastructure alone isn&#8217;t enough - without shared governance, open becomes a different kind of unaccountable. The imperative  is to build both.</p><p>In the next post, I want to get concrete: what does intervention  look like, who is leading  it, and why the work happening in open source AI foundations right now may be the most important effort  most people have never heard of.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-five-open&quot;,&quot;text&quot;:&quot;Read Part 5&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-five-open"><span>Read Part 5</span></a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>Thanks for reading my idle thoughts! Subscribe for free to receive new posts.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Biggest Fears with AI, Part Three: The Transition Window]]></title><description><![CDATA[This is Part 3 of a series.]]></description><link>https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-three</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-three</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Thu, 19 Mar 2026 19:01:39 GMT</pubDate><content:encoded><![CDATA[<p><em>This is Part 3 of a series. Start with <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">Part 1</a> if you&#8217;re new here, or continue from <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the">Part 2</a>.</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><p>My first two posts laid out <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">the economic risk</a> and <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the">the geopolitical risk</a> of AI. Both are structural, accelerating, and have historical parallels that should make us uncomfortable. But both made the same case: that there&#8217;s a window in which structural choices can still be made, and it&#8217;s closing.</p><p>This post is about that window - why I think it exists, why I see it as narrower than most people realise, and what I believe closes it.</p><div><hr></div><h3><strong>The weavers who never saw the upside</strong></h3><p>The comforting story about technological disruption goes like this: transitions are painful, but institutions catch up. The gains redistribute. It works out.</p><p>I don&#8217;t buy it. Here&#8217;s why. Acemoglu and Johnson - from <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">Post 1</a> - <a href="https://economics.mit.edu/sites/default/files/2024-10/Learning%20from%20Ricardo%20and%20Thompson.pdf">documented</a> the impact of the Industrial Revolution on English handloom weavers. Real wages halved in barely a decade. The economic benefits of industrialisation didn&#8217;t reach workers in the span of an average working lifetime. The people who bore the cost never lived to see the upside.</p><p>But there&#8217;s a second act. Over decades, institutions caught up. Factory acts. Unions. Public education. Progressive taxation. The gains redistributed - not quickly, and not necessarily fairly, but they did. The pie grew, and <em>some</em> of those benefits were realised by all.</p><p>Why? Not goodwill. Those institutions formed because labour was still necessary. Factory owners needed workers. That gave workers leverage - to strike, to bargain, to make production stop. Every mechanism that forced redistribution traced back to the same truth: capital could not produce without labour.</p><p>What happens when that&#8217;s no longer true?</p><p>The standard rebuttal is that technology creates new jobs to replace the ones it destroys. The loom killed the weaver but created the factory mechanic. The internet killed the travel agent but created the web developer. True - but every previous revolution automated <em>specific tasks</em>, shifting demand to new human skills. AI is different. It doesn&#8217;t automate a task. It automates the <em>capacity to do tasks</em>. When the next new job category emerges - whatever the AI-age equivalent of &#8220;web designer&#8221; or &#8220;SEO consultant&#8221; turns out to be - AI will be able to do that too. The escape hatch for generations, retrain into the new thing, closes when the new thing is also automatable on arrival.</p><p>I build AI products and watch this play out almost weekly. Recently, I built and shipped a complex application - back-end services, mobile and web front-ends, geolocation, payments, audio and video - in days. I&#8217;m not a mobile developer. I&#8217;m a back-end and infrastructure engineer. I&#8217;d never built a multi-platform mobile app before. But with AI, I was able to ship something more polished than many professional apps on the market. Work that would have taken a team of five several months. Research that used to take me a week now takes under an hour. Understanding an unfamiliar codebase - weeks of reading - now takes hours. I know good engineers who&#8217;ve lost their jobs because a team of twenty can now be done by five - and the five ship faster than the twenty ever did. That&#8217;s not a comfortable thing to witness.</p><p>Each of these is a data point on a trajectory where the value of human labour trends toward zero. Not everywhere at once, but directionally - and faster than I would have imagined, even a year ago.</p><p>As a techno-optimist (yes, I am!) it&#8217;s tempting to see the good in this trend. Faster drug discovery. Cures for diseases, cheaper than ever. Maybe even a solution to climate change. AI can and will bring about enormous scientific advancements. But our existing economic systems will siphon the financial gains from those advancements to the few who own the AI systems.</p><p>Some - including Acemoglu himself - <a href="https://economics.mit.edu/sites/default/files/2024-04/The%20Simple%20Macroeconomics%20of%20AI.pdf">argue that AI&#8217;s near-term economic impact will be more modest</a> than the hype suggests. He may be right about the pace. But the question I&#8217;m asking isn&#8217;t <em>how fast</em> the productivity gains arrive - it&#8217;s who captures them when they do. I could be wrong about the timeline. But I don&#8217;t think I&#8217;m wrong about the direction. If you work in tech, you&#8217;re probably already seeing it. If you don&#8217;t, ask someone who does how their job has changed in the last year. The answer will be more dramatic than you expect.</p><div><hr></div><h3><strong>Three phases - and what we lose in each</strong></h3><p>The AI transition has three phases, defined not by what gets automated but by how much leverage labour retains.</p><p><strong>Phase 1: Partial automation.</strong> This is now. AI handles cognitive tasks at the margins. Jobs don&#8217;t disappear, they compress. Fewer people do more work. The result is layoffs - we&#8217;re seeing a lot of them right now - and predicted productivity gains that accrue to the firms doing the cutting. Ownership of AI capability concentrates in a handful of companies. But labour is still necessary, and the traditional mechanisms of democratic pressure - unions, politics, the threat of withdrawal - still function, even if at diminished capacity. The trap is complacency. The numbers look fine while the groundwork for what comes next is being laid by the companies doing the disrupting - not by governments, not by unions, not by the public.</p><p><strong>Phase 2: Broad displacement.</strong> Robotics catches up with cognitive AI. White-collar displacement accelerates. The tax base erodes as labour income falls. History is consistent: mass displacement without adequate response produces political radicalisation. Leverage to create change erodes. Strikes lose their teeth when you aren&#8217;t needed anyway - go ahead and strike, who cares? The trap is policy lag. By the time legislators grasp the scale, the leverage to respond may be gone.</p><p><strong>Phase 3: Near-zero marginal cost production.</strong> Robots build robots. Solar powers everything. The cost of goods collapses. If productive infrastructure is privately owned, you get neo-feudal lock-in - the scenario from <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">Post 1</a>. If it&#8217;s publicly governed or broadly distributed, you get something closer to post-scarcity: basic material needs met at near-zero cost, human effort freed for work that&#8217;s chosen rather than coerced. The trap is irreversibility. Because labour is optional, strikes have no effect. No demand for labour means no labour market to tighten. The only remaining leverage is political - and by this point, the neo-feudal lords have already captured the political system entirely.</p><p>We&#8217;re in Phase 1, and soon entering Phase 2 and I expect AI-driven layoffs to continue. This isn&#8217;t just the period where structural choices can still be made. It may be the last time workers have the power to demand them.</p><div><hr></div><h3><strong>The speed asymmetry</strong></h3><p>Even within the window, there&#8217;s a problem: everything that needs to happen operates on different timescales.</p><p>The AI capabilities I build with today are dramatically more powerful than six months ago. In three months, they&#8217;ll be more powerful again. Acceleration is exponential. Meanwhile, retraining takes five to ten years. Safety net reform takes ten to twenty. International governance takes twenty to thirty. The gap between how fast the technology moves and how fast institutions can respond is the core structural problem.</p><p>It&#8217;s the same mismatch that made the Industrial Revolution brutal for weavers, just faster.</p><p>Consider the early internet. <a href="https://en.wikipedia.org/wiki/Section_230">Section 230</a>, passed in 1996 - <a href="https://www.propublica.org/article/nsu-section-230">twenty-six words</a> tucked into a telecoms bill, almost no public debate, forty million people online - gave platforms immunity from liability for what their users posted. Those twenty-six words determined the structure of the digital economy for decades, enabled the unchecked rise of social media giants, and we&#8217;re still arguing about the consequences thirty years later. The decisions being made right now about AI infrastructure are this generation&#8217;s Section 230 moment. Some are happening in the right places: standards bodies and open source foundations that are transparent and democratic by design. But many are being made in cloud computing contracts and chip export policies - behind closed doors, no public input, no oversight.</p><div><hr></div><h3><strong>Taxing the feudal lord</strong></h3><p>Standard policy responses - corporate tax reform, UBI, robot taxes - are still necessary. But they redistribute gains after concentration has occurred. And they depend on ongoing political will, which is the very thing that erodes as labour leverage disappears. A tax can be repealed. A subsidy cut. A UBI pilot defunded. Each requires someone in power to keep choosing redistribution, every year, against the interests of those with the most resources to lobby against it.</p><p>Infrastructure-layer interventions are different. Who owns the machines. Who governs the protocols. What becomes open standard. These operate before concentration, and they&#8217;re structural rather than discretionary. An open protocol doesn&#8217;t need a politician to defend it every budget cycle. A commons, once established - like the Linux kernel, or TCP/IP - is harder to capture than a tax is to repeal.</p><p>Open infrastructure alone doesn&#8217;t feed anyone. If AI eventually produces everything at near-zero cost but no one has a job, an open protocol doesn&#8217;t put food on the table. But because the protocols are open, no one needs permission to build, to compete, or to participate. Compare that to mobile app stores, where two companies control the only distribution channels and take a cut of everything - that&#8217;s what a proprietary infrastructure looks like. Open infrastructure keeps the system auditable, governable, and critically, it provides choice - a government can run sovereign AI infrastructure for public services without depending on a foreign corporation. Without that foundation, taxation can be evaded, regulation lobbied away, and democratic oversight has no surface to grip. With it, those mechanisms have a fighting chance.</p><p>Policy asks how we redistribute what the system produces. Infrastructure asks who controls the system. Taxing the feudal lord is better than not taxing the feudal lord. But it&#8217;s not the same as preventing feudalism.</p><div><hr></div><h3><strong>The transition window</strong></h3><p>The weavers had no agency over the transition that destroyed their livelihoods. But the institutions that eventually protected them formed because labour still had leverage: the ability to withdraw work and make the system stop.</p><p>We have one thing the weavers didn&#8217;t: hindsight. We can see where this trajectory leads. And like the weavers, we still have labour leverage - but unlike them, ours has an expiration date. The window in which ordinary people retain enough economic relevance to demand a different architecture is finite and closing. Just a little more every day.</p><p>In the next post, I want to look at what an infrastructure-layer response actually looks like. It turns out someone already built one - and you definitely use it every day without knowing it.</p><p>In <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">Part 1</a>, Ricardo followed the argument to an uncomfortable conclusion. In <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the">Part 2</a>, Szilard tried to govern the knowledge before the race began. The weavers waited for institutions to catch up and paid the price of a generation. We don&#8217;t have a generation. We might have a decade. How are you preparing?</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://open.substack.com/pub/maniksurtani/p/biggest-fears-with-ai-part-four-weve&quot;,&quot;text&quot;:&quot;Read Part 4&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://open.substack.com/pub/maniksurtani/p/biggest-fears-with-ai-part-four-weve"><span>Read Part 4</span></a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>Thanks for reading my idle thoughts! Subscribe for free to receive new posts.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Biggest Fears with AI, Part Two: The Geopolitical Risk]]></title><description><![CDATA[In September 1933, a Hungarian physicist crossed a London street and saw the future.]]></description><link>https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Mon, 16 Mar 2026 04:26:47 GMT</pubDate><content:encoded><![CDATA[<p>In September 1933, a Hungarian physicist crossed a London street and saw the future. What he - and the world - did with that insight is history we&#8217;re revisiting with AI.</p><p>In my <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the">last post</a>, I laid out the economic risk: the structural problem of wages and productivity diverging, accelerating as AI automates cognitive labour. But at <a href="https://policyweek.com.au/">Policy Week Sydney</a>, I shared two fears that keep me up at night. The second is geopolitical: that weaponised AI becomes a tool of national competition and state power rather than a shared resource. I find it hard to look away from.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><div><hr></div><h3>The physicist who saw it first</h3><p>Leo Szilard was living in Bloomsbury, Central London, when, in September 1933, pausing to cross Southampton Row, he first conceived of the nuclear chain reaction. He had read H.G. Wells&#8217; <a href="https://en.wikipedia.org/wiki/The_World_Set_Free">The World Set Free</a>, which imagined atomic bombs and the destruction they would bring. Wells wrote it as a warning. Szilard read it as a blueprint that physics was about to make real.</p><p>Szilard&#8217;s first instinct was not to build the weapon. It was to govern the knowledge. Filing a patent on the chain reaction, and assigning it to the British Admiralty to keep it out of the public eye. He was trying to prevent an arms race.</p><p>It didn&#8217;t work. By 1939, with war approaching, Szilard co-authored Einstein&#8217;s <a href="https://www.atomicheritage.org/key-documents/einstein-szilard-letter">letter to President Roosevelt</a> that launched the Manhattan Project. He spent the rest of his life in the wreckage of that decision - not because it was wrong, but because the governance architecture he&#8217;d hoped for was never built. After Hiroshima, he argued that secrecy and national monopoly over existential capability doesn&#8217;t produce security. It produces escalation.</p><p>Szilard was a pacifist by instinct - yet he spent his career arguing against those instincts, because at each turn, the alternative was worse. Build the bomb before Germany does. Warn Roosevelt before it&#8217;s too late. Accept the standoff because unilateral disarmament was unserious. The logic of competition overriding the logic of peace, and each concession making the next one harder to avoid.</p><p>He was right. The Soviet Union didn&#8217;t refrain from building a bomb because the US kept the secret. They built one faster, because the secret confirmed the threat. The logic of mutually assured destruction created a world of blocs and borders, of us versus them. Monopoly over existential capability created a race to parity - and the race itself is where the danger lived.</p><p>But it wasn&#8217;t enough to be right. He was outmanoeuvred by the logic of national competition before governance structures could be built. Not because shared governance was impractical, but because it was politically inconvenient - and by the time the political will existed, the dynamics were already locked in.</p><p>Leopold Aschenbrenner also made the Szilard comparison, in his influential 2024 essay series on AI&#8217;s trajectory, <em><a href="https://situational-awareness.ai/">Situational Awareness</a></em>. He compellingly argued that people building frontier AI today may be in Szilard&#8217;s position: seeing clearly what&#8217;s coming while the rest of the world hasn&#8217;t caught up. Where I part ways with Aschenbrenner are the lessons I take from  Szilard&#8217;s story. Aschenbrenner draws the nuclear parallel to argue for national securitisation - that the US <em>must race</em> to maintain its AI advantage. I follow  the same parallel to the opposite conclusion: that the <em>race itself</em> is the primary danger. Not that the good guys need to win the race, but that the race, once started, produces bad outcomes for everyone.</p><p>With AI we&#8217;re already deep into the cascading logic of an arms race.</p><div><hr></div><h3>Anthropic and the Department of War</h3><p>In July 2025, Anthropic (the company behind Claude) signed a $200 million contract with the Pentagon. Claude became the first frontier AI model approved for use on classified military networks. The contract contained two explicit red lines: no autonomous lethal weapons, no mass surveillance of US citizens.</p><p>A month later, the Pentagon rebranded as the Department of War.</p><p>In January 2026, Defense Secretary Pete Hegseth directed all DoW AI contracts to adopt &#8220;any lawful use&#8221; language - overriding Anthropic&#8217;s restrictions. When Anthropic held firm, the <a href="https://www.cnn.com/2026/02/27/tech/anthropic-pentagon-deadline">Trump administration ordered all federal agencies to cease using Anthropic products</a>. Hegseth then designated Anthropic a <a href="https://www.mayerbrown.com/en/insights/publications/2026/03/pentagon-designates-anthropic-a-supply-chain-risk-what-government-contractors-need-to-know">&#8220;supply chain risk&#8221;</a> - a classification historically reserved for foreign adversaries - meaning any company doing business with the US military must certify it doesn&#8217;t use Anthropic products. Given that eight of the ten largest US companies use Claude, the blast radius is enormous.</p><p><a href="https://openai.com/index/our-agreement-with-the-department-of-war/">OpenAI stepped in to fill the gap</a>, accepting the terms Anthropic had refused. 1.5 million users allegedly cancelled their ChatGPT subscriptions in response. <a href="https://www.cnn.com/2026/03/09/tech/anthropic-sues-pentagon">Anthropic sued</a>, calling the designation &#8220;unprecedented and unlawful.&#8221;</p><p>I&#8217;m telling this story not to take sides in a commercial dispute, but because it illustrates the structural problem. A company drew ethical red lines on how its technology could be used. The state moved to crush it. A competitor stepped in. As the <a href="https://www.eff.org/deeplinks/2026/03/anthropic-dod-conflict-privacy-protections-shouldnt-depend-decisions-few-powerful">EFF has pointed out</a>, if ethical protections depend on the commercial decisions of individual companies, they&#8217;re revocable the moment a government applies enough pressure. The market signal is unmistakable: ethical limits on AI&#8217;s use by governments are a competitive disadvantage to be punished, not a standard to be upheld.</p><p>This is the Szilard question, live and in court. Can private actors set ethical limits on how the state uses transformative technology? Or will the logic of national security override every guardrail, just as it did with nuclear weapons? What precedent will that set for other state actors?</p><div><hr></div><h3>The arms race we&#8217;re building</h3><p>Zoom out and the pattern is broader still. The US has pursued AI superiority through export controls - restricting advanced chip sales to China since 2022. The intended effect was to slow Chinese AI development. The actual effect: constrained by hardware limitations, Chinese labs were forced into more efficient architectures. In January 2025, <a href="https://arxiv.org/abs/2501.12948">DeepSeek released R1</a> - near-frontier capability at a fraction of the assumed compute cost. A control mechanism produced the opposite of its intended result.</p><p>This is the nuclear dynamic repeating. Each side&#8217;s attempt to maintain superiority validates the other&#8217;s fear and accelerates the competition. We&#8217;ve seen this story before, we know how it plays out and how the stakes escalate.</p><p>At each turn, the space for cooperation narrows. The most dangerous endpoint is geopolitical fragmentation of AI infrastructure: incompatible systems, no shared standards, no verification mechanisms, no shared foundation on which to build trust.</p><div><hr></div><h3>The counter-model</h3><p>Szilard&#8217;s instinct - shared governance of transformative technology - failed for nuclear weapons. But it didn&#8217;t fail everywhere.</p><p>Open source software has quietly become the neutral ground on which geopolitical competitors build shared infrastructure. TCP/IP, HTTP, SMTP - the protocols the Internet runs on - are shared standards, used by every nation regardless of political alignment. The <a href="https://www.linuxfoundation.org/">Linux Foundation</a> and <a href="https://www.cncf.io/">CNCF</a> extended this logic into computing and cloud infrastructure, creating vendor-neutral governance around the technologies the modern economy runs on. Competition happens above the foundation - in applications, services, features - not at the foundation itself.</p><p>What makes this remarkable is who participates. Huawei - a company the US sanctioned and restricted from buying American chips - has been a top-five contributor to the Linux kernel for years, and at times the single largest corporate contributor. China ranks second in the world for contributions to CNCF projects. Alibaba, ByteDance, and Huawei are all active participants in Kubernetes development. These aren&#8217;t peripheral contributions. It&#8217;s the core infrastructure that runs the world&#8217;s cloud computing, and engineers from rival nations are building it together.</p><p>And critically: no government has weaponised this layer. Despite escalating tensions over trade, chips, and AI, neither the US nor China has attempted to fork the Linux kernel along geopolitical lines, or to deny adversaries access to Kubernetes. The shared infrastructure remains shared - because both sides depend on it, and because the governance structures make unilateral capture impractical. This is exactly the dynamic Szilard wanted for nuclear technology and never got.</p><p>Shared AI infrastructure standards - at the protocol layer, for example - could play a similar stabilising role. Not preventing competition at the application layer. And, powerfully, creating something the nuclear era never had: a technical foundation for verification, interoperability, and shared governance. The preconditions for trust, even between adversaries.</p><p>This isn&#8217;t a hypothetical for me. It&#8217;s why I co-founded the <a href="https://aaif.io/press/linux-foundation-announces-the-formation-of-the-agentic-ai-foundation-aaif-anchored-by-new-project-contributions-including-model-context-protocol-mcp-goose-and-agents-md/">Agentic AI Infrastructure Foundation</a> alongside several major AI companies - to try to build exactly this kind of shared, open infrastructure for the AI layer where agents communicate and coordinate.</p><div><hr></div><h3>The window</h3><p>Szilard&#8217;s instincts were right. His timing was wrong. By the time the international community was ready to talk seriously about nuclear governance - the <a href="https://en.wikipedia.org/wiki/Treaty_on_the_Non-Proliferation_of_Nuclear_Weapons">Non-Proliferation Treaty</a> wasn&#8217;t signed until 1968, twenty-three years after Hiroshima - the dynamics were already entrenched.</p><p>Will the same logic outmanoeuvre us again? AI infrastructure is being built right now - protocols, standards, ownership structures. They pass through a brief window where the architecture is still malleable, and then lock in - and what looked like a choice becomes a permanent condition. As students of nuclear arms control can tell, negotiation becomes increasingly difficult beyond that point.</p><p>That window is narrower than most people realise. In the next post, I want to lay out why the next few years may be the only years that matter, and what might happen on the other side.</p><p>Szilard spent his last decades trying to put a genie back in a bottle. We might not have to. But only if we act before the genie escapes.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-three&quot;,&quot;text&quot;:&quot;Read Part 3&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-three"><span>Read Part 3</span></a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>Thanks for reading my idle thoughts! Subscribe for free to receive new posts.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Biggest Fears with AI, Part One: The Economic Risk]]></title><description><![CDATA[On Wednesday, at Policy Week Sydney, I was asked a question:]]></description><link>https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the</link><guid isPermaLink="false">https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-one-the</guid><dc:creator><![CDATA[Manik Surtani]]></dc:creator><pubDate>Fri, 13 Mar 2026 13:08:34 GMT</pubDate><content:encoded><![CDATA[<p>On Wednesday, at <a href="https://policyweek.com.au">Policy Week Sydney</a>, I was asked a question:</p><p><em>&#8220;What&#8217;s your biggest fear with AI?&#8221;</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/subscribe?"><span>Subscribe now</span></a></p><p>My response was twofold. My first fear is economic: the short-term disruption that&#8217;s already underway, and the risk that long-term policy responses fall short of what the situation demands. The second is geopolitical: that AI becomes weaponised; a tool of national competition and state power rather than a shared resource that benefits everyone. I didn&#8217;t have to reach for hypotheticals - but more on this in a future post.</p><p>What follows here is the first in a series of posts elaborating on both fears - not as abstract anxieties, but specific, structural problems with historical precedents and, I believe, potential solutions.</p><p>Let&#8217;s start with the economic risk.</p><div><hr></div><h3>The economist who changed his mind</h3><p>In 1817, David Ricardo published <em><a href="https://www.marxists.org/reference/subject/economics/ricardo/tax/">Principles of Political Economy</a></em>, establishing much of the intellectual foundation of modern economics. He argued - as most economists have argued since - that technological progress is ultimately good for workers. Machinery displaces some jobs, but it creates new ones, raising productivity and living standards overall. This went on to become something close to economic orthodoxy.</p><p>What&#8217;s less well known is that subsequently Ricardo quietly changed his mind.</p><p>In a new chapter added to the third edition in 1821, he revised his position, concluding that the introduction of machinery could harm the working class. That productivity gains didn&#8217;t automatically translate into shared prosperity. That the displacement of labour by capital was a real and persistent problem, not just a temporary adjustment. He&#8217;d worked through the numbers and arrived somewhere&#8230; uncomfortable.</p><p>He never trumpeted his reversal, but economists Daron Acemoglu and Simon Johnson <a href="https://economics.mit.edu/sites/default/files/2024-04/Learning%20from%20Ricardo%20and%20Thompson%20-%20Machinery%20and%20Labor%20in%20the%20Early%20Industrial%20Revolution%20-%20and%20in%20the%20Age%20of%20AI.pdf">recently highlighted it</a> as one of the more significant - and underappreciated - moments in the history of economic thought. A man who had built the framework that justified technological optimism, looking at the same framework more carefully, concluded the exact opposite.</p><p>I find this story important because it models a willingness to follow an argument even when it leads somewhere inconvenient. That&#8217;s the spirit in which I want to approach this topic.</p><div><hr></div><h3>The divergence that&#8217;s already happening</h3><p>On AI&#8217;s economic disruption: it isn&#8217;t coming. It&#8217;s already here. And it has been accelerating for decades.</p><p>Since the 1970s, productivity and wages in most developed economies have <a href="https://www.epi.org/productivity-pay-gap/">sharply diverged</a>. GDP has grown. The economy has grown. Corporate profits have grown. The value produced per worker has grown. And yet median real wages - what the typical worker actually takes home after inflation - have been largely flat. The gains have accrued overwhelmingly to capital owners, not labour.</p><p>The evidence is there. It is measurable in the data of every major Western economy. The extent of divergence is sometimes debated, but the direction is not. The standard response is that this divergence has non-technological causes - globalisation, declining union membership, policy choices. All true. But when people claim &#8220;AI will create new jobs to replace the ones it displaces&#8221;, the last fifty years of evidence urge caution. Even if the jobs are created, the gains won&#8217;t automatically distribute themselves to the people who need them.</p><p>Previous waves of automation have largely displaced routine physical labour - repetitive and rule-based - freeing people to engage in higher value work. What&#8217;s different about this wave is that it displaces cognitive labour: the analysis, the coding, the diagnosis, the legal research. The jobs that the middle class retrained into after the last round of automation are now the jobs being automated. The escalator that was supposed to carry displaced workers upward is being removed.</p><div><hr></div><h3>A note on where the blame doesn&#8217;t lie</h3><p>None of this is an argument against companies adopting AI. A company that can deliver better work, faster, at lower cost, is doing what companies are supposed to do. The problem isn&#8217;t that companies are making rational decisions. The problem is that the system surrounding those decisions has no mechanism to distribute the resulting gains. That&#8217;s not a failure of any individual companies and their decisions. It&#8217;s a failure of policy and institutional design. And it&#8217;s the level at which the response needs to operate.</p><div><hr></div><h3>The neo-feudal scenario</h3><p>Follow this trajectory to its logical endpoint and you arrive somewhere economists don&#8217;t have great language for, but which we might call neo-feudalism.</p><p>Automation drives productivity gains that accrue to whoever owns the automated capital: the models, the robots, the infrastructure. That ownership concentrates rapidly in a small number of corporations and individuals. Concentrated capital compounds: the returns from owning productive infrastructure are reinvested into more productive infrastructure. Meanwhile, the labour income that used to distribute purchasing power broadly across the population shrinks. The middle hollows out. Not the very bottom, where some physical and care work remains hard to automate, and not the very top, where ownership confers returns regardless of personal productivity. But the broad middle, credited with its stabilising effect on democratic societies.</p><p>The natural political response is to raise taxes on corporate profits and redistribute accordingly. That may certainly be a necessary part of any response, but it faces serious structural headwinds. Corporate profits are the most mobile form of taxable income: companies can relocate IP, engage in transfer pricing, domicile earnings in low-tax jurisdictions (remember <a href="https://conversableeconomist.com/2014/07/16/double-irish-dutch-sandwich/">the Double Irish Dutch sandwich</a>?). The OECD spent a decade negotiating a global minimum corporate tax rate of 15% and still faces significant holdouts. Getting from 15% to something that meaningfully funds a post-labour social contract requires a level of international coordination that has historically proven extremely difficult to achieve.</p><p>But the problem is deeper than the collection problem. Corporate tax revenue distributed through government programs isn&#8217;t the same thing as wages. Wages have historically acted as an automatic distribution mechanism, continuously putting purchasing power into the hands of a broad population. Replace wages with government transfers and you&#8217;ve introduced a political dependency that concentrated wealth tends, over time, to reshape in its favour. Political capture by self-interested elites happens all the time, eroding protections and safeguards offered to the average person.</p><p>This is the scenario I&#8217;m worried about. Not the old B-movie trope of robots enslaving humanity, but a quieter, more insidious shift with a small ownership class capturing the productive gains of automation, while the rest becomes economically peripheral. Not oppressed exactly, but just irrelevant. History is rich with examples of what societies look like when the economic foundation of the middle class is removed. </p><p>Here we have neo-feudalism.</p><div><hr></div><h3>Why the window matters</h3><p>None of this is inevitable. But the window for structural solutions is narrowing.  Decisions being made now - about who owns AI&#8217;s foundational infrastructure, about how it&#8217;s governed, about what becomes a commons and what becomes proprietary - will be much harder to reverse in a few years than they are today.</p><p>Ricardo publicly changed his mind in 1821, even though it was inconvenient. The question worth sitting with is whether we&#8217;re willing to do the same. To look at where the current trajectory actually leads, rather than where we&#8217;d like it to go, and to act on what we find.</p><p>There&#8217;s obviously a lot more to be said, so I&#8217;m splitting my thoughts into a few posts. <a href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the">Next, the geopolitical risk</a> - and the story of a physicist imagining nuclear fission on a pre-war London street corner and spending the rest of his life trying to grapple with its implications. In some regards, AI may find its only parallel in the atomic bomb, so we might have a lot to learn from his story. </p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the&quot;,&quot;text&quot;:&quot;Read Part Two&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://maniksurtani.substack.com/p/biggest-fears-with-ai-part-two-the"><span>Read Part Two</span></a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://maniksurtani.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>Thanks for reading my idle thoughts! Subscribe for free to receive new posts.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item></channel></rss>