<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[The Rest of the System]]></title><description><![CDATA[Field notes on the machinery around the model, work, judgment, ownership, and what happens after the demo, for the operators and leaders who have to own the results.]]></description><link>https://news.tomsullivan.dev</link><image><url>https://substackcdn.com/image/fetch/$s_!zoId!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2b1092f-0e83-4ba3-b33e-16853284c7ca_1024x1024.png</url><title>The Rest of the System</title><link>https://news.tomsullivan.dev</link></image><generator>Substack</generator><lastBuildDate>Tue, 25 Aug 2026 21:26:00 GMT</lastBuildDate><atom:link href="https://news.tomsullivan.dev/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Tom Sullivan]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[restofthesystem@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[restofthesystem@substack.com]]></itunes:email><itunes:name><![CDATA[Tom]]></itunes:name></itunes:owner><itunes:author><![CDATA[Tom]]></itunes:author><googleplay:owner><![CDATA[restofthesystem@substack.com]]></googleplay:owner><googleplay:email><![CDATA[restofthesystem@substack.com]]></googleplay:email><googleplay:author><![CDATA[Tom]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[The model is the small box]]></title><description><![CDATA[The AI model is likely the most reliable part of your entire system]]></description><link>https://news.tomsullivan.dev/p/the-model-is-the-small-box</link><guid isPermaLink="false">https://news.tomsullivan.dev/p/the-model-is-the-small-box</guid><dc:creator><![CDATA[Tom]]></dc:creator><pubDate>Mon, 24 Aug 2026 20:06:46 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!zoId!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2b1092f-0e83-4ba3-b33e-16853284c7ca_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>In 2015, researchers at Google published the following diagram in <a href="https://research.google/pubs/hidden-technical-debt-in-machine-learning-systems/">Hidden Technical Debt in Machine Learning Systems</a>. The almost unreadable, black box labeled &#8220;ML code&#8221; is where a lot of engineering of that era focused. </p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!68W8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!68W8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 424w, https://substackcdn.com/image/fetch/$s_!68W8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 848w, https://substackcdn.com/image/fetch/$s_!68W8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 1272w, https://substackcdn.com/image/fetch/$s_!68W8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!68W8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png" width="639" height="201" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a38d373e-5748-4c44-b376-1307d55324dd_639x201.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:201,&quot;width&quot;:639,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:19364,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://news.tomsullivan.dev/i/212599260?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!68W8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 424w, https://substackcdn.com/image/fetch/$s_!68W8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 848w, https://substackcdn.com/image/fetch/$s_!68W8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 1272w, https://substackcdn.com/image/fetch/$s_!68W8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa38d373e-5748-4c44-b376-1307d55324dd_639x201.png 1456w" sizes="100vw" fetchpriority="high"></picture><div></div></div></a></figure></div><p>Just like in 2015, the same is true today with AI. From an engineering perspective, we have several to dozens of boxes across data, infra, observability, inference, and more. Similarly, we also have to consider process integration, change management, training and talent management, support, financial validation to fully capture value from the system. </p><p>The diagram is just as relevant today as it was then. Teams and leaders often focus on the model (i.e., hallucination / cost / vendor lock in, etc.). While this is incredibly important, results depend on the full supporting system. </p><p>The FULL system, the one going much beyond the model, is also why I&#8217;m writing this newsletter. <em>The Rest of the System</em> covers the work, judgment, ownership, controls, and long term maintenance around the model. These aspects drive whether AI creates long term value for people and organizations, or the pilot gets canned or relegated to the backlog.</p><p>I spent the last ~15 years implementing systems inside larger orgs, most of which are regulated. I walked manufacturing floors in pharma / consumer products, implemented automations and software, worked with LOB finance teams to qualify opportunities, and HR to carefully plan change management and long term talent management. </p><p>I work with leaders most days to plan, design, build, deploy, and retire solutions today, so I will share what I am building, seeing, and reading from that lens, and I promise to share real examples when I have them.</p><p><strong>Three recurring lenses will organize the publication (likely more to follow):</strong></p><ul><li><p><em><strong>Field Notes</strong></em><strong>:</strong> translation from the physical or business process into software.</p></li><li><p><em><strong>Shaped Like Success</strong></em><strong>:</strong> systems that look green while quietly failing (particularly insidious with AI / nondeterministic systems).</p></li><li><p><em><strong>After the Demo</strong></em><strong>:</strong> adoption, ownership, maintenance, and the operating life of a build.</p></li></ul><p>Expect one issue every week or two.</p><p>The full detailed essays, models, and figures live at <a href="https://tomsullivan.dev/writing/">tomsullivan.dev</a>, but each email version will stand on its own.</p><p>The complete flagship essay behind the first issue is currently live here:</p><ul><li><p><a href="https://tomsullivan.dev/writing/fde-before-the-label/">Forward-Deployed Engineering Is New. The Work Underneath It Is Not.</a></p></li></ul><p><strong>Request</strong>: Please drop me a line and tell me what part of the AI implementation / management process your organization is still figuring out how to build and / or own. I read every reply, and the answers steer what I investigate next.</p><p>Have a wonderful week,</p><p>Tom</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://news.tomsullivan.dev/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading The Rest of the System! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item></channel></rss>