<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Data with Baraa]]></title><description><![CDATA[Data Engineer with 17+ years of experience, Ex-Mercedes Benz. I visually explain data and build real-world courses.
👇 Subscribe to get the latest content straight to your inbox! 
]]></description><link>https://www.blog.datawithbaraa.com</link><image><url>https://substackcdn.com/image/fetch/$s_!pYyn!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c71cf6d-1277-4ff5-996a-7be14558308b_772x772.png</url><title>Data with Baraa</title><link>https://www.blog.datawithbaraa.com</link></image><generator>Substack</generator><lastBuildDate>Sun, 04 Oct 2026 16:33:20 GMT</lastBuildDate><atom:link href="https://www.blog.datawithbaraa.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Baraa]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[baraa@datawithbaraa.com]]></webMaster><itunes:owner><itunes:email><![CDATA[baraa@datawithbaraa.com]]></itunes:email><itunes:name><![CDATA[Data with Baraa]]></itunes:name></itunes:owner><itunes:author><![CDATA[Data with Baraa]]></itunes:author><googleplay:owner><![CDATA[baraa@datawithbaraa.com]]></googleplay:owner><googleplay:email><![CDATA[baraa@datawithbaraa.com]]></googleplay:email><googleplay:author><![CDATA[Data with Baraa]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Coding With AI: My Experience So Far]]></title><description><![CDATA[One year of letting AI write my code, The good, the bad, and what I do about it.]]></description><link>https://www.blog.datawithbaraa.com/p/coding-with-ai-my-experience-so-far</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/coding-with-ai-my-experience-so-far</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 29 Sep 2026 12:34:44 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/255294a4-aeda-4765-a51e-d031486d3339_3840x2160.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Thursday!</strong></p><p>At the start of 2026 I was sure I would keep writing my own code. One month later, I was not writing a single line.</p><p>It went step by step. First AI gave me suggestions, then it wrote the syntax, then it reviewed my code, then I gave it some functions. Then everything.</p><p>Now AI does the whole coding part. And I have one question the whole year: </p><blockquote><p><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">how do I keep this under control?</mark></strong></p></blockquote><p>Because there is no return back. And I can tell you, it comes with a cost.</p><p>So this is my experience so far. Or maybe I am writing it for my future self, as a checkpoint.</p><p>Let&#8217;s go!</p><div id="youtube2-71iQH1NQYL0" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;71iQH1NQYL0&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/71iQH1NQYL0?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h2><strong>I stopped reading the docs</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!7cL5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!7cL5!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 424w, https://substackcdn.com/image/fetch/$s_!7cL5!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 848w, https://substackcdn.com/image/fetch/$s_!7cL5!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 1272w, https://substackcdn.com/image/fetch/$s_!7cL5!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!7cL5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png" width="3840" height="1782" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1782,&quot;width&quot;:3840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:8346877,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffe12543-1de7-4d50-9f58-e96681daeb0b_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!7cL5!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 424w, https://substackcdn.com/image/fetch/$s_!7cL5!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 848w, https://substackcdn.com/image/fetch/$s_!7cL5!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 1272w, https://substackcdn.com/image/fetch/$s_!7cL5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c0ab25-f961-44a9-b5d4-461ebda096dd_3840x1782.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Before AI, I read the docs every day. A new feature comes out on a platform, I google it, I read it, I learn it.</p><p>I check the syntax of a function. I read the discussions on Stack Overflow.</p><p><strong><mark data-color="#d9ead3" style="background-color: rgb(217, 234, 211); color: rgb(0, 0, 0);">The good side</mark>:</strong> Why bother now? AI explains it instantly and does the research for me. I ask, I get the answer, I save the time.</p><p><strong><mark data-color="#f4cccc" style="background-color: rgb(244, 204, 204); color: rgb(0, 0, 0);">The bad side:</mark></strong> Reading docs sounds like the boring part of the job. But it is one of the main reasons I became an expert.</p><p>While researching one thing, I found ten other features by accident. That is how I built my overview of the platforms I work with.</p><p>Now I get the answer to my question, and nothing else.</p><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">I feel I lost something. I lost the overview.</mark></strong></em></p></blockquote><div><hr></div><h2><strong>Faster than me in everything</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!0uHd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!0uHd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 424w, https://substackcdn.com/image/fetch/$s_!0uHd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 848w, https://substackcdn.com/image/fetch/$s_!0uHd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 1272w, https://substackcdn.com/image/fetch/$s_!0uHd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!0uHd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png" width="3840" height="1637" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/dc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1637,&quot;width&quot;:3840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:6200446,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F102295d5-bc1f-4473-b14e-0111047cab40_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!0uHd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 424w, https://substackcdn.com/image/fetch/$s_!0uHd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 848w, https://substackcdn.com/image/fetch/$s_!0uHd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 1272w, https://substackcdn.com/image/fetch/$s_!0uHd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc0d1c63-2a1a-4178-acaa-c143e670e371_3840x1637.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We cannot argue here. AI is fast, super fast.</p><p>It writes the syntax, the setup code every project needs, and it does the search I used to do. It builds three apps while I make my coffee. It debugs a whole pipeline in seconds, finds the root cause, and suggests three solutions with a recommendation.</p><p>It is faster than me in everything.</p><p><strong>The good side:</strong> I have more time for architecture thinking. And I can test new ideas in no time, things I never dreamed of having time for.</p><p>AI does the boring tasks too: the tests, the metadata, the documentation, and removing the code nobody uses. And the ideas don&#8217;t wait in the backlog anymore, so I do more projects.</p><p><strong>The bad side:</strong> You feel faster with AI. But feeling faster and being faster are two different things. You see it in every project after the first week.</p><p>Since when is speed the most important thing in a project? We never measured the best expert by lines of code per hour.</p><p>Maybe management does, but speed by itself has no value.</p><p>And yes, as long as I am in the loop, I slow the AI down somewhere. That is fine. That is exactly the part that keeps the result right.</p><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">It is all about accuracy.</mark></strong></em></p></blockquote><div><hr></div><div class="callout-block" data-callout="true"><p><strong>If you work in dbt, you know the pain: change one column and half the project needs updating. dbt Wizard CLI is an AI agent in your terminal. It reads your whole dbt project, so it knows the lineage, the tests and the contracts. Then it makes the change across models, YAML and docs in one go, and shows you the diff before anything is saved. Install dbt Wizard CLI <a href="https://fandf.co/46ydbQD">https://fandf.co/46ydbQD</a> (sponsored by dbt Labs)</strong></p></div><div><hr></div><h2><strong>The start is always perfect</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!GTPB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!GTPB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 424w, https://substackcdn.com/image/fetch/$s_!GTPB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 848w, https://substackcdn.com/image/fetch/$s_!GTPB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 1272w, https://substackcdn.com/image/fetch/$s_!GTPB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!GTPB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png" width="648" height="274.725" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1628,&quot;width&quot;:3840,&quot;resizeWidth&quot;:648,&quot;bytes&quot;:7014169,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb01eeb0-454e-49f5-9aa4-5282a73ba319_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!GTPB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 424w, https://substackcdn.com/image/fetch/$s_!GTPB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 848w, https://substackcdn.com/image/fetch/$s_!GTPB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 1272w, https://substackcdn.com/image/fetch/$s_!GTPB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fae3cea62-14c5-4500-8e38-8aff3b6d71c0_3840x1628.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Every AI project I start looks amazing in the first week. A few rounds of changes later, it explodes.</p><p>And I noticed, it is always the same story.</p><ul><li><p><strong>The start is easy:</strong> Empty project, clear task, nothing to break. The AI knows everything, because there is nothing to know yet.</p></li><li><p><strong>Then the changes start:</strong> You ask for a feature, it does a quick fix. You report a bug, it does another quick fix on top of the first one. It never goes back and cleans up.</p></li><li><p><strong>Then it forgets:</strong> The project grows, and the AI knows less and less of it. It fixes the file in front of it and breaks the one next to it.</p></li><li><p><strong>And you stop reading the code:</strong> The start was so good that you trust it. Around the third round you stop looking. The break happens exactly there.</p></li></ul><p>The first 70 percent takes an afternoon. The last 30 percent takes longer than everything before, and often it never arrives.</p><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">It looks finished. It runs. And a few weeks later nobody can fix it, not me and not the AI.</mark></strong></em></p></blockquote><div><hr></div><h2><strong>Who does what? The dilemma</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!QfxI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!QfxI!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 424w, https://substackcdn.com/image/fetch/$s_!QfxI!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 848w, https://substackcdn.com/image/fetch/$s_!QfxI!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 1272w, https://substackcdn.com/image/fetch/$s_!QfxI!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!QfxI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png" width="586" height="272.3984375" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1785,&quot;width&quot;:3840,&quot;resizeWidth&quot;:586,&quot;bytes&quot;:7526654,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5c3ccc7d-e4c3-4008-a729-bed0ee07ebed_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!QfxI!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 424w, https://substackcdn.com/image/fetch/$s_!QfxI!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 848w, https://substackcdn.com/image/fetch/$s_!QfxI!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 1272w, https://substackcdn.com/image/fetch/$s_!QfxI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2fee1ebf-df3a-4991-8d16-fba21fd54070_3840x1785.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>One question haunted me the most: who writes, and who reviews?</p><p>There are a few options, and I tried them all.</p><ul><li><p><strong><mark data-color="#d9ead3" style="background-color: rgb(217, 234, 211); color: rgb(0, 0, 0);">AI codes, I review</mark>:</strong> Impossible. I cannot review thousands of lines of code a day, nobody can. And if I do it, what did we win? AI is fast, I am the bottleneck again, and the speed is gone.</p></li><li><p><strong><mark data-color="#fff2cc" style="background-color: rgb(255, 242, 204); color: rgb(0, 0, 0);">I code, AI reviews</mark>:</strong> I feel like I am blocking the full potential of AI. Everything is slow, when I know AI could write it in seconds.</p></li><li><p><strong><mark data-color="#e6b8af" style="background-color: rgb(230, 184, 175); color: rgb(0, 0, 0);">AI codes, AI reviews</mark>:</strong> This is what people call vibe coding. Good luck with that. AI builds beautiful garbage at incredible speed. Give it a few weeks, and you <strong>throw the whole project in the garbage</strong>.</p></li><li><p><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">AI codes, AI reviews, I review</mark>:</strong> This one I did for months, and it worked.</p></li></ul><p>Until I lost the trust.</p><p>The review said all good. It was not.</p><p>More than once, I caught the AI doing things it never reported.</p><p>And when a test failed, it did not fix the code. It fixed the test.</p><p>So today I added one step, at the very beginning.</p><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">I write the rules. AI codes. AI reviews. And I review.</mark></strong></em></p></blockquote><p>Let me explain it like this.</p><div><hr></div><h2><strong>How I work with AI now</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tAK4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tAK4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 424w, https://substackcdn.com/image/fetch/$s_!tAK4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 848w, https://substackcdn.com/image/fetch/$s_!tAK4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 1272w, https://substackcdn.com/image/fetch/$s_!tAK4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tAK4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png" width="630" height="247.734375" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/af9fe432-248b-4607-af41-caecaae0620f_3840x1510.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1510,&quot;width&quot;:3840,&quot;resizeWidth&quot;:630,&quot;bytes&quot;:6667694,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F384d4035-071f-40b6-8ba4-19f15d1a8392_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tAK4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 424w, https://substackcdn.com/image/fetch/$s_!tAK4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 848w, https://substackcdn.com/image/fetch/$s_!tAK4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 1272w, https://substackcdn.com/image/fetch/$s_!tAK4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf9fe432-248b-4607-af41-caecaae0620f_3840x1510.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I am the expert. AI is a super fast developer with a lot of knowledge, and it lies.</p><p>How do I deal with such a developer? I cannot fire it, because then I do all the work myself again.</p><p>So I manage it. And managing developers is nothing new for me. Three things did not change.</p><p><strong>We never reviewed every single line.</strong> Even before AI, we reviewed the core parts, the ones we knew were important, and we made sure they were protected.</p><p><strong>We always shipped code we did not write.</strong> Every library, every package, every dependency in the project. We never read those line by line. We tested, we checked what matters, and we stayed responsible for what we merged.</p><p><strong>We always wrote the rules.</strong> Standards and guidelines for the team, and everyone had to follow them.</p><p>Same thing for AI. So it looks like this:</p><p>1. I write the rules and the standards in files, like before. Including how big one change can be, because I cannot review a change of two thousand lines, and I will not. The AI is not allowed to change those files. Only me. It can read them as much as it needs.</p><p>2. I give it a memory. Every mistake it makes goes into the files it reads before it writes code, CLAUDE.md or AGENTS.md, and corrections.yaml. And when the same mistake comes twice, it becomes a rule, so it does not come back a third time. One rule is already there: it is not allowed to change a failing test. It fixes the code.</p><p>3. Following my rules and reading its memory, it writes the code.</p><p>4. It reviews its own work and reports it to me.</p><p>5. I review the review. And I review on my own, with zero trust, the things that matter: security leaks, the core transformations, the core functions, anything that deletes data or costs money, and the architecture.</p><p>The AI writes it. I sign it. If it breaks in production, that is on me, not on the tool.</p><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">I stop being the person who writes every line. I become the person who owns the context and proves the result is right.</mark></strong></em></p></blockquote><div><hr></div><h2><strong>What it still costs me</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!1GmF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!1GmF!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!1GmF!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!1GmF!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!1GmF!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!1GmF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png" width="550" height="309.375" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:550,&quot;bytes&quot;:5310815,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!1GmF!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!1GmF!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!1GmF!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!1GmF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e341708-f0b9-4125-ad66-cea70ef303c2_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Even with the rules, the memory and the review, the lost overview stays. And three more things don&#8217;t go away.</p><ul><li><p><strong><mark data-color="#f4cccc" style="background-color: rgb(244, 204, 204); color: rgb(0, 0, 0);">It is addictive:</mark></strong> Once AI writes one transformation, you want it to write all of them.</p></li><li><p><strong><mark data-color="#f4cccc" style="background-color: rgb(244, 204, 204); color: rgb(0, 0, 0);">The risk of losing the skill</mark>:</strong> If I never code myself, the skill goes over time.</p></li><li><p><strong><mark data-color="#f4cccc" style="background-color: rgb(244, 204, 204); color: rgb(0, 0, 0);">I work more, not less</mark>:</strong> I thought AI would automate a lot of my work. But I found myself working more, because guiding the AI is real work, all day.</p></li></ul><p>No setup fixes these.</p><div><hr></div><h2><strong>AI does things I never asked for</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!dL96!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!dL96!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 424w, https://substackcdn.com/image/fetch/$s_!dL96!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 848w, https://substackcdn.com/image/fetch/$s_!dL96!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 1272w, https://substackcdn.com/image/fetch/$s_!dL96!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!dL96!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png" width="632" height="241.60833333333332" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1468,&quot;width&quot;:3840,&quot;resizeWidth&quot;:632,&quot;bytes&quot;:6284148,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b63823c-de96-474d-ab98-af125cfb14c2_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!dL96!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 424w, https://substackcdn.com/image/fetch/$s_!dL96!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 848w, https://substackcdn.com/image/fetch/$s_!dL96!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 1272w, https://substackcdn.com/image/fetch/$s_!dL96!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c9fe8b8-093b-40c4-b8db-ee809009b820_3840x1468.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>You tell AI to change one thing. You expect one file to change.</p><p>It changes that file and creates three new ones. And this is only the start.</p><p>After reviewing AI work, I found it many times doing things that were never in the plan.</p><ul><li><p><strong>It copies instead of reusing:</strong> I already have a function for that in the project. It writes a new one.</p></li><li><p><strong>It creates extra things:</strong> New files, new configs, new folders. Nobody asked for them.</p></li><li><p><strong>It changes files silently:</strong> It adjusts things that were never in the plan, and it does not tell you.</p></li><li><p><strong>It hides errors:</strong> Instead of fixing the bug, it makes the code stop failing. The bug is still there.</p></li><li><p><strong>It says done when it is not:</strong> It marks the task as finished. And when I ask, it defends the result.</p></li></ul><p>Every task leaves some junk behind. Junk is easy to add and hard to remove. Once it is in, you are scared to delete it, because nobody knows what depends on it.</p><p>After a few weeks, you have a brand new project, and it already feels like legacy code.</p><blockquote><p><em><strong>This is how the project explodes.</strong></em></p></blockquote><div><hr></div><h2><strong>AI codes, but it is not an engineer</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!9Ol_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!9Ol_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 424w, https://substackcdn.com/image/fetch/$s_!9Ol_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 848w, https://substackcdn.com/image/fetch/$s_!9Ol_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 1272w, https://substackcdn.com/image/fetch/$s_!9Ol_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!9Ol_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png" width="626" height="303.05572916666665" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1859,&quot;width&quot;:3840,&quot;resizeWidth&quot;:626,&quot;bytes&quot;:7334858,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3af3a35d-9cb7-4b56-bf55-97f2a0ce14cb_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!9Ol_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 424w, https://substackcdn.com/image/fetch/$s_!9Ol_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 848w, https://substackcdn.com/image/fetch/$s_!9Ol_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 1272w, https://substackcdn.com/image/fetch/$s_!9Ol_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0afa7d9-b973-4804-9407-b0d39d6d3e2d_3840x1859.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>AI does the job you tell it to do. Even when it does more, it is more of the task, never more for the project.</p><p>A real engineer sees the whole project. While working on a task, they notice what is wrong around it, even if it has nothing to do with the task.</p><p>And they don&#8217;t ask. They come with an opinion: this part will break in two months, these two pipelines should be one, here is how I would do it.</p><p>AI never does that. It never comes to you with an opinion on its own.</p><ul><li><p><strong>It never consolidates:</strong> The same logic ends up in three places. An engineer sees it and brings it together into one. AI never does that on its own. Ask it, and it does it very well, but it will never suggest it.</p></li><li><p><strong>It never protects the project:</strong> Whether the project explodes next month is not part of its task. It closes the task.</p></li><li><p><strong>It never brings new ideas on its own:</strong> Nothing out of the box, no innovation. It cannot think like a senior yet.</p></li></ul><p>You can push it so much. You can write it in the rules. Your AI agent will still just do the job, and never care about your project.</p><blockquote><p><em><strong>The project is not its problem. So it has to be yours.</strong></em></p></blockquote><div><hr></div><h2><strong>AI cannot beat the expert yet</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!otnS!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!otnS!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!otnS!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!otnS!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!otnS!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!otnS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png" width="616" height="346.5" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:616,&quot;bytes&quot;:5321109,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!otnS!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!otnS!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!otnS!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!otnS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecce67f8-1156-472d-9474-740b330c9a0b_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Now you might ask: it is faster than me in everything, so when does it beat me?</p><p>Here is the thing. AI learned coding from public projects and public data. But the real projects are never public.</p><p>No bank uploads its warehouse to GitHub. No car maker publishes its pipelines. What is public is mostly tutorials, demos and toy projects.</p><p>The expert learned the opposite way. I worked on more than ten industry projects. I built five warehouses and two lakehouses. Real requirements, real complexity, real people with different opinions.</p><p>AI never saw one real project from the inside. So when your project gets real, its suggestions stay at the tutorial level.</p><p>And I don&#8217;t see this gap closing soon, because two things would have to change.</p><p>Companies would have to let AI deep inside the real business. Most don&#8217;t, and won&#8217;t for years.</p><p>And the experts would have to write down what is in their heads: the decisions, the reasons, the lessons. Almost nobody does that.</p><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">It cannot learn what nobody ever wrote down.</mark></strong></em></p></blockquote><div><hr></div><h2><strong>Everyone sends me their AI code</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!nZC0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nZC0!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 424w, https://substackcdn.com/image/fetch/$s_!nZC0!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 848w, https://substackcdn.com/image/fetch/$s_!nZC0!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 1272w, https://substackcdn.com/image/fetch/$s_!nZC0!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!nZC0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png" width="628" height="293.884375" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1797,&quot;width&quot;:3840,&quot;resizeWidth&quot;:628,&quot;bytes&quot;:8357589,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F795f9055-e21b-422c-846a-d1f98f01470f_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!nZC0!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 424w, https://substackcdn.com/image/fetch/$s_!nZC0!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 848w, https://substackcdn.com/image/fetch/$s_!nZC0!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 1272w, https://substackcdn.com/image/fetch/$s_!nZC0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe04dbd8c-c62a-40f8-bf58-d4f6e40343bd_3840x1797.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>That was my own code. But there is a second problem.</p><p>I used to review the work of a whole team. And many of my colleagues leading projects today spend their days reviewing pull requests.</p><p>They have the same issue. Many developers generate work in seconds and send it for review: code changes, dashboards, scripts. Most of it was never read by the person who sent it.</p><p>The juniors do it the most. And I understand them, the button is right there.</p><p>Someone sends a code change of thousands of lines for a small feature. Or a dashboard built in one afternoon, and when it breaks, nobody knows what is inside.</p><p>The senior became the bottleneck of the whole team, not only of their own project.</p><p>And the answer is not to review faster. Nobody can.</p><p>The answer is the same rule I give the AI: a change I cannot review goes back to the person who sent it.</p><p>And one question decides it: explain your change to me. If they cannot, it does not get merged.</p><div><hr></div><h2><strong>Maybe your company does not allow it yet</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!N4Dn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!N4Dn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 424w, https://substackcdn.com/image/fetch/$s_!N4Dn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 848w, https://substackcdn.com/image/fetch/$s_!N4Dn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 1272w, https://substackcdn.com/image/fetch/$s_!N4Dn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!N4Dn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png" width="660" height="314.875" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1832,&quot;width&quot;:3840,&quot;resizeWidth&quot;:660,&quot;bytes&quot;:6304767,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81b85384-811b-43d3-aaaa-e67e2de79b1f_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!N4Dn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 424w, https://substackcdn.com/image/fetch/$s_!N4Dn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 848w, https://substackcdn.com/image/fetch/$s_!N4Dn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 1272w, https://substackcdn.com/image/fetch/$s_!N4Dn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09b4bf05-8c8e-4f85-a50c-2017ac54a702_3840x1832.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Everything I wrote here, I can do because nobody blocks me. I have full access, and the AI can work on the whole project.</p><p>Many of you don&#8217;t. In banks, in insurance, in big corporations, AI agents are still blocked. Security, legal and procurement all have to say yes.</p><p>I know that world. A new tool needs a year to get approved.</p><p>Autocomplete, yes. An agent that reads your whole project and runs commands, no.</p><p>So if you read this and think, nice for you, my company blocks all of it, I understand. But it is coming to you too, in a year, maybe two.</p><p>Use that time. Build the habit at home, on your own projects, with your own rules. But never paste company code into your private AI account.</p><p>When it arrives at work, you are the one who knows how to keep it under control.</p><div><hr></div><h2><strong>The rehab</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!7xhY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!7xhY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 424w, https://substackcdn.com/image/fetch/$s_!7xhY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 848w, https://substackcdn.com/image/fetch/$s_!7xhY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 1272w, https://substackcdn.com/image/fetch/$s_!7xhY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!7xhY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png" width="3840" height="1757" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1757,&quot;width&quot;:3840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:7659425,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc80bc23f-6997-4009-80fc-652b55fcfc34_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!7xhY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 424w, https://substackcdn.com/image/fetch/$s_!7xhY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 848w, https://substackcdn.com/image/fetch/$s_!7xhY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 1272w, https://substackcdn.com/image/fetch/$s_!7xhY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd77db202-9a1b-4353-a5e9-ef8b75714853_3840x1757.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>And me? Of all the costs, one worries me the most: the risk of losing the coding skill.</p><p>Because I see how it starts. I open a file to write something myself, and my brain pushes back: why bother? The AI writes it in seconds.</p><p>Today I still win that argument. I can write my code.</p><p>But this is exactly how a skill dies. Not in one day. A little bit, every time you press the button instead of typing.</p><p>So what is the solution? Some people quit AI completely. Cold turkey.</p><p>I don&#8217;t believe in that. And you know it already: there is no return back.</p><p>My solution is smaller, and it works like magic. One full day of work, without AI.</p><p>Not one chat, not one prompt. Like the old days.</p><p>On this day, I code small things with my own hands. I walk through the project and read functions the AI wrote.</p><p>I run some tests myself, and I chase a few issues on my own. And when a question comes up, I google it and read with my own eyes.</p><p>One day is not much. But it keeps the muscle alive, and it wins me the argument with my brain.</p><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">One full day, no AI. It works like magic.</mark></strong></em></p></blockquote><div><hr></div><h2><strong>The junior trap</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!GjFF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!GjFF!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 424w, https://substackcdn.com/image/fetch/$s_!GjFF!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 848w, https://substackcdn.com/image/fetch/$s_!GjFF!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 1272w, https://substackcdn.com/image/fetch/$s_!GjFF!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!GjFF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png" width="3840" height="1840" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1840,&quot;width&quot;:3840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:7615928,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4951118-c80e-4393-b17b-12bf86b7fb93_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!GjFF!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 424w, https://substackcdn.com/image/fetch/$s_!GjFF!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 848w, https://substackcdn.com/image/fetch/$s_!GjFF!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 1272w, https://substackcdn.com/image/fetch/$s_!GjFF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c30baa-faa3-494e-9eb0-898b35d0af29_3840x1840.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So far I talked about people who already have the job. But what about juniors and beginners?</p><p>Reading this, you might think: why should I learn to code, if the experts let AI do it? And every post out there says you don&#8217;t need coding anymore.</p><p>This is the trap.</p><h3>The hiring problem</h3><p>Companies don&#8217;t hire a data engineer who can only prompt AI to write Python.</p><p>They hire engineers who can write Python themselves, and use AI to speed up their work.</p><p>So if you skip the coding, you don&#8217;t get hired.</p><h3>Gut feeling and judgment</h3><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!K8XO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!K8XO!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 424w, https://substackcdn.com/image/fetch/$s_!K8XO!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 848w, https://substackcdn.com/image/fetch/$s_!K8XO!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 1272w, https://substackcdn.com/image/fetch/$s_!K8XO!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!K8XO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png" width="602" height="320.5963541666667" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2045,&quot;width&quot;:3840,&quot;resizeWidth&quot;:602,&quot;bytes&quot;:7402694,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/217105647?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92ace891-f569-443c-8080-a80737262bcd_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!K8XO!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 424w, https://substackcdn.com/image/fetch/$s_!K8XO!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 848w, https://substackcdn.com/image/fetch/$s_!K8XO!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 1272w, https://substackcdn.com/image/fetch/$s_!K8XO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdf1ab22-eabf-41dc-a6c2-7ca2cac9ef01_3840x2045.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I can let go of the coding because I did it for 17 years. If you are still learning, you cannot. Not yet.</p><p>If you jump to AI on day one and only copy, paste and run what it writes, you understand nothing.</p><p>You learn this job by getting it wrong a hundred times. If AI does the work for you, how do you ever build the gut feeling for what is wrong?</p><p>And later, how do you explain your own project, or understand why it is failing?</p><p>I am not saying ignore AI. The one who ignores it cannot write one single good prompt, and risks looking outdated.</p><p>So while you are learning:</p><ul><li><p><strong>Struggle first:</strong> Turn to AI only when you have no ideas left.</p></li><li><p><strong>Let AI explain, not solve:</strong> Ask it to explain a concept, never to solve the task for you.</p></li><li><p><strong>Learn the fundamentals:</strong> You still need SQL and Python, so you can tell when AI is wrong.</p></li></ul><blockquote><p><em><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">You code. You struggle. And AI reviews.</mark></strong></em></p></blockquote><div><hr></div><h2><strong>So &#8230;</strong></h2><p>So yes, I gave up the coding, and there is no return back. The costs are real, but I got more time for more projects and innovations.</p><p>And the question of the year, how do I keep it under control? Rules it cannot touch, a memory of its mistakes, and I review what matters.</p><p>My recommendation: use AI every day. And keep your one day without it.</p><p>Don&#8217;t take yourself out of the project. Review what is important. Your rules and your tests cover the rest.</p><p>And if you are still learning, do the hard part yourself first. AI comes after.</p><p>Thanks for reading </p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://youtu.be/kIk8tj0rbo0">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://youtu.be/pzvV5WS69tE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/qKXUPI06tZo">AI Engineering Roadmap</a><br></strong>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Will AI Replace You?]]></title><description><![CDATA[Everyone is asking it. My view after 17 years inside companies.]]></description><link>https://www.blog.datawithbaraa.com/p/will-ai-replace-you</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/will-ai-replace-you</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 22 Sep 2026 13:20:39 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/de862894-b11c-447a-ac0d-777420c70da0_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>Everyone is asking the same question right now: </p><blockquote><p><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">&#8220;will AI replace me?&#8221;</mark></strong></p></blockquote><p>And I see the fear in every comment on my channel. Everyone is panicking about it. I mean everyone: students, juniors, even experts.</p><p>I don&#8217;t know why, but I am totally happy that we have AI. So here are my thoughts. Sorry, this one is long, but I wanted to share it all with you.</p><p>Once we get past the fear, I am going to post more about AI and coding, and AI and data.</p><p>Let&#8217;s go :)</p><div><hr></div><h2><strong>The question is wrong</strong></h2><p>&#8220;Will AI replace the data analyst?&#8221; I think the whole question is wrong.</p><p>The better question is not &#8220;will AI replace my title&#8221;, it is &#8220;what happens to each task I do&#8221;.</p><p>Because the question looks only at the title. But in real companies we never work under one title.</p><p>You might find a data analyst who is more like a process expert, helping the business and giving advice all day. Or an engineer who helps the whole department, because they find the data problems and give amazing advice about the architecture.</p><p>To be honest, in many projects I ended up doing both roles.</p><p>Titles are never designed perfectly. We all do so many things at companies.</p><blockquote><p><em><strong>So when someone asks &#8220;will AI replace the data analyst&#8221;, I&#8217;m going to say: first tell me what this analyst really does all day.</strong></em></p></blockquote><div><hr></div><p>Btw Today I published Roadmap for AI Engineers and Forward Deployed Engineers based on 40.000 Job ads, I built machine to analyse the job market :)</p><div id="youtube2-qKXUPI06tZo" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;qKXUPI06tZo&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/qKXUPI06tZo?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h2><strong>The task list test</strong></h2><p>Here is a test that works for any job. You could be a doctor reading this, it is the same.</p><p><strong>Step 1: Make a list of what you really do.</strong> Not your job description, the real tasks: going to meetings, talking to people, writing code, answering questions, whatever it is.</p><p><strong>Step 2: Give each task one of three marks.</strong></p><ul><li><p><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">AI alone</mark>:</strong> It does it without me.</p></li><li><p><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">AI with me</mark>:</strong> I&#8217;m faster, but I still decide.</p></li><li><p><strong><mark data-color="#d9d2e9" style="background-color: rgb(217, 210, 233); color: rgb(0, 0, 0);">Not AI</mark>:</strong> It needs me.</p></li></ul><p><strong>Step 3: Count.</strong> If every task is &#8220;AI alone&#8221;, then yes, your job is replaceable.</p><p>If it is half, and the rest needs deep understanding of your company or your client, then good news. It will not replace your job.</p><p>And look at which half it is. If AI takes the routine end of your job, you become more valuable, because now you have time for the expert end.</p><p>If it takes the expert end, that is the bad news.</p><p>And the &#8220;AI with me&#8221; tasks stay yours. You just do them faster.</p><p>Now you might say, okay, but how do I know which mark a task gets? Four questions:</p><ul><li><p><strong>Do I have to talk to people to do it?</strong> Colleagues, clients, other teams. If yes, it is &#8220;Not AI&#8221;.</p></li><li><p><strong>Is everything it needs written down?</strong> If the knowledge is in people&#8217;s heads, AI cannot reach it. So if you want to fight AI, don&#8217;t write down your knowledge, keep it in your head &#128517;</p></li><li><p><strong>If it gets it wrong, will I notice?</strong> If a wrong result looks exactly like a right one, it is &#8220;AI with me&#8221; at best, never &#8220;AI alone&#8221;.</p></li><li><p><strong>Does someone have to answer for it?</strong> If a person has to put their name under the result, for the client, the auditor or the boss, it stays with a person. AI can write the report. It cannot sign it.</p></li></ul><div><hr></div><h2><strong>A quick example: my own job</strong></h2><p>Here is my own job as a data engineer, marked for today:</p><ul><li><p><strong>AI alone:</strong> Nothing yet.</p></li><li><p><strong>AI with me:</strong> Writing the transformation code, building pipelines, tests and documentation, monitoring.</p></li><li><p><strong>Not AI:</strong> Talking to the source experts, agreeing on data contracts, consulting the consumers of our data, the architecture, the data modeling, and the big incidents. It is never only fixing code.</p></li></ul><p>If you can only do coding and building pipelines, then yes, a big part of your work gets automated. But the last group is all about people, sources and decisions, and this is where we engineers spend most of our time.</p><blockquote><p><em><strong>So will AI take your job? It depends. And it depends on you.</strong></em></p></blockquote><div><hr></div><div class="callout-block" data-callout="true"><p><strong>Is analytics slowing down your PostgreSQL database?<br>Transactional databases aren&#8217;t designed to scan millions of rows every time someone opens a dashboard. Tinybird gives you the speed of ClickHouse without the operational overhead: stream in your data, write SQL, and publish low-latency APIs.<br>Start free with Tinybird: <a href="https://fandf.co/4cFUrCd">https://fandf.co/4cFUrCd</a> (sponsored by Tinybird)</strong></p></div><div><hr></div><h2><strong>What the job ads say</strong></h2><p>I checked almost 40,000 real job ads. Around <strong>20%</strong> of the analyst ads mention AI, and around <strong>25%</strong> of the engineer ads.</p><p>Still small, but it started.</p><p>And what do they ask? Look at the real sentences:</p><ul><li><p>&#8220;Use AI tools to accelerate analysis.&#8221;</p></li><li><p>&#8220;Automate recurring reporting workflows.&#8221;</p></li><li><p>&#8220;Build pipelines for retrieval-augmented generation.&#8221;</p></li></ul><p>Nobody is asking you to build AI. They ask you to be faster with it, and to build the data for it.</p><p>The new jobs say the same. AI data engineer, AI data analyst: the companies took the data jobs and put AI in front of the name.</p><p>Same core: Python, SQL, pipelines, data modeling. On top of it, LLMs, RAG and AI agents.</p><p><strong>AI sits on top of your job. It does not replace it.</strong> And companies started naming the tools: Claude, Claude Code, Copilot, Cursor.</p><blockquote><p><em><strong>If they ask analysts to use AI, they are not replacing analysts.</strong></em></p></blockquote><p>Nobody is going to fire you tomorrow because you don&#8217;t use AI. But the companies started writing it in the ads.</p><div><hr></div><h2><strong>But the company needs fewer of us, right?</strong></h2><p>Now you might say, okay Baraa, if I am twice as fast with AI, then the company needs half of us.</p><p>Think about data teams. We are usually small, and we cover only a small part of the company&#8217;s data.</p><p>So once AI makes us faster, the company has three options:</p><ul><li><p><strong>Reduce:</strong> Fewer people, the same small part of the data. You save cost, and nothing really improves.</p></li><li><p><strong>Keep:</strong> The same team, now fast, so it covers a larger part of the data.</p></li><li><p><strong>Expand:</strong> Grow the data team, because every AI project needs the data first.</p></li></ul><p>What I saw is the second and the third. For years the data team was the &#8220;nice to have&#8221; at companies, with the smallest budget.</p><p>Then every AI project came and said: I can do the AI use case for you. But I need half a year just to get the data.</p><p><strong>AI did not make us the extra. It made us the core.</strong></p><div><hr></div><h2><strong>Companies move very slowly</strong></h2><p>And you might still say: but my company is going to replace me with AI tomorrow anyway.</p><p>One thing you have to understand: it depends on the size. From what I see, mid-size to big companies are slow to adopt any new technique.</p><p>We don&#8217;t even need AI to see it:</p><ul><li><p><strong>The tools:</strong> We have the best tools in the world for data. Tableau, Power BI, Databricks, Snowflake, dbt.</p></li><li><p><strong>The reality:</strong> Companies still use Excel for critical reports. Many don&#8217;t even have a clean data warehouse.</p></li></ul><p>A company cannot change overnight and become AI-driven. <strong>It takes years</strong>: migrations, pipelines, governance, training.</p><p>So even though the tools exist, companies need years to really use them. With AI it is going to be the same.</p><div><hr></div><h2><strong>Why companies cut people</strong></h2><p>But companies are cutting down. Yes, true, but look at why.</p><p>It is mostly not because a project turned completely to AI. Many companies are suffering financially right now, and they are going to use <strong>whatever reason to cut headcount.</strong></p><blockquote><p><em><strong>Right now, that reason is AI.</strong></em></p></blockquote><p>And this is nothing new:</p><ul><li><p><strong>Before ChatGPT:</strong> Layoffs happened before it, and they are going to happen after. Budget cuts, company pivots, bad leadership.</p></li><li><p><strong>Sam Altman:</strong> Even the CEO of OpenAI agreed that some companies blame AI for layoffs they would do anyway. Some real replacement too, he said, but a lot of it is just blame.</p></li><li><p><strong>Klarna:</strong> They went very far with AI in customer service. Later their CEO said what you end up having is lower quality, and they started bringing humans back.</p></li></ul><div><hr></div><h2><strong>Why they are not hiring</strong></h2><p>Partly it is the same reason as the cuts, money. But here there is something new: companies are speculating.</p><p>They think they don&#8217;t need new people, because all the new projects can be handled with AI by the experts who are still inside.</p><ul><li><p><strong>Shopify</strong> made it a rule: &#8220;teams must demonstrate why they cannot get what they want done using AI.&#8221;</p></li><li><p><strong>Salesforce:</strong> Their CEO said they are not adding any software engineers in 2025, because AI made the teams more than <strong>30%</strong> more productive.</p></li></ul><p>About a year and a half later, the same CEO said about AI: <strong>&#8220;The model still cannot operate autonomously.&#8221;</strong></p><div><hr></div><h2><strong>What AI does not know</strong></h2><p>And here is the problem with that speculation. AI learned from public data, and it never saw the inside of a real company.</p><ul><li><p><strong>The code:</strong> Real data projects live inside companies, never public. Search GitHub for a real lakehouse, and what you find are toys.</p></li><li><p><strong>The knowledge:</strong> Most of it is not in documents. It is in the minds of people.</p></li></ul><p>From a lakehouse I built in one of those companies, I can tell you this. We spent about three years just connecting ten source systems, more than <strong>1,200</strong> tables, with years of business rules on top.</p><p>So <strong>AI never saw how a real company works from inside.</strong> Data systems hit a level of complexity that you cannot just build with a few prompts.</p><p>The real question is not &#8220;can AI write SQL&#8221;. The real question is: can AI understand the whole company?</p><div><hr></div><h2><strong>What happens when the experts leave</strong></h2><p>So let&#8217;s say the speculation works, and the experts inside carry everything with AI. Then we have a bigger issue, and this is the one that worries me most.</p><blockquote><p><em><strong>What happens when those experts leave the company?</strong></em></p></blockquote><p>Do those companies have juniors who practiced alongside them? No.</p><p>Nobody became a senior by reading about it. We all started with the small tasks, and we got them wrong again and again.</p><p><strong>You learn when data is lying by getting it wrong a hundred times.</strong></p><p>Those small tasks are exactly the ones AI does with us today. So if AI does all of this, how does the next engineer build that gut?</p><p>And companies look at the same tasks and say: <strong>okay, now we hire only seniors.</strong> They now expect juniors to be seniors already.</p><p>So where are the seniors of tomorrow going to come from?</p><div><hr></div><h2><strong>Why I think companies will come back</strong></h2><p>Well, I can only speculate here, I don&#8217;t know the future. But I think it is only a matter of time until companies go back to hiring juniors.</p><p>The Financial Times made a film about this. In it, the CEO of a hiring platform took law firms as his example.</p><p>With AI, he said, they can probably do maybe <strong>80%</strong> of what the junior lawyers do. And then came the important part:</p><blockquote><p><em><strong>&#8220;The average age in this law firm is 55, and so if you don&#8217;t hire people right now, the company will cease to exist in 15 years.&#8221;</strong></em></p></blockquote><p>I think this is the same for every team. Seniors leave, and somebody has to be ready.</p><p><strong>They are going to need them.</strong></p><p>And it already started. Remember Salesforce, the company that stopped hiring engineers?</p><p>In April 2026 the same CEO wrote: &#8220;We&#8217;re hiring 1,000 new grads &amp; interns right now to ride the AI exponential.&#8221;</p><div><hr></div><h2><strong>And the headlines?</strong></h2><p>So that is what I saw inside companies. Now compare it with social media.</p><p>A new headline every day, and most of them want you to panic: &#8220;AI is taking over!&#8221; &#8220;Developers getting replaced!&#8221; &#8220;Tech layoffs everywhere!&#8221;</p><p>Most of that is just <strong>noise</strong>, designed to trigger fear and get clicks. Before I believe one, I run three checks.</p><p><strong>Check 1: Who is talking, and what do they sell?</strong> Three groups, three stories:</p><ul><li><p><strong>The sellers</strong> say you are fine if you use AI. Jensen Huang of Nvidia: most people will lose their job &#8220;to somebody who uses AI&#8221;, not to AI itself.</p></li><li><p><strong>The buyers</strong> say they need fewer people. Andy Jassy of Amazon: &#8220;We will need fewer people doing some of the jobs that are being done today.&#8221;</p></li><li><p><strong>The measurers</strong> say it is small so far. Two researchers found no measurable effect on pay or hours in Denmark in the first two years after ChatGPT.</p></li></ul><p>Nvidia sells the chips. Amazon pays the salaries. The researchers sell nothing.</p><p><strong>Check 2: Do they give you a date?</strong> I saw people saying AI replaces tech jobs in 2026, and I thought: okay, let&#8217;s see.</p><p>Well, the year is almost over, and we are all still here.</p><p><strong>Check 3: Did they ever work inside a real company?</strong> Most of those people are either selling AI tools, or they never worked in one.</p><p>Inside, things are way more complex, and way slower.</p><p>Now to be fair, not everyone who warns is selling something. Geoffrey Hinton won the Turing Award for his work on AI, and he left Google with no product to sell.</p><p>He said: &#8220;We&#8217;re going to see it having the capabilities to replace many, many jobs.&#8221;</p><p>I take him seriously, and I am not going to tell you he is wrong about the technology. <strong>But the technology can be ready, and the company still is not.</strong></p><p>Even Sam Altman said it in May 2026: &#8220;I&#8217;m delighted to be wrong about this. I thought there would have been more impact on entry-level white-collar jobs being eliminated by now than has actually happened.&#8221;</p><p>Over the years you develop a feeling for what is hype and what is real. Until then, the three checks do the job.</p><div><hr></div><h2><strong>So &#8230;</strong></h2><p>So, will AI replace you? Most headlines say yes.</p><p>I say: it depends on you, and your company is slower than you think.</p><ul><li><p><strong>Your job:</strong> Take your list and ask what happens to each task. Do it this week, and again next year, because the marks change. Monitoring, for example, I expect to move to &#8220;AI alone&#8221;.</p></li><li><p><strong>Your company:</strong> It is slow, and that gives you time. But don&#8217;t sit back, because if you stop learning, AI is going to take your job.</p></li><li><p><strong>Your team:</strong> Faster does not mean smaller. Every AI project needs the data first, and we are the ones who prepare it.</p></li><li><p><strong>Inside a company:</strong> Be the one who understands the domain, the business and the data, not the fastest one to write SQL. That knowledge is what AI does not have, and for a company it is gold.</p></li><li><p><strong>Not inside yet:</strong> Push harder. Build projects, and learn to think like a senior.</p></li><li><p><strong>A few years in:</strong> AI is going to make you fast, and it can make you forget. Keep doing the hard tasks yourself.</p></li><li><p><strong>Already a senior:</strong> Understand the whole company, and prove the data is right. That is the human job.</p></li><li><p><strong>The headlines:</strong> Run the three checks before you panic.</p></li></ul><p>And for everyone: use AI every day. But understand what it gives you, don&#8217;t just copy and paste it.</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong></p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong></p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a></strong></p><p>&#128204; <strong><a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><p>Hey friends,</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.</p><p>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p><a href="http://bit.ly/3GiCVUE">Visit My Youtube Channel</a></p><p><a href="https://www.blog.datawithbaraa.com/subscribe?">Subscribe now</a></p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://youtu.be/kIk8tj0rbo0">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://youtu.be/pzvV5WS69tE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/qKXUPI06tZo">AI Engineering Roadmap</a><br></strong>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[The Mindset of Data Architect]]></title><description><![CDATA[The role, the money, the decisions you can't undo, and how to start thinking like one before you have the title]]></description><link>https://www.blog.datawithbaraa.com/p/the-mindset-of-data-architect</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/the-mindset-of-data-architect</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Mon, 24 Aug 2026 16:32:19 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!mzji!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Monday!</strong></p><p>The data architect is the role I loved most in my whole career, and it&#8217;s the one I almost never see explained honestly.</p><p>There&#8217;s no roadmap for it, no course that makes you one, and most of what&#8217;s written about it online is a vendor selling a platform.</p><p>That why I went last week talking about it and tomorrow continue where I will show you how to create Data Architecture Live!  &#128340; 17:00 Berlin </p><div id="youtube2-lTnr5k2fuoc" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;lTnr5k2fuoc&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/lTnr5k2fuoc?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h1><strong>Who Is the Data Architect?</strong></h1><p>Before a company builds anything big with data, someone has to make the plan.</p><p>That someone is the data architect, and the job works exactly like building a house:</p><ul><li><p><strong>Listen:</strong> sit with the business and understand what they really need.</p></li><li><p><strong>Draw:</strong> turn those needs into a blueprint, on paper, nothing built yet.</p></li><li><p><strong>Hand over and stay:</strong> give the plan to the engineers and mentor them until it works.</p></li></ul><p>That&#8217;s the job on paper. In reality you&#8217;ll do several jobs at once: I started at Mercedes-Benz as a solution architect and ended up designing, building, and leading projects at the same time.</p><blockquote><p><em>The architect doesn&#8217;t build the house. But if the wrong house gets built, that&#8217;s the architect&#8217;s mistake.</em></p></blockquote><div><hr></div><h1><strong>Architect or Engineer?</strong></h1><p>Right now some of you are thinking: I&#8217;m a data engineer, I already design my own pipelines, so am I not doing this already?</p><p>Careful, because the usual answer (&#8221;the engineer builds, the architect decides&#8221;) is wrong. Engineers decide all day.</p><p>The real line is which decisions:</p><ul><li><p><strong>The engineer</strong> makes a hundred decisions a day inside one pipeline.</p></li><li><p><strong>The architect</strong> owns the ten decisions a year that the company can&#8217;t easily undo: which platform, one copy of the data or many, batch or streaming, build or buy.</p></li></ul><p>And here&#8217;s the test I want you to keep, my friend. It&#8217;s the cleanest one I know:</p><p><strong>If reversing it needs a migration project, it was an architecture decision.</strong></p><p>The job ads say the same thing. I put the architect ads and the engineer ads side by side, concept by concept:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5l_F!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5l_F!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!5l_F!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!5l_F!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!5l_F!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5l_F!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!5l_F!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!5l_F!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!5l_F!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!5l_F!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a62cb3-ab97-4617-bd5a-73d7ce3ccc6f_1500x1000.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>Data pipelines</strong> is the number one concept in engineer ads at <strong>62%</strong>, and in architect ads it falls to place thirteen at <strong>25%</strong>. <strong>Data architecture</strong> runs the other way: <strong>71%</strong> for architects, <strong>23%</strong> for engineers.</p><blockquote><p><em>Same data, different job. The architect isn&#8217;t a senior engineer with a nicer title.</em></p></blockquote><div><hr></div><h1><strong>What the Job Ads Say</strong></h1><div id="youtube2-fBOtbNqgc0s" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;fBOtbNqgc0s&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/fBOtbNqgc0s?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>I didn&#8217;t want to guess what companies expect, so I analyzed <strong>14,600+</strong> real job ads.</p><p>Only <strong>364</strong> of them were hiring data architects.</p><p><strong>The skills</strong> are less exotic than you&#8217;d think:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!XmKa!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XmKa!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!XmKa!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!XmKa!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!XmKa!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!XmKa!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!XmKa!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!XmKa!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!XmKa!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!XmKa!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b99bfc-7e4e-4db8-8b28-2c285e9c5bd4_1500x1000.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>The tasks</strong> are where the job really shows its face. Design the architecture is 83%, and then it turns into governance and people:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!s1Pn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!s1Pn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!s1Pn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!s1Pn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!s1Pn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!s1Pn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!s1Pn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!s1Pn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!s1Pn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!s1Pn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b04989-a7fe-4ee8-8c60-ec3dcff3ab12_1500x1000.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>The experience</strong> is the wall. A median of <strong>7 years</strong>, and out of all 364 ads, exactly <strong>3</strong> were junior:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!jis3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!jis3!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!jis3!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!jis3!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!jis3!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!jis3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!jis3!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 424w, https://substackcdn.com/image/fetch/$s_!jis3!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 848w, https://substackcdn.com/image/fetch/$s_!jis3!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!jis3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a73d778-25f5-4342-b520-31277d1ab85f_1500x1000.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>To be honest with you: this is not a job you apply for. You grow into it, the same way you grow into being a manager.</p><p>Now you might tell me: &#8220;3 junior roles, so this is years away for me.&#8221;</p><p>Well, the title is years away. The thinking isn&#8217;t, and the last section of this post is about starting it this week.</p><div><hr></div><h1><strong>The 10 Architects You Don&#8217;t Want to Be</strong></h1><p>I met a lot of architects in my career, and the ones who failed usually failed the same way:</p><ul><li><p><strong>The tool guy:</strong> every discussion is Databricks vs Snowflake, never the actual problem. The company&#8217;s real pain never makes it into the room.</p></li><li><p><strong>The theory guy:</strong> they know every concept and never built one. You can&#8217;t plan a house you never helped build.</p></li><li><p><strong>The big spender:</strong> they plan like the company has endless money. The price reaches the manager, and the plan stops right there.</p></li><li><p><strong>The overkiller:</strong> they bring complexity because they like complexity. The company asked for a few reports and gets a data mesh.</p></li><li><p><strong>The talker:</strong> good ideas in every meeting, and not one of them on paper. A plan nobody can see is a plan nobody can follow.</p></li><li><p><strong>The diagram factory:</strong> 20 pictures, and they keep switching between them. Ask for the plan and you get a folder instead of an answer.</p></li><li><p><strong>The big banger:</strong> they design alone for weeks and reveal it at the end. That&#8217;s the meeting where the architecture dies, because everyone is seeing it for the first time with an audience.</p></li><li><p><strong>The baby defender:</strong> the design becomes theirs, so they defend it against the evidence. Changing it feels like losing.</p></li><li><p><strong>The stubborn one:</strong> the whole team struggles with the plan and they don&#8217;t move. Being right matters more to them than getting it built.</p></li><li><p><strong>The ghost:</strong> they present the plan and leave. The architect owns the plan until it&#8217;s built, and this one is already gone.</p></li></ul><p>And the one that costs the most: <strong>the exception becomes the standard</strong>. Let one team skip the rules just this once and by Friday three other teams quote it as precedent.</p><blockquote><p><em>Change the plan for everyone, or hold it for everyone. There&#8217;s no third door.</em></p></blockquote><div><hr></div><h1><strong>The Career Ladder</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Ho7j!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Ho7j!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 424w, https://substackcdn.com/image/fetch/$s_!Ho7j!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 848w, https://substackcdn.com/image/fetch/$s_!Ho7j!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 1272w, https://substackcdn.com/image/fetch/$s_!Ho7j!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Ho7j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png" width="1456" height="743" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/46c17914-9106-430d-8711-b97c49c16e90_1920x980.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:743,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!Ho7j!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 424w, https://substackcdn.com/image/fetch/$s_!Ho7j!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 848w, https://substackcdn.com/image/fetch/$s_!Ho7j!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 1272w, https://substackcdn.com/image/fetch/$s_!Ho7j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46c17914-9106-430d-8711-b97c49c16e90_1920x980.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>As a data engineer or analyst, you have three doors in front of you:</p><ul><li><p><strong>Management:</strong> team lead, department lead, and up. High ceiling, but you trade the tech for politics and people problems.</p></li><li><p><strong>Expert:</strong> senior engineer, senior analyst. You keep the tech, but senior is usually the last stop.</p></li><li><p><strong>Architect:</strong> the third door. You keep the tech, you skip managing people, and the ceiling opens all the way up.</p></li></ul><p>And the architect door has its own three levels:</p><ul><li><p><strong>Casual:</strong> you&#8217;re still building, and you also design the thing you build. Some of the best architectures I&#8217;ve seen came from an engineer who stepped up. This was me at the start.</p></li><li><p><strong>Dedicated:</strong> out of the single team. You turn department needs into blueprints, sign off other teams&#8217; designs, and stop two teams building the same thing twice.</p></li><li><p><strong>Principal:</strong> you turn the company&#8217;s data strategy into a target architecture, pick the platform, set the standards everyone reuses, and watch the total cost.</p></li></ul><p>Before I left Mercedes-Benz for content, principal was exactly the role I was targeting.</p><div><hr></div><h1><strong>Vendor Architecture vs Data Architecture</strong></h1><p>Google &#8220;data architecture&#8221; and you&#8217;ll get pages of diagrams packed with logos.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!STeW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!STeW!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 424w, https://substackcdn.com/image/fetch/$s_!STeW!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 848w, https://substackcdn.com/image/fetch/$s_!STeW!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!STeW!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!STeW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!STeW!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 424w, https://substackcdn.com/image/fetch/$s_!STeW!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 848w, https://substackcdn.com/image/fetch/$s_!STeW!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!STeW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff687a8c-4b28-4302-a3be-b37147bd233f_1920x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>My friends, that&#8217;s not a data architecture. That&#8217;s a <strong>vendor architecture</strong>: a company selling you their tools.</p><p>Draw one of those at work and they&#8217;ll throw it back at you. You&#8217;re not solving the company&#8217;s problem, you&#8217;re just another guy selling Microsoft products.</p><p>A real data architecture answers real questions:</p><ul><li><p>Where does the data come from, and where does it go?</p></li><li><p>What happens inside every box: full load or incremental? Batch or streaming? Which data model?</p></li><li><p>Who owns it, who may see it, how long we keep it, and what it costs.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!mzji!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!mzji!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 424w, https://substackcdn.com/image/fetch/$s_!mzji!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 848w, https://substackcdn.com/image/fetch/$s_!mzji!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 1272w, https://substackcdn.com/image/fetch/$s_!mzji!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!mzji!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png" width="1456" height="800" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:800,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!mzji!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 424w, https://substackcdn.com/image/fetch/$s_!mzji!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 848w, https://substackcdn.com/image/fetch/$s_!mzji!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 1272w, https://substackcdn.com/image/fetch/$s_!mzji!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71dffd35-4027-4364-92af-ec3ce7c421a3_1920x1055.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><blockquote><p><em>If your diagram only shows logos, it&#8217;s an ad, not an architecture.</em></p></blockquote><div><hr></div><h1><strong>How I&#8217;d Start in a New Company</strong></h1><p>If I got hired as a data architect tomorrow, this is exactly what I&#8217;d do.</p><p><strong>Phase one, I change nothing.</strong> No tools, no proposals, no criticism, no timelines. I&#8217;m here to understand first.</p><p><strong>Then I talk to everyone, in this order:</strong></p><ul><li><p><strong>The business first, IT second:</strong> what do they do, and why do they need data?</p></li><li><p><strong>The source owners:</strong> how is the data born, and who answers when it breaks?</p></li><li><p><strong>The engineers:</strong> what exists today, what are the pains, how long does a load take?</p></li><li><p><strong>The managers:</strong> where does the money come from?</p></li></ul><p><strong>Then I draw the current situation.</strong> The mess as it is, ugly and honest, on one page, plus the list of pain points.</p><p>That&#8217;s my first delivery, and it buys everything else, because most companies have never seen their own picture. Be careful here: no finger pointing, just the picture and the &#8220;because&#8221; behind every pain.</p><p><strong>Then quick wins</strong>, small fixes that buy trust, and only then the target architecture.</p><p><strong>Then I sell it before the meeting.</strong> Security alone first, then the loudest skeptic alone, then the sponsor last.</p><p>I&#8217;ve watched good architectures die in review, not because they were wrong, but because the security officer saw them for the first time with an audience.</p><p><strong>Then I stay</strong> and mentor the engineers through it, and when reality disagrees, the drawing changes. Mine lived for <strong>5 years</strong> and never stopped growing.</p><blockquote><p><em>You listen first, you draw second, and you stay until it works.</em></p></blockquote><div><hr></div><h1><strong>The Questions You Carry</strong></h1><p>Every box in a good architecture is the answer to one of these questions:</p><ul><li><p><strong>Where is the data born?</strong></p></li><li><p><strong>How fresh does it really need to be?</strong> What breaks if it&#8217;s a day late?</p></li><li><p><strong>Who consumes it,</strong> and with what skills?</p></li><li><p><strong>How big is it,</strong> today and in two years?</p></li><li><p><strong>Does it already exist</strong> somewhere in the company?</p></li></ul><p>The second one saves the most money. When the business says real time, never argue, just ask what they&#8217;d do differently if the number arrives at 9:05 instead of tomorrow at 8.</p><p>Silence means batch. A real answer, somebody gets paged, an order reroutes, means streaming, and now you also know what it&#8217;s worth.</p><p>And watch for requirements with a tool hiding inside them. &#8220;The data must be in a Kafka topic&#8221; is somebody&#8217;s favourite answer wearing a requirement&#8217;s clothes.</p><blockquote><p><em>A requirement tells you what and how well. The moment it names a tool, someone else already did your job, badly.</em></p></blockquote><div><hr></div><h1><strong>Start Before the Title</strong></h1><p>You don&#8217;t need the role to start, and this is the part I really want you to take:</p><ul><li><p><strong>Be the one who draws.</strong> In your next project, draw the picture nobody asked for: sources, layers, consumers. If a diagram already exists, draw your own anyway and bring it as a question, not a correction.</p></li><li><p><strong>Write down why.</strong> One page per decision: the options, your pick, the price, who agreed. The industry calls these decision records, and architect ads ask for them by name.</p></li><li><p><strong>Count the arrows.</strong> Every arrow between two teams is a promise: an owner on each end, a format, a timing, a bill, and a phone call at 3am when it stops flowing.</p></li><li><p><strong>Learn draw.io.</strong> Free, runs in the browser, and it&#8217;s what I saw companies actually use.</p></li></ul><p>Juniors count boxes. Architects count arrows.</p><blockquote><p><em>Diagrams show what you built. Decision records prove you can think. In the architect interview, they ask for your decisions, not your drawings.</em></p></blockquote><h1><strong>So &#8230;</strong></h1><p>If you keep only a few lines from this one, keep these:</p><ul><li><p>If reversing it needs a migration project, it was an architecture decision. That&#8217;s the whole job.</p></li><li><p>It&#8217;s not an entry job: median <strong>7 years</strong>, and 3 junior ads out of 364.</p></li><li><p>The path is wider, not higher. No authority, three yeses, paid for the mistakes you prevent.</p></li><li><p>Half of this job is politely not building things, because every box costs money forever.</p></li></ul><p>A data architect is the person who understands the business first, draws the plan second, and stays until it works.</p><p>Next time I&#8217;ll take you through the architectures themselves: the warehouse, the lake, the lakehouse, and why companies are now splitting everything into domains.</p><p>Hit reply and tell me which one you want first, I read everything.</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[We Go Live Tomorrow: Intro to Data Architecture]]></title><description><![CDATA[What a data architect really is, and how we design one live.]]></description><link>https://www.blog.datawithbaraa.com/p/we-go-live-tomorrow-intro-to-data</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/we-go-live-tomorrow-intro-to-data</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Mon, 17 Aug 2026 16:04:39 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/421cdc88-3ff7-4796-84e8-8bd110bf7c8b_1146x770.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Monday!</strong></p><p>I&#8217;m super happy to invite you to our <strong>LIVE on YouTube tomorrow</strong> &#127881;</p><blockquote><p><strong>Data Architecture</strong></p></blockquote><p><strong>Data Architect is one of my favorite roles I&#8217;ve had in my career.</strong></p><p>I did this job for years at Mercedes-Benz and other companies. Tomorrow, I&#8217;m going to share my experience with you, and we&#8217;re going to cover:</p><ul><li><p>What is Data Architecture?</p></li><li><p>The role + the real numbers from 14,600+ job ads</p></li><li><p>Technical and soft skills</p></li><li><p>The mindset of an architect</p></li><li><p>Cloud vs. System vs. Data Architects</p></li><li><p>Data Architecture concepts</p></li><li><p>My tips on how to become one</p></li></ul><p></p><p><span>&#128197; Tuesday, August 18</span><br><span>&#128340; 17:00 Berlin | 20:30 India</span></p><p><strong><a href="https://youtube.com/live/fBOtbNqgc0s">Set the reminder here</a></strong></p><div><hr></div><p>If you ever wondered how to keep growing in data without becoming a manager, this session is for you.</p><p>Set the reminder, grab a coffee, and see you tomorrow &#128075;</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[The Big Three: Databricks vs Snowflake vs Fabric]]></title><description><![CDATA[The real differences behind the scenes, and my honest pick]]></description><link>https://www.blog.datawithbaraa.com/p/the-big-three-databricks-vs-snowflake</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/the-big-three-databricks-vs-snowflake</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Wed, 29 Jul 2026 13:45:53 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/000cfa25-66bf-4102-bb25-9dd890c440bd_1179x803.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Wednesday!</strong></p><p>Databricks, Snowflake, and Microsoft Fabric.</p><p>Once you enter the data world, you hear these three names everywhere. Job posts. LinkedIn. Meetings. And if you are new, I totally understand that this topic is confusing.</p><blockquote><p><strong>What are these platforms? What is the difference between them? And which one should I learn?</strong></p></blockquote><p>Let&#8217;s go.</p><div id="youtube2-yPGEQ8vtuOw" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;yPGEQ8vtuOw&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/yPGEQ8vtuOw?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h1><strong>What is a data platform?</strong></h1><p>One central place where the whole data work happens:</p><ul><li><p><strong>Store</strong> the data in the cloud</p></li><li><p><strong>Clean and transform</strong> it with pipelines</p></li><li><p><strong>Analyze</strong> it with reports, dashboards, and AI</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xKfd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xKfd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 424w, https://substackcdn.com/image/fetch/$s_!xKfd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 848w, https://substackcdn.com/image/fetch/$s_!xKfd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 1272w, https://substackcdn.com/image/fetch/$s_!xKfd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xKfd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png" width="684" height="400.7440169645562" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1934,&quot;width&quot;:3301,&quot;resizeWidth&quot;:684,&quot;bytes&quot;:2955116,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/208975230?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9541b51a-17e4-4a1c-bca1-67084eb655e4_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xKfd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 424w, https://substackcdn.com/image/fetch/$s_!xKfd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 848w, https://substackcdn.com/image/fetch/$s_!xKfd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 1272w, https://substackcdn.com/image/fetch/$s_!xKfd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b40a6b1-61ca-4b12-9662-af1b2c1b6854_3301x1934.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Why companies pay for this? Because the alternative is chaos. Without one platform, every team buys its own tools. One for ETL, one for the database, one for orchestration, one for reporting. And good luck connecting all of that in one project. I have done exactly this more than seven times in different companies, and I can tell you, it was a nightmare. Data silos, repeated projects, shadow IT, and a very expensive way to work with data.</p><p>So this is the promise of all three: everyone in one place, one copy of the data, one source of truth.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!uvxD!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!uvxD!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 424w, https://substackcdn.com/image/fetch/$s_!uvxD!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 848w, https://substackcdn.com/image/fetch/$s_!uvxD!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 1272w, https://substackcdn.com/image/fetch/$s_!uvxD!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!uvxD!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png" width="678" height="338.19689391945246" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1895,&quot;width&quot;:3799,&quot;resizeWidth&quot;:678,&quot;bytes&quot;:2312621,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/208975230?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdedc2966-bd70-4fa6-b20b-d28566b49f7e_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!uvxD!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 424w, https://substackcdn.com/image/fetch/$s_!uvxD!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 848w, https://substackcdn.com/image/fetch/$s_!uvxD!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 1272w, https://substackcdn.com/image/fetch/$s_!uvxD!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa2b3cce-411b-4a96-8847-0e940c7fbf7c_3799x1895.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h1><strong>The origins explain everything</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!TU9R!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!TU9R!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 424w, https://substackcdn.com/image/fetch/$s_!TU9R!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 848w, https://substackcdn.com/image/fetch/$s_!TU9R!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 1272w, https://substackcdn.com/image/fetch/$s_!TU9R!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!TU9R!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp" width="1095" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1095,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:86920,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/webp&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/208975230?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!TU9R!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 424w, https://substackcdn.com/image/fetch/$s_!TU9R!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 848w, https://substackcdn.com/image/fetch/$s_!TU9R!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 1272w, https://substackcdn.com/image/fetch/$s_!TU9R!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65e6b123-2a6e-4ae3-b138-9387b55ba2e0_1095x802.webp 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong>Snowflake (2012):</strong> database engineers from </p><p>Oracle. People who love SQL and clean warehouses. So they rebuilt the data warehouse for the cloud. Simple, managed, SQL-first.</p></li><li><p><strong>Databricks (2013):</strong> the Berkeley researchers who created Apache Spark. People who love code and big data. A platform built by engineers, for engineers.</p></li><li><p><strong>Microsoft Fabric (end of 2023):</strong> the youngest one. Microsoft glued Power BI, Data Factory, and Synapse into one bundle, for companies that already live in the Microsoft world.</p></li></ul><p>And nobody here is small. Databricks is around <strong>$7 billion</strong> a year, growing around 80%. Snowflake is over <strong>$5 billion</strong>, growing around 30%. Fabric passed <strong>$2 billion</strong>, growing around 60%. One more detail people miss: Snowflake and Databricks are independent companies. Fabric is not a company. It is a product from Microsoft.</p><blockquote><p><strong>Keep this in your head:</strong> Snowflake is the SQL people. Databricks is the engineering people. Fabric is the Microsoft world.</p></blockquote><h1><strong>The differences</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!mUzm!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!mUzm!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!mUzm!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!mUzm!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!mUzm!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!mUzm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3641014,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/208975230?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!mUzm!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!mUzm!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!mUzm!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!mUzm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5fef882-6ebe-4c97-8a88-1d59ead1fda7_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3><strong>1. The cloud</strong></h3><p>Where the platform is allowed to run.</p><ul><li><p><strong>Databricks:</strong> any cloud. Azure, AWS, or Google.</p></li><li><p><strong>Snowflake:</strong> any cloud too. You pick one when you create the account.</p></li><li><p><strong>Fabric:</strong> Azure only.</p></li></ul><h3><strong>2. The storage</strong></h3><p>Where your data lives, and whether you can see the files.</p><ul><li><p><strong>Databricks:</strong> real files in your own storage, in the open <strong>Delta</strong> format, and any tool can read them. On top of the files you still get tables and SQL. That is the lakehouse.</p></li><li><p><strong>Snowflake:</strong> everything in Snowflake&#8217;s storage, in its own closed format. You see tables, never files. The classic warehouse. But they adapted: Iceberg, the other open format, is now supported too.</p></li><li><p><strong>Fabric:</strong> the whole company in <strong>OneLake</strong>, like OneDrive but for data. And the files inside are Delta, the exact format Databricks created.</p></li></ul><blockquote><p><strong>The pattern:</strong> everyone starts their own way, then adopts what works from the competitors.</p></blockquote><h3><strong>3. The compute</strong></h3><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yQ9g!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yQ9g!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 424w, https://substackcdn.com/image/fetch/$s_!yQ9g!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 848w, https://substackcdn.com/image/fetch/$s_!yQ9g!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 1272w, https://substackcdn.com/image/fetch/$s_!yQ9g!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yQ9g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp" width="662" height="372.375" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:662,&quot;bytes&quot;:84744,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/webp&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/208975230?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!yQ9g!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 424w, https://substackcdn.com/image/fetch/$s_!yQ9g!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 848w, https://substackcdn.com/image/fetch/$s_!yQ9g!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 1272w, https://substackcdn.com/image/fetch/$s_!yQ9g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe76a5911-bd95-4c41-b708-36bdffee896b_1456x819.webp 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>All three split your </p><p>work across many machines in the cloud. The real question: who manages those machines?</p><ul><li><p><strong>Databricks:</strong> the <strong>Spark</strong> engine, two ways to run it. Classic: machines in your own cloud account, you configure the clusters yourself (PaaS). Serverless: Databricks machines, few clicks, fully managed (SaaS). And serverless does not mean no servers. It means not your servers.</p></li><li><p><strong>Snowflake:</strong> their own SQL engine, built just for SQL. You pick a warehouse in t-shirt sizes and you never see a machine. Fully managed (SaaS).</p></li><li><p><strong>Fabric:</strong> not one engine, several: Spark, the Synapse SQL engine, and the Power BI engine, all on Microsoft machines. The most SaaS of the three.</p><p></p></li></ul><h3><strong>4. The bill</strong></h3><p>How each one charges you</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!amlK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!amlK!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 424w, https://substackcdn.com/image/fetch/$s_!amlK!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 848w, https://substackcdn.com/image/fetch/$s_!amlK!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 1272w, https://substackcdn.com/image/fetch/$s_!amlK!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!amlK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp" width="637" height="376.4519230769231" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:799,&quot;width&quot;:1352,&quot;resizeWidth&quot;:637,&quot;bytes&quot;:49458,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/webp&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/208975230?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!amlK!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 424w, https://substackcdn.com/image/fetch/$s_!amlK!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 848w, https://substackcdn.com/image/fetch/$s_!amlK!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 1272w, https://substackcdn.com/image/fetch/$s_!amlK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bd762b6-f469-40ee-b78e-343e8a3f8994_1352x799.webp 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong>Databricks:</strong> pay as you go. On the</p><p> classic cluster you get two bills, one from Databricks and one from your cloud for the machines. On serverless, one bill for everything.</p></li><li><p><strong>Snowflake:</strong> pay as you go, same model. You pay while things run. You stop, you stop paying. One bill from Snowflake.</p></li><li><p><strong>Fabric:</strong> a fixed subscription. You buy one capacity, all teams share it, and the price stays the same whether you use it or not.</p></li></ul><p>My opinion, after living with both models:</p><ul><li><p>Pay as you go sounds fair, but it opens the door for surprises. A warehouse running the whole day doing nothing. High-end compute on a tiny task.</p></li><li><p>And budgeting is the real pain. Estimating the whole year for your managers? Good luck with that.</p></li><li><p>The fixed model is way more friendly to plan. One price, no surprises.</p></li></ul><h3><strong>5. Streaming</strong></h3><p>Loading live data as it arrives.</p><ul><li><p><strong>Databricks:</strong> Spark Streaming and Delta Live Tables. The strongest of the three.</p></li><li><p><strong>Snowflake:</strong> Snowpipe and dynamic tables. A little bit simpler.</p></li><li><p><strong>Fabric:</strong> built-in event streams and the eventhouse.</p></li></ul><h3><strong>6. Orchestration</strong></h3><p>How you schedule and run your pipelines.</p><ul><li><p><strong>Databricks:</strong> pipelines and jobs, different ways inside the platform. Second place.</p></li><li><p><strong>Snowflake:</strong> tasks for scheduling. The weakest here, and in practice most teams bring Airflow or dbt from outside anyway.</p></li><li><p><strong>Fabric:</strong> a standalone tool for it, the famous <strong>Data Factory</strong>. The winner here.</p></li></ul><h3><strong>7. Governance</strong></h3><p>Who can see what data, and where the data actually goes.</p><ul><li><p><strong>Databricks:</strong> <strong>Unity Catalog</strong>, the strongest implementation. It is made for this.</p></li><li><p><strong>Snowflake:</strong> Horizon.</p></li><li><p><strong>Fabric:</strong> Purview.</p></li></ul><h3><strong>8. Machine learning and AI</strong></h3><p>All three added it, and the personalities show again.</p><ul><li><p><strong>Databricks:</strong> <strong>Mosaic AI</strong>. Build and train your own models, even AI agents. The strongest, no brainer.</p></li><li><p><strong>Snowflake:</strong> Cortex. AI directly inside your SQL, you ask your data questions right in the queries.</p></li><li><p><strong>Fabric:</strong> Copilot. The assistant everywhere in the Microsoft world.</p></li></ul><h3><strong>9. Dashboards</strong></h3><p>How the business sees all of this.</p><ul><li><p><strong>Databricks:</strong> somex built-in dashboards, but in real projects the business connects Power BI or Tableau on top.</p></li><li><p><strong>Snowflake:</strong> same story. Built-in components, and Power BI or Tableau for the real reporting.</p></li><li><p><strong>Fabric:</strong> the win. Power BI is the core of the family, there is nothing to connect.</p></li></ul><div><hr></div><h1><strong>Who actually picks each one</strong></h1><ul><li><p><strong>Databricks:</strong> companies with heavy engineering, big pipelines, streaming, machine learning and AI. But honestly, it is an overkill if you are a data analyst who just wants to work with SQL.</p></li><li><p><strong>Snowflake:</strong> analytics-first companies. Teams that speak SQL and want speed at scale without the engineering deep end.</p></li><li><p><strong>Fabric:</strong> Microsoft shops. One subscription, everything included, and the business already trusts Power BI. The price: you live fully in the Microsoft world.</p></li></ul><div><hr></div><h1><strong>Okay, which one should YOU learn?</strong></h1><p>Companies choose by context. You choose by background. But first, my rules, in order:</p><ul><li><p><strong>Foundations first.</strong> SQL and Python are the core of everything. Never start a platform before them. And the number one is SQL: as long as we have data, SQL will never die.</p></li><li><p><strong>Learn one, not three.</strong> Learning one platform makes the second one really easy. It is like programming languages, the second language is always faster.</p></li><li><p><strong>The job asks for a different one? Apply anyway.</strong> This happens all the time in tech. Nobody learns everything. Show them you understand the concepts, and the switch is fast.</p></li></ul><p>And now the honest answer, by background:</p><ul><li><p>You come from <strong>Power BI</strong>? Go Fabric. You expand from a tool into a platform, inside the same world.</p></li><li><p>You are a <strong>SQL</strong> person and you do not want to go deep into coding? Go Snowflake. You stay in your world.</p></li><li><p>You want the <strong>engineering deep end</strong>, the pipelines, the ML and AI? Go Databricks.</p></li></ul><p>And if you are at zero and you ask me what I would learn today? My heart goes with <strong>Databricks</strong>, and this one is a little bit personal. If time goes back and I am a student again, I would go with Databricks because of the <strong>free account</strong>. I can experiment and build a lot of projects without paying as I go. And the second reason: inside one platform, I can move between data analytics, data engineering, AI engineering, and data science without switching tools. Deep in one role, small things left and right. That is exactly what many jobs are asking for today. And of course, the growth: around 80% a year.</p><div><hr></div><h1><strong>So &#8230;</strong></h1><p>The full picture in five lines:</p><ul><li><p>Behind the scenes, all three are the same heart: cloud, distributed engines, SQL and Python.</p></li><li><p>The personalities never change: the SQL people, the engineering people, the Microsoft world.</p></li><li><p>The real differences: who manages the machines, who sees the files, and how you pay.</p></li><li><p>Foundations first. Then ONE platform, picked by your background.</p></li><li><p>You are choosing your first platform, not your last one. The skills transfer.</p></li></ul><p>Hit reply and tell me which one you are picking, I read everything. And if you are searching for a job right now, I really hope you land one soon.</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Where Should Your Calculations/Transformations Live?]]></title><description><![CDATA[One simple rule I followed in every data project, from warehouses to Power BI.]]></description><link>https://www.blog.datawithbaraa.com/p/where-should-your-calculationstransformations</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/where-should-your-calculationstransformations</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 28 Jul 2026 13:37:31 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/iFEabYvCCLc" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p><span>Here is a pain almost every data project has </span><strong>calculations are everywhere!</strong></p><p>Some logic lives in SQL. Some in the pipeline. Some in Power Query, some in DAX, and some in an Excel sheet nobody talks about. Every tool in the chain can calculate, so every tool does. Nobody planned it. Each calculation just landed in whatever tool was open at that moment.</p><p>And then a number looks wrong, and the hunt begins. Where is this thing even computed? You find it in three places. With three different formulas.</p><p>The fix is not a tool. It is one rule:</p><blockquote><p>&#127919; <strong>The golden rule:</strong> Calculate as early as you can, as close to the source as possible. And calculate on the fly only what must react to the user, as close to the report as possible.</p></blockquote><div id="youtube2-iFEabYvCCLc" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;iFEabYvCCLc&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/iFEabYvCCLc?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h2><strong>Why early wins</strong></h2><p></p><p><strong>#1: Reusability.</strong> Watch what happens to the same calculation as you push it back:</p><ul><li><p>In a <strong>visual</strong>, it serves one visual.</p></li><li><p>In a <strong>measure</strong>, it serves one data model.</p></li><li><p>In <strong>Power Query</strong>, it serves one file.</p></li><li><p>In a <strong>SQL view</strong>, it serves every report, every tool, every team.</p></li></ul><p>The further back you push it, the more people inherit it for free. Find a bug? You fix it once, and everything downstream gets the fix.</p><blockquote><p>The earlier a calculation lives, the more people it serves.</p></blockquote><p><strong>#2: Stronger tools.</strong> To be honest, for heavy transformations, SQL and Python are simply stronger than Power Query and DAX. Full languages, easy to test, easy to reuse, and your whole team can read them.</p><p><strong>#3: Performance.</strong> An early calculation runs once at refresh. A late calculation runs for every user, on every click, all day long. Why pay a thousand times for something you could pay for once?</p><p><strong>#4: One version of the truth.</strong> Logic that lives inside one report gets reinvented in the next one. Two slightly different formulas, and the same KPI shows two different numbers. And when users see different numbers, they stop trusting the whole project. And then they go back to Excel.</p><p>In the lakehouse I led at Mercedes-Benz, this was the whole game. We built the business logic once, inside the platform, and more than 40 analytics and AI teams consumed it from there. Now imagine every team calculating revenue on their own. Forty teams, forty versions of revenue.</p><div><hr></div><h2><strong>The magic of this rule</strong></h2><p>And here is the part I really love. Once you know this rule, you start seeing it everywhere, because half of the data world was invented just to follow it.</p><ul><li><p><strong>Why do companies build data warehouses at all?</strong> This rule. Prepare the data once, in one central place, and every project consumes it.</p></li><li><p><strong>Why do lakehouses have silver and gold layers?</strong> Same rule. Clean once, build the business logic once, and everyone downstream inherits it.</p></li><li><p><strong>Materialized views, OLAP cubes, aggregation tables?</strong> All the same trick. Pay for the calculation once, early, instead of on every single query.</p></li><li><p><strong>Feature stores in machine learning?</strong> Calculate the features once, and every model consumes them.</p></li></ul><div><hr></div><h2><strong>So my Friends&#8230;</strong></h2><p>Prepare early, once, close to the source. React late, live, close to the user. That is the whole rule.</p><p>We just opened the DAX chapter of the Power BI course with exactly this idea, explained step by step with the sketches.</p><p>And if you made it this far, you&#8217;re already one of the good ones.</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[My Full Power BI Data Modeling Course is Here (100% Free)]]></title><description><![CDATA[Over 5 hours, from the star schema all the way to a full hands-on project. All on YouTube, all free.]]></description><link>https://www.blog.datawithbaraa.com/p/my-full-power-bi-data-modeling-course</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/my-full-power-bi-data-modeling-course</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Wed, 15 Jul 2026 13:13:24 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/pQSMbRA3O6g" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>I have been waiting to type these words for a while, and today is the day:</p><p>&#127881; <strong>The full Data Modeling course for Power BI is now LIVE and 100% free!</strong> &#127881;</p><p>Over 5 hours, from the very first &#8220;what is a data model&#8221; all the way to a full hands-on project. All on YouTube.</p><div id="youtube2-pQSMbRA3O6g" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;pQSMbRA3O6g&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/pQSMbRA3O6g?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h3><strong>To Be Honest With You</strong></h3><p>While I was building this course, I could not find anything like it on YouTube. The few paid courses that come close to this quality are charging around <strong>$500</strong>.</p><p>And I understand why. Data modeling is not something you can just read about and then teach. It only comes from working on real projects in real companies.</p><p>I could have easily put a price on it. But I still remember how it felt to want to learn something and not be able to pay hundreds of dollars for it. So just like my SQL, Python and Power BI courses, this one is yours, for free.</p><blockquote><p>This is the most important chapter in the whole Power BI. I got invited many times to save Power BI projects that were failing and giving wrong numbers, and almost every time it was the same mistake. They skipped the data modeling.</p></blockquote><p>And if you know me, you know I teach visually. Every concept is drawn by hand so the ideas actually stick.</p><div><hr></div><h3><strong>&#128214; What&#8217;s Inside</strong></h3><ul><li><p><strong>Why Data Modeling</strong> matters</p></li><li><p><strong>Tables and Schemas</strong>: facts, dimensions, star, snowflake, galaxy</p></li><li><p><strong>Relationships</strong>: cardinality, filter direction, active vs inactive</p></li><li><p><strong>Special Dimensions</strong>: junk and role-playing</p></li><li><p><strong>Fact Tables</strong>: the grain, multiple facts, the bridge</p></li><li><p><strong>Row-Level Security</strong> (RLS)</p></li><li><p><strong>The Nightmare Project</strong>: a full hands-on rebuild, end to end</p></li><li><p><strong>Golden Rules</strong> recap</p></li></ul><div><hr></div><h3><strong>Two Tips From Me</strong></h3><p><strong>1. Learn it well.</strong> Data modeling is one of the most asked topics in data interviews. Master this course and you can handle almost any modeling question they throw at you.</p><p><strong>2. Do the final project.</strong> We take a messy 23-table model and rebuild it into a clean star schema, step by step, exactly like I do at real work. It is yours. Build it, and put it in your portfolio. If you share your success on LinkedIn, a little credit would be awesome. :</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IH1L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IH1L!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 424w, https://substackcdn.com/image/fetch/$s_!IH1L!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 848w, https://substackcdn.com/image/fetch/$s_!IH1L!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 1272w, https://substackcdn.com/image/fetch/$s_!IH1L!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!IH1L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:108176,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/webp&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/207151492?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!IH1L!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 424w, https://substackcdn.com/image/fetch/$s_!IH1L!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 848w, https://substackcdn.com/image/fetch/$s_!IH1L!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 1272w, https://substackcdn.com/image/fetch/$s_!IH1L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F610e840d-c0a3-4ebf-92b2-6e999bbc543e_1456x819.webp 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>)</p><p>That is it for today. Go build something clean.</p><p><strong>Baraa</strong></p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[The Nightmare Data Model Project is Live!]]></title><description><![CDATA[Hey friends, Happy Tuesday!]]></description><link>https://www.blog.datawithbaraa.com/p/the-nightmare-data-model-project</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/the-nightmare-data-model-project</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 07 Jul 2026 14:59:28 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/54c7efe0-f588-4343-a3a0-cdbb728abfb4_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>Big news today:</p><p>&#127881; <strong>My new Power BI Data Modeling Project is LIVE!</strong> &#127881;</p><p>A complete data modeling project, built exactly like I do in my real projects. We take a nightmare dataset and turn it, step by step, into a clean star schema. Completely free.</p><div id="youtube2-0A2k62YEbfI" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;0A2k62YEbfI&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/0A2k62YEbfI?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>And by the way, it happened to me again with this one. Somewhere in the middle, I forgot the camera completely and started talking to you like my colleague, fixing a real problem at a real company. Same story with the SQL data warehouse and the Tableau dashboards:</p><blockquote><p>&#8220;For a while, I thought that I&#8217;m working at the company. I&#8217;m not recording a video and I&#8217;m talking to a colleague.&#8221;</p></blockquote><p>Yes, I actually said that on camera. &#128517;</p><h1><strong>The nightmare dataset</strong></h1><p>I refused to hand you a clean tutorial dataset. Instead, I collected the ugly scenarios from my real projects and packed them all into one dataset:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!EURC!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!EURC!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 424w, https://substackcdn.com/image/fetch/$s_!EURC!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 848w, https://substackcdn.com/image/fetch/$s_!EURC!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 1272w, https://substackcdn.com/image/fetch/$s_!EURC!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!EURC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png" width="1332" height="821" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:821,&quot;width&quot;:1332,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:272360,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/205776904?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b018598-6e5b-4972-a94f-01edc026c355_1404x908.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!EURC!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 424w, https://substackcdn.com/image/fetch/$s_!EURC!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 848w, https://substackcdn.com/image/fetch/$s_!EURC!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 1272w, https://substackcdn.com/image/fetch/$s_!EURC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcadb628e-7ea3-4e7a-a76d-9008129884f8_1332x821.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p>23 tables dumped into a stage, and nothing else</p></li><li><p>Bad shapes, bad relationships, a data model that looks like a spider web</p></li><li><p>A test customer (999) somebody left behind in the data</p></li><li><p>Customer data scattered across six different tables</p></li><li><p>Duplicate products with different codes, quietly waiting to break your numbers</p></li></ul><p>Why so mean? Because there is a high chance that when you join a company, you will open a Power BI project that looks exactly like this. This dataset is my way of preparing you for that moment.</p><p>And we clean all of it together. For each step, you pause the video, you do it at your end, and then we continue. From 23 chaotic tables to a healthy star schema. Honestly, with this many facts, it is more like a galaxy.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!4VfA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!4VfA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 424w, https://substackcdn.com/image/fetch/$s_!4VfA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 848w, https://substackcdn.com/image/fetch/$s_!4VfA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 1272w, https://substackcdn.com/image/fetch/$s_!4VfA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!4VfA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png" width="1366" height="795" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:795,&quot;width&quot;:1366,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:183080,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/205776904?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd05c619b-54f0-4c04-832b-e2bcde7c8a7d_1424x824.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!4VfA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 424w, https://substackcdn.com/image/fetch/$s_!4VfA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 848w, https://substackcdn.com/image/fetch/$s_!4VfA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 1272w, https://substackcdn.com/image/fetch/$s_!4VfA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a61791-e870-48e1-8836-72ec5f5c1cb9_1366x795.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h1><strong>The skill everyone skips</strong></h1><p>In my previous roles, I was involved in many Power BI projects that struggled badly. Slow refreshes. Slow reports. And worst of all, wrong numbers.</p><p>And after investigating, it was almost never the dashboard. Almost each time, it was the bad model underneath the reports.</p><p>The thing is, most people skip data modeling completely. They connect the tables somehow, jump straight to the visuals, and hope for the best. It works for the demo. Then the project grows, the numbers stop matching, and people stop trusting the whole thing. I have seen projects die exactly like this.</p><p>Across all my years in data, I met only a few people who can turn a chaos model into a clean one. That is why this skill is going to make you stand out of the crowd.</p><h1><strong>The rules I want you to keep</strong></h1><p>The project is full of lessons, but if you only remember five things:</p><ul><li><p> <strong>Never connect two facts directly</strong>, always put a shared dimension between them.</p></li><li><p><strong>Protect the number.</strong> Put your total sales in a card and know it by heart. Everything you merge into the fact must land on exactly that same number. Mine jumped in the middle of the project (duplicate products), and I caught it in minutes instead of shipping wrong numbers for months.</p></li><li><p><strong>Every column must earn its place.</strong> One single point of truth for each info. In one project we dropped the hash keys from every table and saved around 20% of the dataset. Never be the person who leaves things &#8220;just in case&#8221;.</p></li><li><p><strong>Don&#8217;t trust until you test.</strong> We lock the model with row-level security, then open the report as Nora and check she only sees North America.</p></li></ul><h1><strong>So &#8230;</strong></h1><p>If you build this model with me until the end, make it your portfolio project. Share it in LinkedIn, and tag me if you want. And when you get interviewed, talk about this project. This skill is rare.</p><p>The next time a spider web data model is staring back at you, you will not panic. You are going to look at it and smile.</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[AI Agents Explained: I handed my worst morning job to AI]]></title><description><![CDATA[I built a team of Claude agents to check my emails for me.]]></description><link>https://www.blog.datawithbaraa.com/p/ai-agents-explained-i-handed-my-worst</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/ai-agents-explained-i-handed-my-worst</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Wed, 01 Jul 2026 18:45:51 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/GJH2fax3990" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>Let me be honest with you. Most people are stuck in the first phase of AI. You open Claude or ChatGPT, ask a question, get an answer, and that is it.</p><p>And the moment you try to go one step deeper, you hit a wall of scary words.</p><blockquote><p>AI agents. Sub-agents. LLM. MCP. Context engineering. Loop engineering. Skills. ReAct.</p></blockquote><div id="youtube2-GJH2fax3990" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;GJH2fax3990&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/GJH2fax3990?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>These words scare people. They stop them from ever reaching the real power of AI.</p><p>I am going to take one boring thing I do every morning and hand it to the AI, one step at a time. Every step needs one new idea, and that idea is the scary word. So the buzzwords are not the topic. Each one is just the tool that unlocked one more step.</p><div><hr></div><h1><strong>The task: my morning emails, all by hand</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xreb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xreb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 424w, https://substackcdn.com/image/fetch/$s_!xreb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 848w, https://substackcdn.com/image/fetch/$s_!xreb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 1272w, https://substackcdn.com/image/fetch/$s_!xreb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xreb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png" width="3840" height="1166" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1166,&quot;width&quot;:3840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2602166,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2e9a4e1-25e0-45b3-9d7d-6d18bea88435_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xreb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 424w, https://substackcdn.com/image/fetch/$s_!xreb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 848w, https://substackcdn.com/image/fetch/$s_!xreb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 1272w, https://substackcdn.com/image/fetch/$s_!xreb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fad5d0b-d709-4972-9e63-b487e8382fce_3840x1166.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Every morning after making my coffee, I open my inbox and hunt for sponsor offers. I am a content creator now, and this is real money for the channel.</p><p>But not every offer is real. I get a lot of fake AI sponsors from websites created like last week. So before I reply, I run the same little investigation every time:</p><ul><li><p>Read the offer.</p></li><li><p>Check if the company is even real, and look at their website.</p></li><li><p>Check if my name is spelled right.</p></li><li><p>Look up the person on LinkedIn.</p></li><li><p>Then decide, reply or skip. If it is real, write a clean reply and send.</p></li></ul><p>Then the next one, and again, and again. At the start I got two or three a day. Now I get around 200 emails a day, and this eats about half an hour every morning.</p><p>And here is the thing. It is really boring. Some days I skip it, and then I either drown the next day, or I miss a real sponsor and lose it.</p><blockquote><p><strong>If you repeat the same judgment every morning, that is exactly the task to hand to AI.</strong></p></blockquote><div><hr></div><h1><strong>Let the AI write the reply</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ybx_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ybx_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 424w, https://substackcdn.com/image/fetch/$s_!ybx_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 848w, https://substackcdn.com/image/fetch/$s_!ybx_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 1272w, https://substackcdn.com/image/fetch/$s_!ybx_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ybx_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png" width="1456" height="505" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:505,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1912148,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ybx_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 424w, https://substackcdn.com/image/fetch/$s_!ybx_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 848w, https://substackcdn.com/image/fetch/$s_!ybx_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 1272w, https://substackcdn.com/image/fetch/$s_!ybx_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5f0c02d-6b0f-461d-a099-bbb6027a2d66_3708x1286.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So I pick the easiest step first, the writing.</p><p>I copy the sponsor email, drop it into Claude, and ask for a reply. Behind that chat window is an LLM, a large language model. It read a massive amount of public text, books, websites, code, to do one thing: predict the next word. That is why it is so good at a first draft.</p><p>But the draft is never perfect. So I push back, make it shorter, friendlier, then copy it back into Gmail, do the last touch, and send. One step is off my plate, but I am still the middleman copying between two windows.</p><blockquote><p>A chatbot can write for you. It cannot yet work for you.</p></blockquote><div><hr></div><blockquote><p><span>AI is reshaping analytics engineering, but organizations continue to face challenges around trust, governance, and cost management. Drawing on insights from hundreds of analytics and data professionals, this report examines the trends, priorities, and practices defining the next generation of data teams.</span><a href="https://fandf.co/4eLYptf"><span> </span></a><strong><a href="https://fandf.co/4eLYptf"><span>Read the dbt Labs report</span></a></strong></p></blockquote><div><hr></div><h1><strong>The research that eats my morning</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!4HpZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!4HpZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 424w, https://substackcdn.com/image/fetch/$s_!4HpZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 848w, https://substackcdn.com/image/fetch/$s_!4HpZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 1272w, https://substackcdn.com/image/fetch/$s_!4HpZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!4HpZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png" width="1456" height="543" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:543,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2139098,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!4HpZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 424w, https://substackcdn.com/image/fetch/$s_!4HpZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 848w, https://substackcdn.com/image/fetch/$s_!4HpZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 1272w, https://substackcdn.com/image/fetch/$s_!4HpZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96993c85-7595-4fbf-97e4-a4868dd164c3_3738x1394.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The real time sink is not the writing. It is the research. Googling the company, checking LinkedIn, opening their website.</p><p>So I ask the AI instead. Do you know this company? Are they legit? For an old, well known company I get a good answer. But for one that started two weeks ago, the AI answers with full confidence and it is completely wrong. You google it yourself, get a different story, and this is the moment people say the AI is lying.</p><p>But it is not lying. This is a hallucination, when the AI sounds completely confident but is wrong. It has no intent, it just fills the gap with a guess. And there is a reason for the gap. Every model has a knowledge cutoff, it only learned up to a certain date, so a website made last week does not exist for it.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!O5MN!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!O5MN!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 424w, https://substackcdn.com/image/fetch/$s_!O5MN!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 848w, https://substackcdn.com/image/fetch/$s_!O5MN!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 1272w, https://substackcdn.com/image/fetch/$s_!O5MN!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!O5MN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png" width="558" height="278.51937984496124" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1159,&quot;width&quot;:2322,&quot;resizeWidth&quot;:558,&quot;bytes&quot;:3219677,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00aa5449-5d4b-4ddd-83c7-d82495a5d4a9_2322x1502.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!O5MN!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 424w, https://substackcdn.com/image/fetch/$s_!O5MN!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 848w, https://substackcdn.com/image/fetch/$s_!O5MN!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 1272w, https://substackcdn.com/image/fetch/$s_!O5MN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F770b121a-2b88-4dd0-aef9-cf2aaa64204c_2322x1159.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So how do we fix this? We give the model tools. A tool lets the AI do something outside its own head, and the famous one is web search. Now it has hands.</p><ul><li><p>Without tools, the AI guesses from old memory.</p></li><li><p>With tools, it reads the real website, checks the domain age, and comes back with facts.</p></li></ul><blockquote><p>The AI is not smarter because it sounds confident. It is smarter when it can go and check.</p></blockquote><div><hr></div><h1><strong>Let it into my inbox</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6MSD!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6MSD!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 424w, https://substackcdn.com/image/fetch/$s_!6MSD!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 848w, https://substackcdn.com/image/fetch/$s_!6MSD!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 1272w, https://substackcdn.com/image/fetch/$s_!6MSD!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!6MSD!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png" width="1456" height="549" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:549,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2199762,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!6MSD!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 424w, https://substackcdn.com/image/fetch/$s_!6MSD!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 848w, https://substackcdn.com/image/fetch/$s_!6MSD!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 1272w, https://substackcdn.com/image/fetch/$s_!6MSD!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f1d7206-90db-4b09-a9c0-5d2a173ba450_3762x1418.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Now the AI can write and research. But I am still the delivery person, carrying text between Gmail and the chat, one email at a time. With hundreds of emails, that is painful.</p><p>So I give it real access to my inbox. And this is exactly where people freeze. No way. I am not letting AI walk into my emails. It might send junk in my name, or delete something important.</p><p>I understand that fear completely. But it is not as scary as you think, because of one word: control.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PinW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PinW!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 424w, https://substackcdn.com/image/fetch/$s_!PinW!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 848w, https://substackcdn.com/image/fetch/$s_!PinW!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 1272w, https://substackcdn.com/image/fetch/$s_!PinW!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!PinW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png" width="545" height="314.28333333333336" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1384,&quot;width&quot;:2400,&quot;resizeWidth&quot;:545,&quot;bytes&quot;:3720400,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865820da-4f03-4f3c-a2a8-2e3cc576feae_2400x1630.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PinW!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 424w, https://substackcdn.com/image/fetch/$s_!PinW!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 848w, https://substackcdn.com/image/fetch/$s_!PinW!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 1272w, https://substackcdn.com/image/fetch/$s_!PinW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95e1f744-c19e-416e-b577-c0a7a00e18c2_2400x1384.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The AI connects to your apps through MCP, the Model Context Protocol. Think of it like USB-C for AI, one safe standard connector. And here is the part that matters. The model never touches your inbox. It only sends a request, and your app decides if that request is allowed:</p><ul><li><p>Read only if you are nervous.</p></li><li><p>Read and draft, but never send.</p></li><li><p>Block delete completely.</p></li><li><p>Keep the final Send button for yourself.</p></li></ul><p>If the model tries to delete and you only allowed reading, Google says no. Once it is connected, I hand it the whole routine in one prompt: open the latest emails, keep the sponsors, research each one, summarize, draft a reply, next. That fixed list of steps has a name, a workflow. No decisions yet, just a recipe it runs end to end.</p><blockquote><p>Connecting AI to your apps is not giving up control. It is defining control clearly.</p></blockquote><div><hr></div><h1><strong>The moment it becomes an agent</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!oyCB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!oyCB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 424w, https://substackcdn.com/image/fetch/$s_!oyCB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 848w, https://substackcdn.com/image/fetch/$s_!oyCB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 1272w, https://substackcdn.com/image/fetch/$s_!oyCB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!oyCB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png" width="728" height="270.5" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:541,&quot;width&quot;:1456,&quot;resizeWidth&quot;:728,&quot;bytes&quot;:2112347,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!oyCB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 424w, https://substackcdn.com/image/fetch/$s_!oyCB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 848w, https://substackcdn.com/image/fetch/$s_!oyCB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 1272w, https://substackcdn.com/image/fetch/$s_!oyCB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4629353e-794e-405c-89ea-f05b1f9649d0_3760x1396.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Now the workflow gives me a summary and a draft for every email. But with 100 emails, I get 100 drafts, and I still read them one by one and decide. So the decision is still on me.</p><p>So now I hand over the judgment itself. This is the important jump, because this is the moment the chatbot turns into an agent.</p><p>To do it, I build a skill. A skill is just my know-how written down once, my rules, my style, saved so the model can read it. Like explaining to a new person exactly how you decide. Now the AI runs the same checks I do by hand, and decides my way every time.</p><p>Put it all together, the LLM, the tools, the workflow, and the skill that decides like me. That is an AI agent. The moment the model can choose, skip, decide, and act on its own, it becomes an agent. Its loop has a fancy name, ReAct: it thinks, does it, looks at the result, and thinks again, until the job is done.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CDzI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CDzI!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 424w, https://substackcdn.com/image/fetch/$s_!CDzI!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 848w, https://substackcdn.com/image/fetch/$s_!CDzI!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 1272w, https://substackcdn.com/image/fetch/$s_!CDzI!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!CDzI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png" width="650" height="559.9639546858908" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1673,&quot;width&quot;:1942,&quot;resizeWidth&quot;:650,&quot;bytes&quot;:3911903,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F55512f9c-b614-410f-b06a-3527ff3b065d_2328x1988.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CDzI!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 424w, https://substackcdn.com/image/fetch/$s_!CDzI!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 848w, https://substackcdn.com/image/fetch/$s_!CDzI!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 1272w, https://substackcdn.com/image/fetch/$s_!CDzI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbec7800a-76d9-4993-a2ed-293ac5280656_1942x1673.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Not a robot with feelings. Just a model in a loop, using tools, following your rules, choosing the next step.</p><blockquote><p>A chatbot answers. A workflow follows. An agent decides what to do next.</p></blockquote><div><hr></div><h1><strong>Make it sound like me</strong></h1><p>Now the agent decides like me. But the replies still do not sound like me. Too polished, too generic. So I need a second skill, this time for my voice.</p><p>But I do not write this one by hand. I tell the AI to read hundreds of my old sent emails and learn how I open, how I close, my tone, the words I use. Then it bundles all of that into a skill on its own. Now I have two skills, one for the judgment and one for my voice.</p><p>And one warning. More skills means more context, and more is not always better. Overload the AI and it gets distracted. Giving it exactly the right context and no junk, that is context engineering.</p><p>But there is still a problem. Over time the AI drifts and stops following my voice. So I tell it to reread the skill, it apologizes, fixes it, and I am back to babysitting. That is exhausting.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!sk-W!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sk-W!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 424w, https://substackcdn.com/image/fetch/$s_!sk-W!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 848w, https://substackcdn.com/image/fetch/$s_!sk-W!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 1272w, https://substackcdn.com/image/fetch/$s_!sk-W!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!sk-W!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png" width="590" height="518.9080150618612" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1635,&quot;width&quot;:1859,&quot;resizeWidth&quot;:590,&quot;bytes&quot;:3784721,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F62b098fc-f9bc-48d6-88ab-5f7649325f67_2368x1974.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sk-W!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 424w, https://substackcdn.com/image/fetch/$s_!sk-W!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 848w, https://substackcdn.com/image/fetch/$s_!sk-W!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 1272w, https://substackcdn.com/image/fetch/$s_!sk-W!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60b651cf-dbc9-4c77-a1d1-55458b785425_1859x1635.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The fix is a self-check loop, what people call loop engineering. Instead of handing me the draft, the agent rereads its own draft against my voice skill first. If something is off, it rewrites, then checks again, until it truly sounds like me. Only then does it reach me. In Claude you just type /loop to get this.</p><blockquote><p>The real unlock is not an AI that writes. It is an AI that checks its own work before you ever see it.</p></blockquote><div><hr></div><h1><strong>From one worker to a team</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Q_zz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Q_zz!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 424w, https://substackcdn.com/image/fetch/$s_!Q_zz!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 848w, https://substackcdn.com/image/fetch/$s_!Q_zz!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 1272w, https://substackcdn.com/image/fetch/$s_!Q_zz!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Q_zz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png" width="678" height="480.56043956043953" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:678,&quot;bytes&quot;:1718008,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Q_zz!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 424w, https://substackcdn.com/image/fetch/$s_!Q_zz!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 848w, https://substackcdn.com/image/fetch/$s_!Q_zz!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 1272w, https://substackcdn.com/image/fetch/$s_!Q_zz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff39d580e-6a70-487b-9990-ec92cfaec43d_2670x1892.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>By now the whole system works. But with hundreds of emails, one agent going through them one by one takes about half an hour. I want this in one or two minutes.</p><p>So I stop using one agent and build a team. I promote that one agent to be a manager. And like any real manager, it does not do the work itself. It slices the inbox and hands each slice to a helper, a sub-agent.</p><p>Each sub-agent is a full agent. It reads, researches, and drafts, but only for its own slice, with no idea about the others. So they all run in parallel, report back, and the manager combines everything into one answer for me.</p><p>Nothing here got smarter. It just got faster. Half an hour becomes two minutes. When I was testing Fable 5, I launched around 200 agents at once to optimize my website. Very expensive, but honestly very cool.</p><blockquote><p>The AI did not get smarter here. It just got faster, because the work could be split.</p></blockquote><div><hr></div><h1><strong>And now it runs without me</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!I97u!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!I97u!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 424w, https://substackcdn.com/image/fetch/$s_!I97u!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 848w, https://substackcdn.com/image/fetch/$s_!I97u!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 1272w, https://substackcdn.com/image/fetch/$s_!I97u!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!I97u!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png" width="1456" height="605" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:605,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2453474,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/204262386?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!I97u!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 424w, https://substackcdn.com/image/fetch/$s_!I97u!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 848w, https://substackcdn.com/image/fetch/$s_!I97u!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 1272w, https://substackcdn.com/image/fetch/$s_!I97u!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d45f6c2-4394-4c3f-b9d1-9bcd308a8203_3834x1594.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The last touch is simple. Right now I still open my Mac every morning and tell it to start. But I do this every day, so why start it by hand?</p><p>So I add a schedule inside Claude, a trigger that runs at the same time every day. It checks the inbox, researches, decides, writes like me, checks its own work, and prepares everything in the background. My PC does not even have to be on.</p><p>And here is my one line. I automated everything except the last step. I kept Send for myself. Sometimes I just do not feel like working with a certain sponsor, or I want the final look. Automation does not mean removing every human decision. That last call stays with me.</p><blockquote><p>Automating the boring part is the goal. The final judgment is the part worth keeping.</p></blockquote><h1><strong>So &#8230;</strong></h1><p>I took one boring routine and handed it over, one step at a time. And every buzzword that used to scare me was just the tool that unlocked the next step.</p><ul><li><p><strong>LLM</strong> let it write the first draft.</p></li><li><p><strong>Tools</strong> and web search stopped the hallucinations with fresh facts past its knowledge cutoff.</p></li><li><p><strong>MCP</strong> connected it to my inbox safely, on my rules, and the <strong>workflow</strong> gave it the steps.</p></li><li><p>A <strong>skill</strong> taught it to decide like me, and that is when it became an <strong>agent</strong> running its <strong>ReAct</strong> loop.</p></li><li><p>A second skill made it sound like me, and <strong>loop engineering</strong> made it check its own work.</p></li><li><p><strong>Sub-agents</strong> turned one worker into a team, half an hour down to two minutes.</p></li><li><p>A <strong>schedule</strong> made it run on its own.</p></li></ul><p>But one thing never changed. I stayed the judge. The AI reads, researches, decides, writes like me, and checks itself, and I still keep the final Send. You stop being the one doing every repetitive step, and become the one who designs the process and judges the result.</p><blockquote><p>AI did not take my skill away. It moved my skill into the rules, the checks, and the final call.</p></blockquote><p>So here is my one move for you. Do not start with the buzzwords. Start with one boring task you repeat every day. Write down the steps, automate the easiest one, then add one upgrade at a time. That is how the scary words stop being scary.</p><p>If you want the full story with all the sketches and animations, the video is on YouTube.</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Excel vs Power BI vs SQL vs Python vs AI]]></title><description><![CDATA[Why the fight was never real, and the one skill AI can't take from you]]></description><link>https://www.blog.datawithbaraa.com/p/excel-vs-power-bi-vs-sql-vs-python</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/excel-vs-power-bi-vs-sql-vs-python</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 23 Jun 2026 12:40:46 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/275df400-7d73-43ac-9634-577b3ae3808b_1559x877.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>There&#8217;s one question I keep getting everywhere.</p><blockquote><p><strong>Should I learn Excel, Power BI, SQL, or Python? And now with AI, do I even need any of them?</strong></p></blockquote><p>And honestly, this is the wrong question.</p><p>If you feel lost between all these tools, don&#8217;t worry. I just published a new animated-sketch video that walks through the whole thing as one story, and this is the short version.</p><p>Because here is the thing nobody tells you. These tools never replaced each other. Each one solves a real pain, and then quietly hands you a bigger one.</p><p>Let me walk you through the story.</p><div><hr></div><h1><strong>Excel: the whole job on one laptop</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!FdIb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!FdIb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 424w, https://substackcdn.com/image/fetch/$s_!FdIb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 848w, https://substackcdn.com/image/fetch/$s_!FdIb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 1272w, https://substackcdn.com/image/fetch/$s_!FdIb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!FdIb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png" width="602" height="319.58231368186875" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1909,&quot;width&quot;:3596,&quot;resizeWidth&quot;:602,&quot;bytes&quot;:2152970,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3ff38e8-7f80-4917-bb97-d30d4fd9acfa_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!FdIb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 424w, https://substackcdn.com/image/fetch/$s_!FdIb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 848w, https://substackcdn.com/image/fetch/$s_!FdIb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 1272w, https://substackcdn.com/image/fetch/$s_!FdIb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea067556-b305-4347-aefb-61efcf9db61b_3596x1909.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>It always starts the same way. A manager has a question, the data sits in some application, and you pull it into Excel. You explore it, clean it, write a few formulas, build a chart, drop it into PowerPoint, and present the answer. Question in the morning, answer by lunch. And honestly, in almost every company there is that one Excel file that quietly runs the whole business, and everyone is scared to touch it.</p><h4>Why everyone starts here</h4><ul><li><p>No setup, no database, no code. Just you and a laptop.</p></li><li><p>The fastest way to answer a small, quick question.</p></li><li><p>Anyone can do it, which is why everyone starts here.</p></li></ul><h4>Where it falls apart</h4><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!45QQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!45QQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 424w, https://substackcdn.com/image/fetch/$s_!45QQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 848w, https://substackcdn.com/image/fetch/$s_!45QQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 1272w, https://substackcdn.com/image/fetch/$s_!45QQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!45QQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png" width="662" height="340.03517060367454" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1957,&quot;width&quot;:3810,&quot;resizeWidth&quot;:662,&quot;bytes&quot;:3176698,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feda7df72-ad37-428e-ae81-5a552180c52b_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!45QQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 424w, https://substackcdn.com/image/fetch/$s_!45QQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 848w, https://substackcdn.com/image/fetch/$s_!45QQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 1272w, https://substackcdn.com/image/fetch/$s_!45QQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a04b296-ebd5-4dd5-b2b1-79565fe17242_3810x1957.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p>The file grows until it takes minutes to open, and Excel caps out around a million rows.</p></li><li><p>&#8220;Can I get this every week?&#8221; turns the whole thing into a manual routine.</p></li><li><p>You split the file to survive, and now you have sales_final, sales_final_v2, and sales_final_OLD_DO_NOT_USE. Someone is always using the wrong one.</p></li><li><p>I met people who got stuck for years doing one thing, fighting Excel until it refreshes.</p></li></ul><ul><li><p>The file grows until it takes minutes to open, and Excel caps out around a million rows.</p></li><li><p>&#8220;Can I get this every week?&#8221; turns the whole thing into a manual routine.</p></li><li><p>You split the file to survive, and now you have sales_final, sales_final_v2, and sales_final_OLD_DO_NOT_USE. Someone is always using the wrong one.</p></li><li><p>I met people who got stuck for years doing one thing, fighting Excel until it refreshes.</p></li></ul><blockquote><p>Excel does the whole job alone, but it collapses the moment the data grows.</p></blockquote><div><hr></div><h1><strong>Power BI: automate it and share it</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!U8zQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!U8zQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 424w, https://substackcdn.com/image/fetch/$s_!U8zQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 848w, https://substackcdn.com/image/fetch/$s_!U8zQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 1272w, https://substackcdn.com/image/fetch/$s_!U8zQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!U8zQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png" width="636" height="307.98623974596455" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1830,&quot;width&quot;:3779,&quot;resizeWidth&quot;:636,&quot;bytes&quot;:2317580,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd20e2c70-e10d-4a54-b40a-d65c720fdc15_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!U8zQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 424w, https://substackcdn.com/image/fetch/$s_!U8zQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 848w, https://substackcdn.com/image/fetch/$s_!U8zQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 1272w, https://substackcdn.com/image/fetch/$s_!U8zQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48473d90-58a4-4622-924e-5d7b2d0e69f8_3779x1830.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So you move to Power BI. This time you connect straight to the source instead of exporting files. Your cleaning becomes a recipe in Power Query, your calculations become DAX, and on top you get a live dashboard people can click around. You publish it once, it refreshes by itself, and you just share a link.</p><h4>Why analysts love it</h4><ul><li><p>Connect once, refresh automatically, no more weekly nightmare.</p></li><li><p>The home of dashboards and interactive reports.</p></li><li><p>All of it without writing a single line of code.</p></li></ul><h4>Where it cracks</h4><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!XKmX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XKmX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 424w, https://substackcdn.com/image/fetch/$s_!XKmX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 848w, https://substackcdn.com/image/fetch/$s_!XKmX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 1272w, https://substackcdn.com/image/fetch/$s_!XKmX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!XKmX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png" width="635" height="315.65406976744185" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1881,&quot;width&quot;:3784,&quot;resizeWidth&quot;:635,&quot;bytes&quot;:3677897,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1594ac15-1dfc-4cf1-b231-0adf40bce893_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!XKmX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 424w, https://substackcdn.com/image/fetch/$s_!XKmX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 848w, https://substackcdn.com/image/fetch/$s_!XKmX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 1272w, https://substackcdn.com/image/fetch/$s_!XKmX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fddd3b4f6-c78b-4191-9fbb-da6293940277_3784x1881.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p>As the data grows, the refresh crawls from a few minutes to over an hour, and Power Query is a black box you can&#8217;t really tune.</p></li><li><p>Every team builds its own report, and the same revenue comes out different in Finance, Sales, and Marketing.</p></li><li><p>Three numbers in one meeting, and nobody knows which one is real.</p></li></ul><blockquote><p>Power BI automates the work, but it was never built to be the single source of truth.</p></blockquote><div><hr></div><h1><strong>SQL: the king of working with data</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fzkF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fzkF!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 424w, https://substackcdn.com/image/fetch/$s_!fzkF!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 848w, https://substackcdn.com/image/fetch/$s_!fzkF!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 1272w, https://substackcdn.com/image/fetch/$s_!fzkF!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fzkF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png" width="697" height="376.4526041666667" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2074,&quot;width&quot;:3840,&quot;resizeWidth&quot;:697,&quot;bytes&quot;:3231839,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3b0071-33e9-425d-84f1-72d7b351f4b0_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!fzkF!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 424w, https://substackcdn.com/image/fetch/$s_!fzkF!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 848w, https://substackcdn.com/image/fetch/$s_!fzkF!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 1272w, https://substackcdn.com/image/fetch/$s_!fzkF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4dd1a268-5b95-4b56-be14-852792f84877_3840x2074.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>That truth needs to live in one place, a database, the data warehouse. And the language you use to talk to it is SQL. Here is the thing about SQL, it was built for exactly one job, working with data, and that is why it is so good at it. You write your logic once as clean tables and views, organized in layers like bronze, silver, and gold. Power BI stays on top, light, and just reads the final layer. Now everyone walks into the meeting with the same number.</p><h4>Why it's the king</h4><ul><li><p><strong>The best tool for working directly with data.</strong> SQL was built for this one job, so it is the simplest and fastest way to transform, reshape, and prepare it.</p></li><li><p>One shared source of truth, written once and reused by every report and team.</p></li><li><p>The heavy work runs where the data lives, and you finally have real tools to make it fast, like indexes, better joins, and partitioning.</p></li><li><p>Want to investigate something? A few lines of SQL and you have the answer, way faster than clicking around in Power BI.</p></li></ul><h4>Its one weakness</h4><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!emC8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!emC8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 424w, https://substackcdn.com/image/fetch/$s_!emC8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 848w, https://substackcdn.com/image/fetch/$s_!emC8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 1272w, https://substackcdn.com/image/fetch/$s_!emC8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!emC8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png" width="3840" height="2078" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2078,&quot;width&quot;:3840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3777280,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F59d94cf1-ccf1-4b0a-9c32-9fdc654026a7_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!emC8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 424w, https://substackcdn.com/image/fetch/$s_!emC8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 848w, https://substackcdn.com/image/fetch/$s_!emC8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 1272w, https://substackcdn.com/image/fetch/$s_!emC8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd19fea7-5b2a-4e8a-9a93-8e3fd50bcd92_3840x2078.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p>SQL lives inside the walls of the database. It can&#8217;t call an API or listen to a stream.</p></li><li><p>Modern sources keep moving to APIs and streams that SQL can&#8217;t reach.</p></li><li><p>Debugging stored procedures is honestly a nightmare.</p></li></ul><blockquote><p>SQL is the king inside the database, but the job keeps moving outside its walls.</p></blockquote><div><hr></div><h1><strong>Python: everything around SQL</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!XgC9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XgC9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 424w, https://substackcdn.com/image/fetch/$s_!XgC9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 848w, https://substackcdn.com/image/fetch/$s_!XgC9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 1272w, https://substackcdn.com/image/fetch/$s_!XgC9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!XgC9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png" width="3840" height="2014" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2014,&quot;width&quot;:3840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3149860,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9cbd6041-967b-4217-9c6b-7ba629cf480a_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!XgC9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 424w, https://substackcdn.com/image/fetch/$s_!XgC9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 848w, https://substackcdn.com/image/fetch/$s_!XgC9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 1272w, https://substackcdn.com/image/fetch/$s_!XgC9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9e7dd0e-85ec-4469-8003-3f234538f8a0_3840x2014.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>And that is where Python comes in. First, let me kill the biggest fear. Python does not replace SQL. Your SQL keeps doing the heavy lifting. Python just wraps around it and handles everything outside the database, connecting to any source, logging, quality checks, and messy data like JSON. That Excel file a colleague just emailed you? One line of Python, and it sits right next to your database data.</p><h4>Why it's so powerful</h4><ul><li><p>Connect to anything, APIs, streams, files, all in one script.</p></li><li><p>Automate the full pipeline and add real logging and quality checks.</p></li><li><p>pandas makes tables easy, and if you already know SQL it feels like home (a groupby is just GROUP BY).</p></li><li><p>It opens the door to advanced things like forecasting and machine learning.</p></li></ul><h4>The trap</h4><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5M-f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5M-f!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 424w, https://substackcdn.com/image/fetch/$s_!5M-f!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 848w, https://substackcdn.com/image/fetch/$s_!5M-f!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 1272w, https://substackcdn.com/image/fetch/$s_!5M-f!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5M-f!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png" width="3499" height="2002" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2002,&quot;width&quot;:3499,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3625998,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F443b440b-5e65-4a07-aaf5-a5b0e7253ab9_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!5M-f!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 424w, https://substackcdn.com/image/fetch/$s_!5M-f!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 848w, https://substackcdn.com/image/fetch/$s_!5M-f!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 1272w, https://substackcdn.com/image/fetch/$s_!5M-f!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76f529fb-a0c3-415e-96a3-427497cd07ee_3499x2002.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p>Everything now goes through you. Every new task is new code you write and maintain.</p></li><li><p>The sources keep growing, and you and your team become the bottleneck.</p></li><li><p>Your day turns into maintaining pipelines instead of talking to the data.</p></li></ul><blockquote><p>Python crosses every wall, but now you are the wall.</p></blockquote><div><hr></div><h1><strong>AI: write the code, go faster</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!gdww!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!gdww!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 424w, https://substackcdn.com/image/fetch/$s_!gdww!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 848w, https://substackcdn.com/image/fetch/$s_!gdww!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 1272w, https://substackcdn.com/image/fetch/$s_!gdww!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!gdww!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png" width="3527" height="1809" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1809,&quot;width&quot;:3527,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2161116,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4bc2f710-7367-4e6b-91d3-850ac79d34df_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!gdww!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 424w, https://substackcdn.com/image/fetch/$s_!gdww!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 848w, https://substackcdn.com/image/fetch/$s_!gdww!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 1272w, https://substackcdn.com/image/fetch/$s_!gdww!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4a271b2-4e6b-4824-ba57-9bae835575b8_3527x1809.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So the manager says we have AI now, let&#8217;s use it. And it feels like magic. You describe what you want and the AI writes the SQL and the Python in seconds. The boring stuff, documentation, reviews, repeated code, just gets done. It speaks all of them and sits on top of everything you built.</p><p>But here is the most dangerous part of the whole story, and you can&#8217;t see it.</p><p>When normal code is wrong, it crashes. The error is loud. But a wrong SQL query doesn&#8217;t crash. It runs fine, everything turns green, and it hands you a confident, wrong number. One missing filter or one wrong join can quietly drop half your rows, and the job still finishes with no warning, nothing red.</p><h4>Why it feels like magic</h4><ul><li><p>Writes the SQL and Python for you in seconds.</p></li><li><p>Handles the boring, repeated work, and even debugs your errors and explains that old script nobody understands.</p></li><li><p>The first tool that speaks all the others at once.</p></li></ul><h4><strong>The silent danger</strong></h4><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!hqS_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!hqS_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 424w, https://substackcdn.com/image/fetch/$s_!hqS_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 848w, https://substackcdn.com/image/fetch/$s_!hqS_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 1272w, https://substackcdn.com/image/fetch/$s_!hqS_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!hqS_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png" width="3737" height="1990" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1990,&quot;width&quot;:3737,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2077053,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0a6ca530-f411-4b5d-b90c-85a21131a037_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!hqS_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 424w, https://substackcdn.com/image/fetch/$s_!hqS_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 848w, https://substackcdn.com/image/fetch/$s_!hqS_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 1272w, https://substackcdn.com/image/fetch/$s_!hqS_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3214cf3-fc03-4630-88de-27c56d2ed136_3737x1990.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p>Wrong data fails silently. No crash, no red, just a wrong number in a real decision.</p></li><li><p>Your whole platform runs on trust, and once people stop trusting the numbers, it is very hard to win them back.</p></li><li><p>Looks right and is right are two very different things.</p></li></ul><blockquote><p>AI gives you speed, but it can&#8217;t tell you if the answer is actually true.</p></blockquote><div><hr></div><h1><strong>So &#8230;</strong></h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!0GUW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!0GUW!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 424w, https://substackcdn.com/image/fetch/$s_!0GUW!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 848w, https://substackcdn.com/image/fetch/$s_!0GUW!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 1272w, https://substackcdn.com/image/fetch/$s_!0GUW!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!0GUW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png" width="3472" height="1979" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1979,&quot;width&quot;:3472,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2235851,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/203209127?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F431b12c5-7f3d-4b8b-b588-b2da91a8bf5b_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!0GUW!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 424w, https://substackcdn.com/image/fetch/$s_!0GUW!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 848w, https://substackcdn.com/image/fetch/$s_!0GUW!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 1272w, https://substackcdn.com/image/fetch/$s_!0GUW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d2ba6c3-5fef-48d9-bb2c-8033ed1bb073_3472x1979.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Step back and look at the whole thing, and two things become clear.</p><p>First, nothing here ever died. Each tool is still the best at one job.</p><ul><li><p><strong>Excel</strong> for a small, quick question.</p></li><li><p><strong>Power BI</strong> for dashboards and sharing.</p></li><li><p><strong>SQL</strong> for the one truth underneath.</p></li><li><p><strong>Python</strong> for everything around the table.</p></li><li><p><strong>AI</strong> for speed on top of all of them.</p></li></ul><p>Second, the pattern. Every tool solved the pain in front of you and then handed you a bigger one. Excel buried you in manual work, Power BI split the truth, SQL got stuck inside its walls, Python made you the bottleneck, and AI made everything fast but hard to trust. This has been going on for decades. AI is just the newest link, not the end of it.</p><p>And in every single chapter, there was one person who knew if the number was right. With AI writing everything in seconds, that person matters more than ever.</p><blockquote><p>AI didn&#8217;t make these skills useless. It made you the judge.</p></blockquote><p>So if you&#8217;re starting today, don&#8217;t try to learn five things at once. Start with <strong>SQL</strong>, it is the heart. Then add <strong>Python</strong> for everything around it. Excel and Power BI you&#8217;ll pick up on the way. Then put <strong>AI</strong> on top, to go faster, while you stay the judge.</p><p>The tools change. The pattern doesn&#8217;t.</p><p>If you want the full story with all the sketches and animations, the video is on YouTube.</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[AI Engineering Is Just Data Engineering With New Sources]]></title><description><![CDATA[What I figured out after watching it creep into my own projects.]]></description><link>https://www.blog.datawithbaraa.com/p/ai-engineering-is-just-data-engineering</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/ai-engineering-is-just-data-engineering</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Thu, 28 May 2026 14:46:38 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/VCeQcIlJscE" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Thursday!</strong></p><p>Two, three years ago, when I started hearing about AI engineering, my first reaction was:</p><blockquote><p>&#8220;Sounds like a different world. Not for me.&#8221;</p></blockquote><p>I was wrong about that. And after seeing how it played out in my own projects, I think a lot of you are sitting in the same spot I was sitting in back then.</p><p>Let me walk you through how I figured it out.</p><div id="youtube2-VCeQcIlJscE" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;VCeQcIlJscE&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/VCeQcIlJscE?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h2><strong>How it crept into my own projects</strong></h2><p>It didn&#8217;t happen in one big moment. It happened slowly.</p><p>I can tell you from my projects, over time, I started catching myself adding small AI components here and there. A little embedding step. A small retrieval thing. Nothing fancy at first.</p><p>And then customers started asking for it. They had real data platforms already, working, in production, and now they were saying:</p><blockquote><p>&#8220;Hey, can you extend this with our AI use cases?&#8221;</p></blockquote><p>So I found my data platform turning into a data and AI platform. Without me planning it. Without a big strategic decision. Project by project, it just kept happening.</p><p>And once I noticed it, I went and looked at the numbers.</p><div><hr></div><h2><strong>This is not the future. It is already happening.</strong></h2><p>There was a survey from MIT and Snowflake. They asked around four hundred senior data and tech leaders how much time their teams were spending on AI work.</p><p>Back in 2023, it was around <strong>19%</strong>.</p><p>Today it is around <strong>37%</strong>.</p><p>And in two years, they expect more than <strong>60%</strong>.</p><p>So no, my friends, this is not the future. This is already happening to us.</p><blockquote><p>The job didn&#8217;t get replaced. The job grew a new layer.</p></blockquote><p>And once you understand that, the question is not &#8220;do I need to care about AI engineering?&#8221;. The question becomes &#8220;how do I fit it into what I already do?&#8221;</p><div><hr></div><h2><strong>The two-worlds confusion</strong></h2><p>I get this a lot from messages and comments. People line up the two sides like this.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!nuJJ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nuJJ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!nuJJ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!nuJJ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!nuJJ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!nuJJ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1241961,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/199609141?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!nuJJ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!nuJJ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!nuJJ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!nuJJ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6fec18da-0543-4eed-87fb-ac7df2d5acce_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>On the data engineering side, we have what we have always done. <strong>ETL, data modeling, storage, pipelines, scheduling, data quality, DevOps</strong>. The stuff we do every day at work.</p><p>On the AI engineering side, suddenly different words. <strong>RAG, embeddings, vector databases, prompt engineering, fine-tuning, agents, LLMOps</strong>. All shiny, all new, all confusing.</p><p>And if you sit back and just look at this split, you say:</p><blockquote><p>&#8220;Okay, two different worlds. Nothing to do with me.&#8221;</p></blockquote><p>That was my reaction too. But once you look closer, you see something else.</p><div><hr></div><h2><strong>Look closer. Same pattern.</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!gXXw!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!gXXw!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!gXXw!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!gXXw!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!gXXw!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!gXXw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/387e6428-030f-449f-9048-56afe3067b17_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1605579,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/199609141?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!gXXw!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!gXXw!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!gXXw!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!gXXw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F387e6428-030f-449f-9048-56afe3067b17_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>You know how a classical data engineering project flows. Sources (databases, files, APIs), pipeline, warehouse or lakehouse, BI tools and dashboards. You have built it a hundred times.</p><blockquote><p><strong>Sources &#8594; Pipeline &#8594; Storage &#8594; Consumption.</strong></p></blockquote><p>Now look at the AI side. RAG, retrieval-augmented generation, sounds fancy. But the story is the same.</p><p>The sources are different. This time it is documents, PDFs, emails, tickets, web pages. The pipeline cleans them, splits them into chunks, and turns them into embeddings. So instead of aggregating, we transform text into numbers. The storage is different too. Instead of a warehouse, we use a vector database. And at the end, the data gets consumed by AI agents and LLMs, that go read it to answer questions with the right context.</p><p>Now put both side by side.</p><blockquote><p><strong>Same layering. Different transformations.</strong></p></blockquote><p>That is the moment it clicked for me. AI engineering is not a parallel universe. It is another use case sitting on top of the same skeleton we have been building for years.</p><div><hr></div><h2><strong>Companies don&#8217;t build two ecosystems</strong></h2><p>Now the big practical question. Are companies building two separate platforms? One for data, one for AI?</p><p>The honest answer is no.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!LhRS!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!LhRS!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!LhRS!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!LhRS!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!LhRS!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!LhRS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1412188,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/199609141?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!LhRS!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!LhRS!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!LhRS!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!LhRS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c66950c-314e-45a0-acd1-1dafe8fece4b_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Most of the companies I work with already have solid data engineering projects. They are not going to throw that away and start from scratch. So what they do is they extend the existing platform.</p><ul><li><p>New sources come in. Documents, PDFs, emails, tickets, web pages.</p></li><li><p>The pipeline grows to handle them, with cleaning, chunking, embedding.</p></li><li><p>The storage layer gets a new component, the vector database, sitting next to the warehouse and the lakehouse.</p></li><li><p>And in the consumption layer, AI agents plug in.</p></li></ul><p>So we treat AI use cases like any other data engineering requirement. New sources, new pipelines, new storage, new consumers.</p><p>And here is where it gets really good. The AI agent doesn&#8217;t only have access to the vector database. It can also reach into the whole lakehouse. All your data is right there.</p><blockquote><p>More data, more context, more use cases.</p></blockquote><p>This is exactly why AI engineering is so close to us. Because the data layer we have been building for years is exactly what AI needs.</p><div><hr></div><h2><strong>So where do AI engineers fit?</strong></h2><p>Good question, and I get it a lot.</p><p>If data engineers can do the whole AI pipeline, why do we even need AI engineers?</p><p>Same reason we have data analysts, data scientists, BI developers. We data engineers don&#8217;t do the full thing end to end. We pick the source systems, we process the data, we store it in a shape that is easy to consume. And then we stop.</p><p>We don&#8217;t decide if the users should use Power BI or Tableau. We don&#8217;t sit with stakeholders to define business metrics. We don&#8217;t go and design the dashboards. That is not our part.</p><p>Same with AI. We will not pick which LLM model to use for which use case. We will not design the chatbot interface. We will not build the APIs that the business application calls. All those decisions live on the consumer side.</p><blockquote><p>We own the data processing part. We always did.</p></blockquote><p>Same job. Different consumers.</p><p>And honestly, this isn&#8217;t the first time we&#8217;ve gone through this kind of shift.</p><div><hr></div><h2><strong>ETL &#8594; Big Data &#8594; Cloud &#8594; AI</strong></h2><p>When I started in this industry, we were called <strong>ETL developers</strong>. Then the world shifted, and suddenly we were <strong>big data engineers</strong>, working with Hadoop, MapReduce, all that stuff.</p><p>Then the cloud came. Azure, AWS, Databricks, Snowflake. We became <strong>modern data engineers</strong>.</p><p>And now we are in another shift. AI use cases. New sources. New components. New consumers.</p><p>But in the heart of the job, my friend, nothing changed.</p><blockquote><p>We move data from A to B. We process it on the way. We make it easy to consume for the next person.</p></blockquote><p>That is what we do. That is what we will keep doing.</p><div><hr></div><h2><strong>So what should you actually do?</strong></h2><p>You have three options.</p><p><strong>Option 1: switch completely.</strong> Drop data engineering and become a full AI engineer end to end.</p><p><strong>Option 2: ignore the whole thing.</strong> Stay where you are, do what you do, hope nobody asks.</p><p><strong>Option 3 (this is the one I recommend):</strong> stay as a data engineer and add the new AI engineering pieces to your skill set. Combine the two worlds.</p><p>And honestly, this is not that hard. You don&#8217;t need to become an LLM expert. You just need to learn a few things:</p><ul><li><p>How to connect documents as a source.</p></li><li><p>How to split text into chunks.</p></li><li><p>How to turn it into embeddings.</p></li><li><p>How to store it in a vector database.</p></li><li><p>How to query a vector database.</p></li></ul><p>That is the RAG pipeline. And it is exactly the kind of work we already know how to think about. Just new components on top of patterns we have used for years.</p><p>Put one project like this on your portfolio, and you are already ahead of most data engineers in the market right now.</p><div><hr></div><h2><strong>So &#8230;</strong></h2><p>AI engineering is not a different world. It is the next layer of data engineering.</p><p>If you are a data engineer, you are already much closer to it than you think. You just need to extend.</p><p>And honestly, I&#8217;ll tell you where I think this is going. In two or three years, the job titles will look different. The work will look the same. The people who get hired will be the ones who already extended.</p><p>So don&#8217;t see AI as a threat. See it as the next chapter of the same job you have been doing all along.</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Why Power BI Projects Fail Without Data Modeling]]></title><description><![CDATA[The most skipped step in data work, and the number one reason projects quietly fall apart.]]></description><link>https://www.blog.datawithbaraa.com/p/why-power-bi-projects-fail-without</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/why-power-bi-projects-fail-without</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 19 May 2026 12:33:20 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/my3YXrqQbPI" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>Let&#8217;s talk about the most skipped step in data work: <strong>data modeling</strong>.</p><p>No hype, no shiny tool, nobody makes content about it. And honestly? It&#8217;s the number one reason data projects fail. Not just Power BI reports. Pipelines, warehouses, lakehouses, all of it.</p><p>People connect the data, run some transformations, and jump straight to building. The model? Skipped.</p><blockquote><p>Weak model = weak project.</p></blockquote><p>So I just started what I think is the most important chapter in the whole Power BI course. Like always, we build it the right way, step by step, with the sketches.</p><div id="youtube2-my3YXrqQbPI" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;my3YXrqQbPI&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/my3YXrqQbPI?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h2>The Trap: One Big Flat Table</h2><p>Someone asks for a report. You connect the source, grab the columns you need, and dump everything into <strong>one big flat table</strong>. Add a few DAX measures, build the report, share it. One or two weeks of work.</p><p>And honestly? It feels great. You&#8217;re fast, you&#8217;re flexible, the report works, the user is happy.</p><p>But here&#8217;s the trap:</p><blockquote><p>One big table is not a data model.</p></blockquote><p>It&#8217;s fine for one small report. But Power BI projects never stay small. The data grows, the users grow, the requests keep coming. And that one table starts breaking things everywhere.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5kCQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5kCQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 424w, https://substackcdn.com/image/fetch/$s_!5kCQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 848w, https://substackcdn.com/image/fetch/$s_!5kCQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 1272w, https://substackcdn.com/image/fetch/$s_!5kCQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5kCQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png" width="3574" height="1700" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1700,&quot;width&quot;:3574,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1701929,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/198396223?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe286da2f-9b99-43ec-9048-36d3f88d2b3e_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!5kCQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 424w, https://substackcdn.com/image/fetch/$s_!5kCQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 848w, https://substackcdn.com/image/fetch/$s_!5kCQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 1272w, https://substackcdn.com/image/fetch/$s_!5kCQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa025c4c3-beb9-4755-8eee-dc297479fe02_3574x1700.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Here is why:</p><p><strong>#1: The file gets huge.</strong> With 10,000 rows you won&#8217;t feel a thing. But push it to a million, ten million rows, and the same information repeats on every single row, over and over. You&#8217;re storing the same text thousands of times instead of once. The file blows up for no good reason.</p><p><strong>#2: Refresh gets painful.</strong> Once the file is huge, the refresh follows. What used to take a few minutes turns into 30 minutes, an hour, more. Now just getting fresh data into Power BI is a daily fight, and every fix takes longer to test.</p><p><strong>#3: Reports get slow.</strong> Every time a user clicks a slicer, Power BI has to scan that giant table to build the visual. So the report drags. And in real projects users aren&#8217;t patient. If it doesn&#8217;t open in two or three seconds, they don&#8217;t say &#8220;the model needs work,&#8221; they say &#8220;Power BI is slow,&#8221; or worse, &#8220;this project is bad.&#8221;</p><p><strong>#4: DAX gets ugly.</strong> Most people think they&#8217;re bad at DAX. They&#8217;re not. The one big table is forcing them into complicated formulas. A measure that should be one line becomes ten, because you&#8217;re twisting things just to get the right number.</p><blockquote><p>Bad data model = complicated DAX.</p></blockquote><div><hr></div><h2>How a Real Model Fixes It</h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!HvjZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!HvjZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!HvjZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!HvjZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!HvjZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!HvjZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/382d758c-4884-4c88-b96e-521c39996888_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1185478,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/198396223?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!HvjZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!HvjZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!HvjZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!HvjZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382d758c-4884-4c88-b96e-521c39996888_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The fix isn&#8217;t complicated. Stop forcing everything into one table. Split the data into separate, meaningful tables and connect them with relationships.</p><p>Now each piece of information is stored once, in its own table, instead of repeating on every row. The big table only keeps what it actually needs.</p><p>That one change fixes the whole chain. The file gets small. The refresh gets fast. The reports get fast, because a slicer now reads a small table instead of scanning millions of rows. And the DAX gets simple, because the relationships do the heavy work for you.</p><blockquote><p>The model and the relationships do half the work before you write a single measure.</p></blockquote><div><hr></div><h2>The Bigger Danger: One Table for Every Report</h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!WxT2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!WxT2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 424w, https://substackcdn.com/image/fetch/$s_!WxT2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 848w, https://substackcdn.com/image/fetch/$s_!WxT2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 1272w, https://substackcdn.com/image/fetch/$s_!WxT2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!WxT2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png" width="3612" height="2092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2092,&quot;width&quot;:3612,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1750612,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/198396223?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8512e8f6-a013-4ca5-b025-0319e8df3726_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!WxT2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 424w, https://substackcdn.com/image/fetch/$s_!WxT2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 848w, https://substackcdn.com/image/fetch/$s_!WxT2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 1272w, https://substackcdn.com/image/fetch/$s_!WxT2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2335dfa-84e7-43ad-b8b8-9ca8e35aa406_3612x2092.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The technical problems are painful. But there&#8217;s a bigger one.</p><p>When you skip data modeling, you fall into a pattern. A user asks for a report, you build a table for that report. Another user asks for another report, you build another table. Another dashboard comes in, you do it again.</p><p>Over time every report has its own logic, its own transformations, its own version of the truth.</p><blockquote><p>One report, one table. This is the beginning of the end.</p></blockquote><div><hr></div><h2>Maintenance Becomes a Nightmare</h2><p>Say you find a mistake in the transformation logic. With one shared model, you fix it in one place. With one table per report, you open file after file and repeat the same fix everywhere, trying to keep them in sync.</p><p>That&#8217;s a lost battle. One day someone forgets a file. One measure changes in one place but not the other. Now the reports don&#8217;t match.</p><p>One report says <strong>1.2 million</strong>. Another says <strong>1.4 million</strong>. Same question, different answer. And when users see different numbers, they don&#8217;t care why. They just see Power BI giving them different numbers.</p><blockquote><p>When the numbers don&#8217;t match, users stop trusting the whole project. And then they go back to Excel.</p></blockquote><div><hr></div><h2>Build Around the Business, Not One Report</h2><p>This is the real shift.</p><p>A flat table is built around one report. A data model is built around the business. Instead of asking &#8220;what columns do I need for this one report?&#8221;, you ask &#8220;what does the business actually need to answer?&#8221;</p><p>Then you build a model that can answer many questions, not just one dashboard request. One model serves many reports. Fix a calculation once, every report using it stays correct.</p><p>That&#8217;s where consistency comes from. And consistency is what builds trust.</p><div><hr></div><h2>But Should Everything Use One Giant Model?</h2><p>No. This is where people go to the other extreme.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xmwR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xmwR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 424w, https://substackcdn.com/image/fetch/$s_!xmwR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 848w, https://substackcdn.com/image/fetch/$s_!xmwR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 1272w, https://substackcdn.com/image/fetch/$s_!xmwR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xmwR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png" width="672" height="427.16279069767444" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2050,&quot;width&quot;:3225,&quot;resizeWidth&quot;:672,&quot;bytes&quot;:2209751,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/198396223?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc613213d-54e1-403d-87cf-9861fb974ca6_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xmwR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 424w, https://substackcdn.com/image/fetch/$s_!xmwR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 848w, https://substackcdn.com/image/fetch/$s_!xmwR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 1272w, https://substackcdn.com/image/fetch/$s_!xmwR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15508407-67f9-4257-a7a2-93ff888cde0d_3225x2050.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>They hear &#8220;shared model&#8221; and build one giant model for the whole company. Everything depends on it, so changing one measure feels terrifying because it can hit dozens of reports at once.</p><p>So the answer is the middle:</p><blockquote><p>Not one table per report. Not one model for the whole company. One shared model per domain.</p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!O026!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!O026!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 424w, https://substackcdn.com/image/fetch/$s_!O026!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 848w, https://substackcdn.com/image/fetch/$s_!O026!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 1272w, https://substackcdn.com/image/fetch/$s_!O026!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!O026!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png" width="3283" height="2147" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2147,&quot;width&quot;:3283,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2023062,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/198396223?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe322632-6ca8-4758-aa69-81e646aaaf00_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!O026!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 424w, https://substackcdn.com/image/fetch/$s_!O026!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 848w, https://substackcdn.com/image/fetch/$s_!O026!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 1272w, https://substackcdn.com/image/fetch/$s_!O026!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff63fa5f5-f713-4bf5-ba19-3cb2e0da50f5_3283x2147.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>One model per domain, each serving a group of related reports. You get the reuse without turning the whole company into one fragile model.</p><div><hr></div><h2>Quick Recap</h2><p>Bad data models create technical problems:</p><ul><li><p>Large Power BI files</p></li><li><p>Slow refresh</p></li><li><p>Slow reports</p></li><li><p>Complicated DAX</p></li></ul><p>And project problems:</p><ul><li><p>Repeated work</p></li><li><p>Hard maintenance</p></li><li><p>Different KPI numbers</p></li><li><p>Users losing trust</p></li></ul><p>Data modeling takes time. But skipping it is more expensive. Your report might work today with one big table. Over time, that shortcut becomes the reason the project fails.</p><blockquote><p>If the model is weak, the project is weak.</p></blockquote><p>In the next videos we go deeper. What data modeling actually means, the different model types, and how to build clean, fast Power BI models, step by step with the sketches.</p><p><strong>Watch the new chapter here:</strong> [VIDEO LINK]</p><p>Thanks for reading &#10084;&#65039;</p><p>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Will AI Replace Data Jobs? Engineers & Analysts]]></title><description><![CDATA[My honest answer after years in real companies]]></description><link>https://www.blog.datawithbaraa.com/p/will-ai-replace-data-jobs-engineers</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/will-ai-replace-data-jobs-engineers</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 24 Mar 2026 13:02:45 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/e3KQ8ziMp2o" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>There&#8217;s one question I keep getting everywhere.</p><blockquote><p><strong>&#8220;Will AI replace us?&#8221;</strong></p></blockquote><p>And honestly&#8230; I get it. Especially if you&#8217;re still learning, this question can sit in your head all day.</p><p>Now if you ask me directly, my answer is a bit annoying.</p><blockquote><p><strong>It depends.</strong></p></blockquote><p>I know&#8230; not the answer you want. But I&#8217;m not trying to avoid it. The problem is, this question is not simple, and most of the discussions online are missing something very important.</p><p>They ignore how things actually work inside real companies. So instead of giving you a short answer, let me walk you through how I think about this.</p><div id="youtube2-e3KQ8ziMp2o" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;e3KQ8ziMp2o&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/e3KQ8ziMp2o?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h1>The reality inside companies</h1><h3>What you see online vs what actually exists</h3><p>Most AI demos you see are built on very clean setups. A few tables, nice structure, everything documented perfectly. In that world, AI looks insanely powerful.</p><p>But real projects don&#8217;t look like that at all. They&#8217;re messy, huge, and everything is connected to everything.</p><p>I worked on a lakehouse project where we spent years just connecting systems. Data was coming from APIs, Kafka streams, databases, files&#8230; and we ended up with more than a thousand tables. And honestly, that was just the starting point. On top of that, there was business logic built layer by layer over time.</p><p>So when someone says &#8220;AI can build this with a few prompts&#8221;&#8230; yeah, it sounds nice.<br>But it skips the hardest part.</p><p>The hard part is not writing code.<br>It&#8217;s understanding everything behind the code.</p><div><hr></div><h3>Companies move slower than technology</h3><p>Another thing people underestimate.<br>Technology moves fast. Companies don&#8217;t.<br>If you watch what&#8217;s happening in the media, it feels like everything is already AI-driven. Like every company has figured it out and we&#8217;re already there.</p><p>But the moment you step inside a real company, you see a completely different reality.<br>You still find Excel running critical reports. You see systems that have been there for years and no one wants to touch them. And there&#8217;s always a big chunk of data that isn&#8217;t even integrated yet.</p><p>And changing all of this&#8230; it&#8217;s not quick.</p><p>You need to migrate systems, build pipelines, set up governance and security, and at the same time train people so they actually understand what&#8217;s going on. And all of this has to move together.</p><p>So when I hear someone saying that jobs will disappear very soon, I usually just pause for a second and think&#8230; yeah, let&#8217;s see &#128578;</p><p>Not because AI is weak. But because companies don&#8217;t change overnight.</p><div><hr></div><h2>How AI changes data teams</h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!_5d1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_5d1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 424w, https://substackcdn.com/image/fetch/$s_!_5d1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 848w, https://substackcdn.com/image/fetch/$s_!_5d1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 1272w, https://substackcdn.com/image/fetch/$s_!_5d1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!_5d1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png" width="573" height="322.59941733430446" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:773,&quot;width&quot;:1373,&quot;resizeWidth&quot;:573,&quot;bytes&quot;:567741,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191959792?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!_5d1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 424w, https://substackcdn.com/image/fetch/$s_!_5d1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 848w, https://substackcdn.com/image/fetch/$s_!_5d1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 1272w, https://substackcdn.com/image/fetch/$s_!_5d1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0906dcf1-2322-4a9d-83c5-444ba1838e6d_1373x773.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Now let&#8217;s talk about data teams.<br>Most companies have a lot of data, but small teams. So they only process a small portion of it.<br>Then AI comes in and makes those teams faster. And this creates a real decision.</p><p>Do you reduce the team, keep the team, or expand?</p><p>If you <strong>reduce </strong>the team, you save cost&#8230; but nothing really improves. You&#8217;re still processing the same small portion of data, and you might even hurt quality because the team was already stretched.</p><p>If you <strong>keep </strong>the team, you start doing more. More data sources, more pipelines, more insights. This is what I see most often. It works well, but only to a certain point. Eventually, you hit a new limit.</p><p>If you <strong>expand </strong>the team, you treat AI as a growth opportunity. You invest more, improve data quality, and use a much bigger portion of your data. It costs more, but the value is much higher.</p><p>And from what I&#8217;ve seen&#8230; most companies are not rushing to reduce data teams. They either scale what they already have or start investing more.</p><p>Because in the end, AI doesn&#8217;t reduce the need for data work.<br>It actually increases it.</p><div><hr></div><h1>What I think about the job roles</h1><p>Instead of asking &#8220;Will AI replace data analysts or engineers?&#8221;, I prefer to break the job into parts. Because not everything is equal.<br>Let&#8217;s start with data analysts.</p><div><hr></div><h3>Will AI Replace Data Analysts?</h3><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!69lh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!69lh!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 424w, https://substackcdn.com/image/fetch/$s_!69lh!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 848w, https://substackcdn.com/image/fetch/$s_!69lh!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 1272w, https://substackcdn.com/image/fetch/$s_!69lh!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!69lh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png" width="616" height="409.53846153846155" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:968,&quot;width&quot;:1456,&quot;resizeWidth&quot;:616,&quot;bytes&quot;:1246292,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191959792?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!69lh!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 424w, https://substackcdn.com/image/fetch/$s_!69lh!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 848w, https://substackcdn.com/image/fetch/$s_!69lh!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 1272w, https://substackcdn.com/image/fetch/$s_!69lh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94663fd9-0ccf-43e3-b56b-8ccfdfb493df_2303x1531.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>SQL <br></strong>is the first thing everyone talks about. And yes, AI is already very good here. You describe what you want, and it gives you a query. For simple things, it works great.<br>But once things get messy, multiple joins, unclear schemas, relationships&#8230; you start to see the limits. It doesn&#8217;t really understand your data, it just predicts.<br>Still, if I&#8217;m honest, this part will mostly be automated.</p><p><strong>Dashboards:<br></strong>AI can generate charts, but real dashboards are not just visuals. They include business logic, multiple datasets, filters, edge cases&#8230; and most importantly, trust.<br>At the end, someone still needs to look at the numbers and say, &#8220;this is correct.&#8221;<br>Then there&#8217;s something people don&#8217;t talk about enough.</p><p><strong>Finding the right data:<br></strong>In real companies, this is not obvious at all. You might have multiple tables that look the same, different systems storing similar data, and no clear documentation.<br>So what do you rely on? Experience. Context. Conversations.<br>This is where analysts actually spend a lot of their time, and this is where AI struggles the most.</p><p><strong>Understanding the business:<br></strong>Not just what people ask&#8230; but what they actually mean. Sitting with stakeholders, asking better questions, translating vague ideas into something measurable.<br>This is not about tools anymore. This is about thinking.<br>And here, AI is not even close.</p><p>Now to be fair, there is one part that will disappear.<br>The repetitive stuff. The small requests, the same questions again and again, the quick checks.<br>And honestly&#8230; that&#8217;s a good thing.<br>So when people ask me if AI will replace data analysts, my answer is always the same.<br>If your work is mostly writing queries and building simple dashboards, then yes, a big part can be automated.<br>But if you understand the business, work closely with people, and build things others rely on, then you&#8217;re not being replaced.</p><div><hr></div><h3>Will AI Replace Data Engineers?</h3><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!_fmz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_fmz!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 424w, https://substackcdn.com/image/fetch/$s_!_fmz!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 848w, https://substackcdn.com/image/fetch/$s_!_fmz!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 1272w, https://substackcdn.com/image/fetch/$s_!_fmz!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!_fmz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png" width="566" height="299.3269230769231" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:770,&quot;width&quot;:1456,&quot;resizeWidth&quot;:566,&quot;bytes&quot;:1162819,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191959792?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!_fmz!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 424w, https://substackcdn.com/image/fetch/$s_!_fmz!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 848w, https://substackcdn.com/image/fetch/$s_!_fmz!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 1272w, https://substackcdn.com/image/fetch/$s_!_fmz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fba5ae6-2ecb-40b1-9aae-9510b7d986bd_2591x1370.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Now let&#8217;s look at data engineers.</p><p>Coding:<br>AI is already very strong here. It can generate SQL, Python, and Spark code quickly. And this will only improve.</p><p>Build data pipelines:<br>AI can already create simple ones, and in the future, it will likely handle much more. Still, someone needs to review before anything goes to production.</p><p>Architecture:<br>Designing how systems are structured. Choosing between lakehouse or warehouse. Defining layers. Handling performance and scalability.<br>This requires deep understanding of both the technical side and the business context. It&#8217;s not something you can fully automate.</p><p>Data Modeling:<br>This is one of the hardest parts. You need to understand how different data sources connect, how data will be used, and which modeling approach makes sense.<br>Even experienced engineers find this challenging.<br>I don&#8217;t see AI replacing this anytime soon.</p><p>Operations:<br>Operational tasks like monitoring pipelines can be automated. AI can detect issues, suggest fixes, and possibly resolve them.</p><p>So again, the same pattern appears.<br>If someone is only coding and building pipelines, their work can be automated.<br>But if they understand systems, architecture, and data modeling, they become extremely valuable.</p><div><hr></div><h2>The role of data in the AI world</h2><p>There is one important idea that didn&#8217;t change.</p><p>Before AI, we already knew:</p><blockquote><p><em>Bad data leads to bad analysis.</em></p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8jmx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8jmx!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 424w, https://substackcdn.com/image/fetch/$s_!8jmx!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 848w, https://substackcdn.com/image/fetch/$s_!8jmx!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 1272w, https://substackcdn.com/image/fetch/$s_!8jmx!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8jmx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png" width="360" height="166.45962732919256" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/caed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:670,&quot;width&quot;:1449,&quot;resizeWidth&quot;:360,&quot;bytes&quot;:451500,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191959792?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ed07ecc-6172-4b21-98ac-95e7783661e0_1449x790.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8jmx!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 424w, https://substackcdn.com/image/fetch/$s_!8jmx!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 848w, https://substackcdn.com/image/fetch/$s_!8jmx!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 1272w, https://substackcdn.com/image/fetch/$s_!8jmx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcaed9f38-e115-4fde-b4f0-f9a8159caf64_1449x670.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Now with AI, it&#8217;s exactly the same. </p><blockquote><p><em>Bad data leads to bad results.</em></p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!EWF7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!EWF7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 424w, https://substackcdn.com/image/fetch/$s_!EWF7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 848w, https://substackcdn.com/image/fetch/$s_!EWF7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 1272w, https://substackcdn.com/image/fetch/$s_!EWF7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!EWF7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png" width="414" height="164.7596153846154" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:745,&quot;width&quot;:1872,&quot;resizeWidth&quot;:414,&quot;bytes&quot;:515031,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191959792?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4eaa635-dfdb-45c9-a1ea-e5202ca0e9df_1895x995.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!EWF7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 424w, https://substackcdn.com/image/fetch/$s_!EWF7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 848w, https://substackcdn.com/image/fetch/$s_!EWF7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 1272w, https://substackcdn.com/image/fetch/$s_!EWF7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3127c0e9-5198-4546-9977-d27e6114bf58_1872x745.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>So someone still needs to prepare that data properly. And this is why data roles are not disappearing. They are evolving.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6_Uy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6_Uy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 424w, https://substackcdn.com/image/fetch/$s_!6_Uy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 848w, https://substackcdn.com/image/fetch/$s_!6_Uy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 1272w, https://substackcdn.com/image/fetch/$s_!6_Uy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!6_Uy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png" width="610" height="277.76785714285717" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:663,&quot;width&quot;:1456,&quot;resizeWidth&quot;:610,&quot;bytes&quot;:1287497,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191959792?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!6_Uy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 424w, https://substackcdn.com/image/fetch/$s_!6_Uy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 848w, https://substackcdn.com/image/fetch/$s_!6_Uy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 1272w, https://substackcdn.com/image/fetch/$s_!6_Uy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0f8055d-97c6-47a3-bee0-8c598278dfc5_2874x1309.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h1>So &#8230;</h1><p>AI is not replacing jobs in a simple way.<br>It&#8217;s replacing parts of jobs.</p><ul><li><p>The repetitive parts.</p></li><li><p>The mechanical parts.</p></li><li><p>The parts that don&#8217;t require deep thinking.</p></li></ul><p>But the more you move toward understanding, decision-making, and communication, the harder it becomes to replace you.</p><p>If you&#8217;re thinking about your future, don&#8217;t try to compete with AI. Work with it.<br>Learn how it fits into your field. Use it to move faster, but don&#8217;t let it replace your understanding.</p><p>For me, AI is not something to fear. It&#8217;s something that removes the boring parts of the job and lets you focus on what actually matters.</p><p>And over time, you&#8217;ll start to see clearly what is real and what is just noise.<br>If you&#8217;re still here, I appreciate it.</p><p>Much love,<br><strong>&#8212; Baraa</strong></p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[6 Mistakes That Are Stopping You From Becoming a Data Engineer]]></title><description><![CDATA[Most people are doing the right things, just in the wrong way.]]></description><link>https://www.blog.datawithbaraa.com/p/6-mistakes-that-are-stopping-you</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/6-mistakes-that-are-stopping-you</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 17 Mar 2026 15:01:12 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!qiLK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>Today we&#8217;re going to do something a bit different.</p><p>Instead of talking about how to become a data engineer, I want to focus on the mistakes that might be stopping you from getting hired.</p><p>Over the last few years, I&#8217;ve seen many people move into data engineering. They learn Python, SQL, build projects, follow roadmaps&#8230; and still don&#8217;t land a job.</p><p>Yes, AI made things more competitive.</p><p>But companies are still hiring data engineers, even juniors. I see it from your messages, LinkedIn, and inside teams.</p><p>So the real question is not whether it&#8217;s possible.</p><blockquote><p>&#8220;Why do some people succeed while others stay stuck?&#8221;</p></blockquote><p>After years in the industry, I can tell you it&#8217;s not random. The same mistakes keep repeating.</p><p>So in this article, I&#8217;ll walk you through the biggest ones, and if you avoid them, things become much easier.</p><div id="youtube2-8vSdjx-QLIs" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;8vSdjx-QLIs&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/8vSdjx-QLIs?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h2>Mistake 1: Trying to Learn Every Tool in the Industry</h2><p>Trying to learn every tool in the industry. I see this all the time.</p><p>Someone decides to become a data engineer and makes a big list of tools to learn.</p><p><strong>Kafka, Airflow, Spark, Snowflake, Databricks, AWS, Azure, dbt&#8230;</strong></p><p>At the end, the roadmap looks like a <strong>technology supermarket</strong>.</p><p>This is a mistake.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qiLK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qiLK!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 424w, https://substackcdn.com/image/fetch/$s_!qiLK!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 848w, https://substackcdn.com/image/fetch/$s_!qiLK!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 1272w, https://substackcdn.com/image/fetch/$s_!qiLK!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!qiLK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png" width="553" height="339.9925925925926" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:913,&quot;width&quot;:1485,&quot;resizeWidth&quot;:553,&quot;bytes&quot;:2539316,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191221761?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec161d97-55e2-4979-bafc-1624d2890709_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!qiLK!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 424w, https://substackcdn.com/image/fetch/$s_!qiLK!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 848w, https://substackcdn.com/image/fetch/$s_!qiLK!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 1272w, https://substackcdn.com/image/fetch/$s_!qiLK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F114aa22f-53af-4321-8339-7bc581e4513b_1485x913.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>If you try to learn everything at the same time, you end up knowing a little about everything, but nothing deeply.</p><p>And companies don&#8217;t hire you for that. They hire you based on your <strong>project experience</strong>.</p><p>In real projects, you don&#8217;t use all those tools. You use a <strong>specific stack</strong>, like <strong>SQL, Python, Spark, Databricks</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2I73!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2I73!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 424w, https://substackcdn.com/image/fetch/$s_!2I73!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 848w, https://substackcdn.com/image/fetch/$s_!2I73!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 1272w, https://substackcdn.com/image/fetch/$s_!2I73!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2I73!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png" width="1456" height="371" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:371,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1326932,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191221761?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2I73!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 424w, https://substackcdn.com/image/fetch/$s_!2I73!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 848w, https://substackcdn.com/image/fetch/$s_!2I73!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 1272w, https://substackcdn.com/image/fetch/$s_!2I73!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e0d52e5-ddef-483f-940c-87d1a9897e98_3271x833.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>And in interviews, they go deep. They expect you to understand the <strong>architecture</strong>, the <strong>components</strong>, and how things work.</p><blockquote><p>&#8220;If you try to learn everything, you end up mastering nothing.&#8221;</p></blockquote><p>So instead of learning 20 tools on the surface, focus on one stack and go deep.</p><div><hr></div><h2>Mistake 2: Focusing Only on Tools</h2><p>Focusing only on tools and forgetting about the real data engineering skills.</p><p>I can tell you from my own experience. Back in 2013, I built my first data warehouse using <strong>Talend</strong>, then moved to <strong>IBM DataStage</strong>. Later at <strong>Mercedes-Benz</strong>, I worked with <strong>Azure Data Factory, Synapse</strong>, and eventually <strong>Databricks</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qTqt!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qTqt!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 424w, https://substackcdn.com/image/fetch/$s_!qTqt!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 848w, https://substackcdn.com/image/fetch/$s_!qTqt!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 1272w, https://substackcdn.com/image/fetch/$s_!qTqt!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!qTqt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png" width="3591" height="2090" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:2090,&quot;width&quot;:3591,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2571465,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/191221761?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F51361b82-207d-4149-93a4-7f8f500c541d_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!qTqt!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 424w, https://substackcdn.com/image/fetch/$s_!qTqt!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 848w, https://substackcdn.com/image/fetch/$s_!qTqt!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 1272w, https://substackcdn.com/image/fetch/$s_!qTqt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf451fe5-08a2-4728-8760-aa5c1c4f5cd3_3591x2090.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Different tools, same problems.</p><p>That&#8217;s the key.</p><p>Tools keep changing, but the core concepts stay the same.</p><p>If you only learn tools, it becomes very hard to move from one tool to another.</p><p>That&#8217;s why you need to spend some time understanding the fundamentals.</p><p>Things like:</p><ul><li><p>What is a <strong>data warehouse</strong>, <strong>data lake</strong>, <strong>lakehouse</strong></p></li><li><p><strong>ETL vs ELT</strong></p></li><li><p><strong>Batch vs streaming</strong></p></li><li><p><strong>Data modeling</strong> (star schema, snowflake, Data Vault)</p></li></ul><p>You don&#8217;t need to master everything, but you should understand what they are and when to use them.</p><p>Because companies ask about this.</p><blockquote><p>&#8220;Tools change, but concepts stay.&#8221;</p></blockquote><p>So yes, learn tools, but also take time to understand how data engineering actually works.</p><div><hr></div><h2>Mistake 3: Ignoring SQL</h2><p>Ignoring <strong>SQL</strong>. This one really surprises me.</p><p>I&#8217;ve seen many engineers who are good with <strong>Python</strong> and <strong>Spark</strong>, but they struggle with very simple SQL queries, even basic joins.</p><p>A lot of people jump directly into big data tools because they want to work on the &#8220;cool&#8221; stuff.</p><p>But they skip one of the most important skills.</p><p><strong>SQL.</strong></p><p>And sometimes I hear things like: SQL is dead, it&#8217;s not cool, it&#8217;s only for beginners.</p><p>But this is not true.</p><p>In real projects, a huge part of your work still happens in SQL.</p><p>Because almost every platform like <strong>Databricks, Snowflake</strong>, and even tools around <strong>Kafka</strong>, allow you to use SQL to work with data.</p><p>You will use SQL to:</p><ul><li><p>explore data</p></li><li><p>debug issues</p></li><li><p>build transformations</p></li><li><p>apply business logic</p></li></ul><p>For example, in the <strong>Silver layer</strong>, you might use <strong>PySpark</strong>, but very often you also use SQL.</p><p>In the <strong>Gold layer</strong>, you will use SQL heavily for business rules.</p><blockquote><p>&#8220;If your SQL is weak, your daily work becomes harder.&#8221;</p></blockquote><p>So don&#8217;t skip SQL. Start with it, get comfortable, then move to Python and Spark.</p><div><hr></div><h2>Mistake 4: Building Toy Projects</h2><p>Building <strong>toy projects</strong>.</p><p>Projects are very important today. Sometimes they matter more than certificates because they show what you can actually build.</p><p>But most of the projects I see are very small. If you look closely, many of them are just loading one CSV file, cleaning it, and exporting another CSV.</p><p>Yes, technically it&#8217;s a pipeline, but this is not how real data engineering projects look.</p><p>In real scenarios, you work with multiple data sources. Data can come from APIs, databases, files, or even streams. And your job is not only to move data from A to B, but also to handle errors, manage retries, validate data quality, and monitor what is happening in the pipeline.</p><p>You also need to show how you think in terms of architecture. For example, building a lakehouse with Bronze, Silver, and Gold layers, and explaining the role of each one.</p><p>You can also make your project more realistic by adding bad data, testing with larger datasets, and checking how your pipeline performs under pressure.</p><blockquote><p>&#8220;Small projects show effort, but real projects show how you think.&#8221;</p></blockquote><p>So don&#8217;t build many small projects. Build one serious project that looks like a real system.</p><div><hr></div><h2>Mistake 5: Learning Outdated Technologies</h2><p>Learning <strong>outdated technologies</strong>.</p><p>I&#8217;ve seen people follow roadmaps or courses that are already 8 to 10 years old. They spend a lot of time learning things like managing Hadoop clusters, manually configuring Spark, or working heavily with on-premise ETL tools.</p><p>Now don&#8217;t get me wrong, these things were very important in the past.</p><p>But the data ecosystem has changed a lot.</p><p>Today, many companies don&#8217;t want engineers spending their time managing infrastructure. They want them to focus on building pipelines, working with data, and delivering value.</p><p>That&#8217;s why many teams are using platforms like <strong>Databricks</strong> or <strong>Snowflake</strong>, where most of the infrastructure is handled for you.</p><p>So instead of spending months going deep into cluster management and legacy systems, it&#8217;s better to focus on how modern data platforms work and how to build real solutions on top of them.</p><blockquote><p>&#8220;If you prepare for the past, you might miss where the industry is going.&#8221;</p></blockquote><p>Of course, it&#8217;s good to understand the basics of older systems, but don&#8217;t go too deep into them. Focus on the direction the industry is moving today.</p><div><hr></div><h2>Mistake 6: Going to Extremes with AI</h2><p>Going to extremes with <strong>AI</strong>.</p><p>Right now, I see two types of people trying to become data engineers.</p><p>The first group relies completely on AI. They open a tool, generate a data pipeline, copy the code, run it, and move on without really understanding what is happening.</p><p>This becomes a problem very quickly.</p><p>In real projects, things are more complex. You deal with multiple data sources, messy data, and unexpected issues. And when something breaks, you need to understand what is going on to fix it.</p><p>The same thing happens in interviews. If someone asks you why you designed something in a certain way or how you would debug a failure, it becomes difficult to answer if you were only copying code.</p><p>On the other side, there are people who completely ignore AI. They don&#8217;t use it at all, don&#8217;t know how to write prompts, and don&#8217;t take advantage of it.</p><p>This is also a mistake.</p><p>Today, companies expect engineers to know how to use AI to speed up their work, whether it&#8217;s debugging, generating ideas, or improving solutions.</p><blockquote><p>&#8220;AI should support your thinking, not replace it.&#8221;</p></blockquote><p>So the goal is balance. Use AI as a tool to help you, but make sure you understand what you are building.</p><div><hr></div><h1>So &#8230;</h1><p>These are the mistakes I keep seeing again and again from people who feel stuck and struggle to get hired.</p><p>The good part is, none of them are permanent. You can fix all of them.</p><p>You don&#8217;t need more tools, and you don&#8217;t need more random courses.</p><p>You need to focus, go deeper, and actually understand what you are building.</p><p>If you fix these things, you&#8217;ll already be ahead of many others.</p><blockquote><p>&#8220;Getting hired is not about doing more, it&#8217;s about doing the right things well.&#8221;</p></blockquote><p>And if you&#8217;re currently searching for a job, I really hope you land one soon.</p><p>You&#8217;re probably closer than you think.</p><p>The first video is already out, and many more are coming.</p><p>Much love,<br><strong>&#8212; Baraa</strong></p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[The Story of Databricks - Why it exists?]]></title><description><![CDATA[From One Machine to Hadoop to Spark and the Rise of the Databricks Data + AI Platform]]></description><link>https://www.blog.datawithbaraa.com/p/the-story-of-databricks-why-it-exists</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/the-story-of-databricks-why-it-exists</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 10 Mar 2026 13:18:30 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!be6Q!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>I just published the first video in a new series where I&#8217;ll be sharing everything I know about <strong>Databricks</strong>!! &#127881;</p><p>For the past <strong>5 years</strong>, I&#8217;ve been building data projects almost entirely on <strong>one platform: Databricks</strong>. And honestly, it worked like magic.</p><p>So now I want to share everything I&#8217;ve learned from those years of building real projects.</p><p>But if you know my style, you know I don&#8217;t like jumping straight into a tool or platform&#8230; I like to start with the <strong>foundations</strong>.</p><p>The big questions: <strong>What is it? Why does it exist? Who is it actually for?</strong></p><p>The interesting thing is that this platform is <strong>not only for data engineers anymore</strong>.</p><p>Today it&#8217;s used by <strong>data analysts, data scientists, ML engineers, and even AI engineers</strong>.</p><p><strong>let&#8217;s start with the story.</strong></p><div id="youtube2-X5zTCgPN_D4" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;X5zTCgPN_D4&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/X5zTCgPN_D4?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h1>The Single Machine Era</h1><p>In the beginning, everything ran on a <strong>single machine</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!g7o0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!g7o0!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 424w, https://substackcdn.com/image/fetch/$s_!g7o0!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 848w, https://substackcdn.com/image/fetch/$s_!g7o0!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!g7o0!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!g7o0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png" width="634" height="357.4958791208791" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:821,&quot;width&quot;:1456,&quot;resizeWidth&quot;:634,&quot;bytes&quot;:1285612,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!g7o0!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 424w, https://substackcdn.com/image/fetch/$s_!g7o0!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 848w, https://substackcdn.com/image/fetch/$s_!g7o0!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!g7o0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8fdae5f3-7b9e-4c44-9330-4b3089b99334_3830x2159.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Companies stored their data on one server and analysts or engineers ran SQL queries or Python scripts to analyze it. For small datasets this worked perfectly. The machine had enough CPU, memory, and storage to process everything.</p><p>But as companies digitized more of their business, data volumes exploded. Websites started generating event logs. Applications produced telemetry. Businesses began storing historical records for years.</p><p>Suddenly data grew from <strong>gigabytes to terabytes</strong>.</p><p>One machine was no longer enough. Queries took hours. Systems crashed under heavy workloads. And if that single machine failed, the entire analytics process stopped.</p><blockquote><p>One computer works for small data, but it collapses when data becomes massive.</p></blockquote><div><hr></div><h1>The Hadoop Era</h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!VQdf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!VQdf!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 424w, https://substackcdn.com/image/fetch/$s_!VQdf!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 848w, https://substackcdn.com/image/fetch/$s_!VQdf!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 1272w, https://substackcdn.com/image/fetch/$s_!VQdf!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!VQdf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png" width="1456" height="797" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a4170349-b834-450f-a55e-7119a473baea_3757x2057.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:797,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2052908,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!VQdf!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 424w, https://substackcdn.com/image/fetch/$s_!VQdf!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 848w, https://substackcdn.com/image/fetch/$s_!VQdf!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 1272w, https://substackcdn.com/image/fetch/$s_!VQdf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4170349-b834-450f-a55e-7119a473baea_3757x2057.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>To solve this scaling problem, Hadoop introduced <strong>distributed computing</strong>.</p><p>Instead of relying on one powerful computer, Hadoop used many smaller machines working together in a cluster. Data was split across those machines, and each machine processed its piece in parallel.</p><p>This approach allowed companies to process <strong>massive datasets</strong> that were impossible to handle before.</p><p>But Hadoop had a big drawback.</p><p>Every computation required reading data from disk, processing it, and writing it back to disk again.</p><p>Disk operations are slow compared to memory. As datasets grew larger, Hadoop jobs could take hours or even days to complete.</p><blockquote><p>Hadoop solved the scaling problem, but processing data from disk made everything slow.</p></blockquote><div><hr></div><h1>The Spark Era</h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!rU1y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!rU1y!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 424w, https://substackcdn.com/image/fetch/$s_!rU1y!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 848w, https://substackcdn.com/image/fetch/$s_!rU1y!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 1272w, https://substackcdn.com/image/fetch/$s_!rU1y!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!rU1y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png" width="1456" height="788" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:788,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2441185,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!rU1y!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 424w, https://substackcdn.com/image/fetch/$s_!rU1y!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 848w, https://substackcdn.com/image/fetch/$s_!rU1y!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 1272w, https://substackcdn.com/image/fetch/$s_!rU1y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9b043ab-cee3-4f8b-899a-1115133a307b_3790x2051.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Spark was created to solve the <strong>speed problem</strong>.</p><p>It kept the distributed system idea from Hadoop but changed how computations happened.</p><p>Instead of constantly reading and writing to disk, Spark processed data <strong>in memory whenever possible</strong>.</p><p>Memory operations are dramatically faster than disk operations. This made Spark many times faster for most workloads.</p><p>Companies quickly adopted Spark as the new standard for big data processing.</p><p>But there was another issue.</p><p>Early Spark development required knowledge of <strong>Scala or Java</strong>, which limited who could use it. Most analysts and data scientists were not comfortable with those languages.</p><blockquote><p>Spark made big data fast, but it was still difficult for many data professionals to use.</p></blockquote><div><hr></div><h1>The PySpark Era</h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!U1Jt!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!U1Jt!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 424w, https://substackcdn.com/image/fetch/$s_!U1Jt!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 848w, https://substackcdn.com/image/fetch/$s_!U1Jt!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 1272w, https://substackcdn.com/image/fetch/$s_!U1Jt!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!U1Jt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png" width="1456" height="805" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:805,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2443518,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!U1Jt!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 424w, https://substackcdn.com/image/fetch/$s_!U1Jt!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 848w, https://substackcdn.com/image/fetch/$s_!U1Jt!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 1272w, https://substackcdn.com/image/fetch/$s_!U1Jt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b12e3d-37ce-4784-889a-feb5d6a9a75d_3812x2108.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>At the same time, Python was becoming the dominant language for data science.</p><p>Libraries like Pandas, NumPy, and Scikit-learn made Python extremely popular for data analysis and machine learning.</p><p>To connect these worlds, <strong>PySpark</strong> was introduced.</p><p>PySpark allowed developers to write Spark programs using Python while still benefiting from distributed computing.</p><p>This opened big data processing to a much larger audience.</p><p>However, running Spark at scale was still complicated. Engineers had to configure clusters, manage resources, monitor failures, and handle infrastructure issues.</p><p>Before even writing data pipelines, teams often spent weeks setting up the environment.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Bpxb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Bpxb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 424w, https://substackcdn.com/image/fetch/$s_!Bpxb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 848w, https://substackcdn.com/image/fetch/$s_!Bpxb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 1272w, https://substackcdn.com/image/fetch/$s_!Bpxb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Bpxb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png" width="684" height="412.9368131868132" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:879,&quot;width&quot;:1456,&quot;resizeWidth&quot;:684,&quot;bytes&quot;:2851169,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Bpxb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 424w, https://substackcdn.com/image/fetch/$s_!Bpxb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 848w, https://substackcdn.com/image/fetch/$s_!Bpxb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 1272w, https://substackcdn.com/image/fetch/$s_!Bpxb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F92fe0da2-dbca-4adb-bf08-bd4ce1b0acc1_3404x2056.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><blockquote><p>PySpark made big data accessible, but managing the infrastructure remained painful.</p></blockquote><div><hr></div><h1>Databricks as a Big Data (Managed Spark) Tool</h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tnM3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tnM3!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 424w, https://substackcdn.com/image/fetch/$s_!tnM3!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 848w, https://substackcdn.com/image/fetch/$s_!tnM3!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 1272w, https://substackcdn.com/image/fetch/$s_!tnM3!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tnM3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png" width="1456" height="876" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:876,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2748771,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tnM3!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 424w, https://substackcdn.com/image/fetch/$s_!tnM3!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 848w, https://substackcdn.com/image/fetch/$s_!tnM3!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 1272w, https://substackcdn.com/image/fetch/$s_!tnM3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F680e9121-8341-4480-89a4-1c2f51dd346e_3482x2096.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>To remove this operational burden, the creators of Spark founded <strong>Databricks</strong>.</p><p>The idea was to provide Spark as a <strong>fully managed platform</strong>.</p><p>Instead of configuring clusters manually, teams could run workloads on a platform where infrastructure, scaling, and environment setup were handled automatically.</p><p>This allowed engineers and analysts to focus on <strong>building data pipelines, running analysis, and developing models</strong>.</p><p>But a new problem appeared.</p><p>Because storage became cheap and easy, companies began dumping huge amounts of raw data into <strong>data lakes</strong>.</p><p>Over time, many of these lakes became messy. Schemas changed, data quality dropped, and teams lost trust in the datasets.</p><p>People started calling them <strong>data swamps</strong>.</p><blockquote><p>Managed platforms simplified infrastructure, but uncontrolled data lakes created chaos.</p></blockquote><div><hr></div><h1>Databricks as Data Platform ( Data Lakehouse &amp; SQL)</h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!euNG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!euNG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 424w, https://substackcdn.com/image/fetch/$s_!euNG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 848w, https://substackcdn.com/image/fetch/$s_!euNG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 1272w, https://substackcdn.com/image/fetch/$s_!euNG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!euNG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png" width="1456" height="822" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:822,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3584715,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!euNG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 424w, https://substackcdn.com/image/fetch/$s_!euNG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 848w, https://substackcdn.com/image/fetch/$s_!euNG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 1272w, https://substackcdn.com/image/fetch/$s_!euNG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d7a2f75-5060-403b-bc9d-b21f9592e0b2_3746x2114.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>To fix the chaos of data lakes, Databricks introduced the <strong>Lakehouse architecture</strong>.</p><p>The goal was to combine the best parts of two worlds:</p><p>Data lakes for scalability and flexibility.<br>Data warehouses for reliability and structured analytics.</p><p>Using technologies like <strong>Delta Lake</strong>, data lakes gained important capabilities such as transactions, schema enforcement, and versioning.</p><p>At the same time, Databricks introduced powerful <strong>SQL capabilities</strong>, allowing analysts to query the same data layer using familiar tools.</p><p>This meant engineers, analysts, and data scientists could all collaborate on <strong>the same platform and the same data</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!D3EG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!D3EG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 424w, https://substackcdn.com/image/fetch/$s_!D3EG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 848w, https://substackcdn.com/image/fetch/$s_!D3EG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 1272w, https://substackcdn.com/image/fetch/$s_!D3EG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!D3EG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png" width="1456" height="794" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:794,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2578527,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!D3EG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 424w, https://substackcdn.com/image/fetch/$s_!D3EG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 848w, https://substackcdn.com/image/fetch/$s_!D3EG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 1272w, https://substackcdn.com/image/fetch/$s_!D3EG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7184d7d0-cef9-4ab7-bb82-a70716880c95_3822x2084.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!eR8g!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!eR8g!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 424w, https://substackcdn.com/image/fetch/$s_!eR8g!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 848w, https://substackcdn.com/image/fetch/$s_!eR8g!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!eR8g!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!eR8g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png" width="1456" height="996" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:996,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2498174,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!eR8g!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 424w, https://substackcdn.com/image/fetch/$s_!eR8g!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 848w, https://substackcdn.com/image/fetch/$s_!eR8g!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!eR8g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10ba7106-719c-4f5e-b9af-ccd4fba6936a_3157x2159.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><p>However, as organizations grew larger, another challenge emerged. Data governance.</p><blockquote><p>The Lakehouse unified the data stack, but large organizations needed strong governance.</p></blockquote><div><hr></div><h1>The Unity Catalog Era</h1><p>In enterprise environments, managing data access is critical.</p><p>Companies must control who can see which datasets, track how data flows across systems, and ensure compliance with regulations.</p><p>Without governance, data platforms quickly become risky and unmanageable.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Uc-P!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Uc-P!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 424w, https://substackcdn.com/image/fetch/$s_!Uc-P!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 848w, https://substackcdn.com/image/fetch/$s_!Uc-P!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 1272w, https://substackcdn.com/image/fetch/$s_!Uc-P!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Uc-P!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png" width="1456" height="817" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:817,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2956785,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Uc-P!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 424w, https://substackcdn.com/image/fetch/$s_!Uc-P!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 848w, https://substackcdn.com/image/fetch/$s_!Uc-P!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 1272w, https://substackcdn.com/image/fetch/$s_!Uc-P!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef244a96-3625-4b13-a2fa-3ef2ac2fe4b1_3802x2134.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>To address this, Databricks introduced <strong>Unity Catalog</strong>.</p><p>Unity Catalog centralizes governance across the platform. It manages catalogs, schemas, tables, permissions, and lineage in one place.</p><p>This allows organizations to maintain security, transparency, and compliance while still enabling collaboration.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tkjW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tkjW!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 424w, https://substackcdn.com/image/fetch/$s_!tkjW!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 848w, https://substackcdn.com/image/fetch/$s_!tkjW!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!tkjW!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tkjW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3683697,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tkjW!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 424w, https://substackcdn.com/image/fetch/$s_!tkjW!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 848w, https://substackcdn.com/image/fetch/$s_!tkjW!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!tkjW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73576333-8ce6-449a-9bdb-3613d69c5278_3838x2159.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><blockquote><p>As data platforms scale across organizations, governance becomes essential.</p></blockquote><div><hr></div><h1>Databricks as Data &amp; AI platform</h1><p>The industry is now shifting again, this time because of <strong>AI</strong>.</p><p>Companies want to build intelligent systems using their data. But in many organizations a new problem appeared.</p><p>The <strong>data lived in the data platform</strong>, while <strong>AI engineers were building systems somewhere else</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Bwku!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Bwku!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 424w, https://substackcdn.com/image/fetch/$s_!Bwku!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 848w, https://substackcdn.com/image/fetch/$s_!Bwku!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!Bwku!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Bwku!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3683697,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Bwku!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 424w, https://substackcdn.com/image/fetch/$s_!Bwku!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 848w, https://substackcdn.com/image/fetch/$s_!Bwku!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 1272w, https://substackcdn.com/image/fetch/$s_!Bwku!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc621773e-28ae-49cc-874f-56983ccc0fea_3838x2159.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>To create AI applications, teams had to build separate infrastructure for model training, LLM integration, and deployment. This created another fragmented architecture.</p><p>To solve this, Databricks extended the platform with <strong>Mosaic AI</strong>.</p><p>Mosaic AI allows teams to build, train, and deploy AI systems directly inside the platform, using the same data and infrastructure.</p><p>This means data pipelines, analytics, machine learning, and AI applications can now live <strong>in one place</strong>.</p><p>Databricks evolved once again.</p><p>Not just into a data platform, but into a <strong>Data + AI platform</strong>.</p><blockquote><p>The future of data platforms is bringing AI development directly where the data lives.</p></blockquote><div><hr></div><h1>So &#8230;</h1><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!be6Q!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!be6Q!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!be6Q!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!be6Q!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!be6Q!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!be6Q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3884360,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/190501442?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!be6Q!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!be6Q!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!be6Q!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!be6Q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23023e79-7105-4045-b599-3f8d2810edad_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>If we step back and look at this entire journey, we can see something interesting.</p><p>Every generation of technology solved one major problem.</p><ul><li><p>Single machines worked for small datasets.</p></li><li><p>Hadoop made it possible to scale to massive data.</p></li><li><p>Spark made big data processing fast.</p></li><li><p>PySpark opened the door for Python users.</p></li><li><p>Databricks removed the complexity of managing infrastructure.</p></li><li><p>The Lakehouse unified data lakes and data warehouses.</p></li><li><p>Unity Catalog introduced governance for enterprise environments.</p></li><li><p>And today the platform continues evolving into a <strong>Data + AI platform</strong>.</p></li></ul><p>Databricks is a <strong>unified platform where data engineering, analytics, machine learning, and AI development happen in one place</strong>.</p><p></p><p>If you want to understand how modern data platforms actually work, <strong>join me on YouTube</strong>. I&#8217;ll be sharing much more content like this in the coming weeks.</p><p>The first video is already out, and many more are coming.</p><p>Much love,<br><strong>&#8212; Baraa</strong></p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[My 13-Hour Python Masterclass is Finally Here (And It’s Free)]]></title><description><![CDATA[A year in the making. Hand-drawn visuals, real projects, zero fluff. From beginner to advanced &#8212; all on YouTube.]]></description><link>https://www.blog.datawithbaraa.com/p/my-13-hour-python-masterclass-is</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/my-13-hour-python-masterclass-is</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 24 Feb 2026 12:56:16 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/e3d435e6-17f3-4e2e-b17f-bb26f5fc642c_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends, Happy Tuesday!</strong></p><p>The waiting is finally over. I&#8217;ve waited more than a year to write these words&#8230; and today is the day.</p><p><strong>&#127881; My full 13-hour Python course, taking you from absolute beginner to confident Python developer, is officially LIVE! &#127881;</strong></p><p>Let&#8217;s go.</p><div id="youtube2-Rq5gJVxz55Q" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;Rq5gJVxz55Q&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/Rq5gJVxz55Q?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h1>Why You Should Learn Python in 2026?</h1><p>Look around at what is shaping technology today.</p><p>AI assistants. Data platforms. Smart automation. Cloud systems.<br>Behind almost all of it, there is Python.</p><p>It has quietly become the language that powers modern innovation.</p><p>If you want to step into AI, data engineering, analytics, backend development, or simply become more efficient in your current job, Python opens that door. It connects tools, systems, and ideas together.</p><p>And if you are new to coding, you might think this world is not for you. But here is the truth: Python was designed to be readable, logical, and approachable. You do not need a computer science degree to start. You just need curiosity and consistency.</p><p>For data analysts especially, Python is a game changer. It transforms you from someone who works inside tools&#8230; to someone who can build solutions beyond them.</p><blockquote><p>Python is not just a skill. It is a language of leverage.</p></blockquote><div><hr></div><h2>Quick Guide to Content</h2><h4>1&#65039;&#8419; Free The Core Content</h4><p>&#128073; <strong><a href="https://youtu.be/Rq5gJVxz55Q">Watch on YouTube</a><br></strong>The complete 13-hour Python course, available for free:</p><ul><li><p>All lessons and chapters</p></li><li><p>All built-in challenges</p></li></ul><h4>2&#65039;&#8419; The Handbook &amp; Code Bundle</h4><p>&#128073; <strong><a href="https://academy.datawithbaraa.com/l/digital_download/998313/the-python-handbook">Get the Handbook</a><br></strong>A structured reference system that supports the full course:</p><ul><li><p>Complete Python <strong>Handbook </strong>(PDF)</p></li><li><p>All <strong>sketches </strong>organized with clean notes</p></li><li><p><strong>Best practices</strong> &amp; real industry insights</p></li><li><p>Structured Python source <strong>code </strong>and <strong>solutions </strong>for all challenges &amp; projects.</p></li></ul><h4>3&#65039;&#8419; Data Academy: The Full Package</h4><p>&#128073; <strong><a href="https://www.datawithbaraa.com/course/the-ultimate-python-mastery">Enroll in the Full Program</a><br></strong>A guided learning platform that includes everything in one structured system:</p><ul><li><p><strong>Structured </strong>curriculum with <strong>progress </strong>tracking</p></li><li><p>Python <strong>Handbook </strong>PDF &amp; Codes</p></li><li><p><strong>Quizzes </strong>&amp; Exercises</p></li><li><p>3 real-world Python <strong>Projects</strong></p></li><li><p><strong>Certificate </strong>of completion</p></li><li><p>Lifetime access &amp; future updates</p></li></ul><p></p><blockquote><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!zDUq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!zDUq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 424w, https://substackcdn.com/image/fetch/$s_!zDUq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 848w, https://substackcdn.com/image/fetch/$s_!zDUq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 1272w, https://substackcdn.com/image/fetch/$s_!zDUq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!zDUq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png" width="310" height="229.61839530332682" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:757,&quot;width&quot;:1022,&quot;resizeWidth&quot;:310,&quot;bytes&quot;:1413699,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/188887297?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd1f418f-825e-4bef-b897-a2715b0eb384_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!zDUq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 424w, https://substackcdn.com/image/fetch/$s_!zDUq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 848w, https://substackcdn.com/image/fetch/$s_!zDUq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 1272w, https://substackcdn.com/image/fetch/$s_!zDUq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc66d0efc-ce0d-4559-9252-dad179e8a747_1022x757.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>If you are a student with financial limitations and want access to the full program with certificate, comment &#8220;<strong>Python</strong>&#8221; under my <strong><a href="https://www.linkedin.com/posts/baraa-khatib-salkini_python-learnpython-activity-7432044159063969793-LZTO?utm_source=share&amp;utm_medium=member_desktop&amp;rcm=ACoAAAu78_UBLcqM6ziEqlZw9RKL2lDSVeWmNGs">LinkedIn post</a></strong> and I will send you Free Access Link (Limited for 100 Enrollments)</p></blockquote><div><hr></div><h3>A Year in the Making</h3><p>For more than a year, I worked on this course during weekends, late nights, and early mornings next to my full time job. It was not rushed. It was built slowly and intentionally, with one clear goal in mind</p><p>.</p><blockquote><p><strong>Not just to teach Python, but to help you think in Python.</strong></p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!9EvT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!9EvT!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!9EvT!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!9EvT!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!9EvT!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!9EvT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png" width="600" height="337.5" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:600,&quot;bytes&quot;:7537209,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/188887297?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!9EvT!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!9EvT!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!9EvT!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!9EvT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F397ff787-5276-4a80-b5ce-66dbd428b668_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I didn&#8217;t want this to be just another <em>screen recording</em> where you watch someone type for hours and try to keep up. That kind of learning feels productive in the moment, but a week later most of it fades.</p><p>If you know me, you know that&#8217;s not my style.</p><p>I wanted you to understand what really happens <em>behind the scenes</em>. What a variable actually is. How memory works. Why a loop behaves the way it does. What truly happens when you call a function.</p><p>That is why I hand drew every single visual myself on my iPad using Procreate. Every diagram, every flow, every explanation was created manually. I broke down each concept into simple visual animations, because when you can <strong>see the logic</strong>, it becomes clear. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!OBec!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!OBec!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!OBec!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!OBec!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!OBec!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!OBec!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2567110,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/188887297?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!OBec!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!OBec!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!OBec!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!OBec!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9878162c-b963-4132-a175-a89f0868aabd_3840x2160.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>And once you see it clearly, you do not just write code. You write it with <strong>confidence and understanding</strong>.</p><div><hr></div><h2>What&#8217;s Inside the Course?</h2><p><strong><a href="https://mm.tt/map/3916039125?t=ou8ZR0zayk">Link to Mindmap</a></strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!q0rw!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!q0rw!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 424w, https://substackcdn.com/image/fetch/$s_!q0rw!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 848w, https://substackcdn.com/image/fetch/$s_!q0rw!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 1272w, https://substackcdn.com/image/fetch/$s_!q0rw!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!q0rw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png" width="728" height="255.5581044370661" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1163,&quot;width&quot;:3313,&quot;resizeWidth&quot;:728,&quot;bytes&quot;:267520,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/188887297?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e77daa1-52d1-4d20-b880-5a4827427214_3764x1901.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!q0rw!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 424w, https://substackcdn.com/image/fetch/$s_!q0rw!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 848w, https://substackcdn.com/image/fetch/$s_!q0rw!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 1272w, https://substackcdn.com/image/fetch/$s_!q0rw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F273bc084-eb3c-4cd9-b91c-3a7d15da2df3_3313x1163.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>1&#65039;&#8419; Python Foundations</strong></p><p>&#8226; What Python is and how it works<br>&#8226; Installation and setup<br>&#8226; Comments and output<br>&#8226; Variables and user input<br>&#8226; Core data types</p><p><strong>2&#65039;&#8419; Working with Strings</strong></p><p>&#8226; String fundamentals and transformations<br>&#8226; Indexing and slicing<br>&#8226; Searching, validation, and formatting</p><p><strong>3&#65039;&#8419; Working with Numbers</strong></p><p>&#8226; Integers and floats<br>&#8226; Mathematical operations<br>&#8226; Rounding, randomness, and validation</p><p><strong>4&#65039;&#8419; Logic and Operators</strong></p><p>&#8226; Boolean values<br>&#8226; Comparison and logical operators<br>&#8226; Membership and identity</p><p><strong>5&#65039;&#8419; Conditional Statements</strong></p><p>&#8226; If, elif, else<br>&#8226; Nested conditions<br>&#8226; Inline if and match case</p><p><strong>6&#65039;&#8419; Loops</strong></p><p>&#8226; For loops<br>&#8226; While loops<br>&#8226; Break, continue, pass<br>&#8226; Nested loops and for-else</p><p><strong>7&#65039;&#8419; Data Structures</strong></p><p>&#8226; Lists with deep dive into tools.<br>&#8226; Tuples<br>&#8226; Sets<br>&#8226; Dictionaries</p><p><strong>8&#65039;&#8419; Functions</strong></p><p>&#8226; Writing and structuring functions<br>&#8226; Parameters and return values<br>&#8226; Different types of functions<br>&#8226; Clean and reusable design</p><div><hr></div><h2>&#10084;&#65039; If You Appreciate It, Help Me Spread It</h2><p>This course is free. No ads. No sponsors. Just me, sharing my knowledge<br>So if you find it helpful, please consider helping me spread the word:</p><p>&#128077; Like<br>&#128172; Comment<br>&#128226; Share with friends<br>&#128233; Send it to that one person who <em>needs</em> to learn Python<br>&#128250; Subscribe on YouTube</p><p> It helps the YouTube algorithm show this content to other amazing learners like you.</p><div><hr></div><p>Thanks for being part of this journey.<br>Now go dive in and explore Python like never before.<br>Let&#8217;s make learning fun again &#128640;</p><p>Much love,<br><strong>&#8212; Baraa</strong></p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[I'm 40. If you're in your 20s or 30s Read This:]]></title><description><![CDATA[22 Rules (time, money, work, and life) I wish I knew earlier]]></description><link>https://www.blog.datawithbaraa.com/p/im-40-if-youre-in-your-20s-or-30s</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/im-40-if-youre-in-your-20s-or-30s</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 10 Feb 2026 13:02:52 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/RPuPP-wrbEo" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I just turned 40, and without any dramatic moment, I realized how much I&#8217;ve changed. I&#8217;m not the same person I was in my twenties, or even in my thirties. I&#8217;ve rushed things that needed time, waited when I should have moved, and listened to voices that were never meant to guide my life.</p><div id="youtube2-RPuPP-wrbEo" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;RPuPP-wrbEo&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/RPuPP-wrbEo?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>Over the years, life taught me lessons the hard way about time, work, money, relationships, and myself. This post is not advice or a formula to follow. These are simply the rules I live by today, shaped by experience and mistakes.</p><p>Take what resonates with you. Leave the rest.</p><div><hr></div><h2>Rule 01 &#8211; Everything Takes Time</h2><p>Nothing real grows fast:</p><p>&#8226; Your body changes slowly<br>&#8226; Your skills compound slowly<br>&#8226; Your money grows slowly</p><p>Modern life sells speed. Fast results. Instant change. Those shortcuts always charge interest later.</p><p>Time will pass anyway. Build things that last.</p><blockquote><p>&#8220;The long path is the real shortcut.&#8221;</p></blockquote><div><hr></div><h2>Rule 02 &#8211; It Is Never Too Late</h2><p>Being &#8220;too late&#8221; is usually just fear in disguise.</p><p>I&#8217;ve seen capable people stop themselves because they compare timelines and assume they missed their chance. Time doesn&#8217;t care. It keeps moving whether you act or not.</p><p>Every meaningful thing in my life started later than I thought it should. Starting anyway changed everything.</p><blockquote><p>It is never too late. Time will move forward with or without you.</p></blockquote><div><hr></div><h2>Rule 03 &#8211; Don&#8217;t Talk About Your Plans</h2><p>Talking creates a fake sense of progress.</p><p>When you explain your plans in detail, your brain feels rewarded before the work is done. Encouragement replaces execution. Energy leaks into words instead of action.</p><p>Share direction if you must. Keep details to yourself. Work quietly.</p><blockquote><p>&#8220;Execute first,  Show results later, Celebrate after!&#8221;</p></blockquote><div><hr></div><h2>Rule 04 &#8211; Don&#8217;t Compare Yourself With Others</h2><p>Comparison never tells the full story.</p><p>Everyone starts from a different place. Different backgrounds, support, timing, and luck. Timelines are not comparable.</p><p>You only see the wins. You don&#8217;t see the sacrifices, the struggles, or the failures behind them. That&#8217;s why copying someone else&#8217;s path never works.</p><blockquote><p>&#8220;Run your own race. Comparison leads nowhere&#8221;</p></blockquote><div><hr></div><h2>Rule 05 &#8211; My Life. My Rules</h2><p>Everyone has an opinion about how you should live. Family. Culture. Social media. The system.</p><p>If you let those voices decide for you, you slowly lose control.</p><p>I listen to advice. I think about it. But I keep the final decision. This is my life, and I live with the consequences.</p><blockquote><p>&#8220;Live your own life, or you will end up living someone else&#8217;s.&#8221;</p></blockquote><div><hr></div><h2>Rule 06 &#8211; Take Ownership of Your Life</h2><p>Blame feels comforting, but it keeps you powerless.</p><p>Life is unfair. Complaining and blaming only focus your energy on what you can&#8217;t control.</p><p>Change the question. Stop asking <em><strong>&#8220;Why is this happening to me?&#8221;</strong></em> and start asking <br><em><strong>&#8220;What can I do about it?&#8221;</strong></em> There is almost always something.</p><p>Ownership gives you control back.</p><blockquote><p>&#8220;Take ownership, or stay stuck.&#8221;</p></blockquote><div><hr></div><h2>Rule 07 &#8211; Be Careful What You Consume</h2><p>Most content is designed to trigger you.</p><p>Fear. Urgency. Anxiety. Different platforms, same game. Click now. You&#8217;re late. You&#8217;ll regret it.</p><p>News sells fear. Social media sells perfect lives. After a while, you start thinking something is wrong with you.</p><p>Nothing is wrong with you. Real life is quieter, slower, and more normal.</p><blockquote><p>&#8220;Protect your mind. Most content is designed to trigger, not to help.&#8221;</p></blockquote><div><hr></div><h2>Rule 08 &#8211; No One Is Coming to Save You</h2><p>When life gets hard, it&#8217;s easy to wait. For help. For luck. For someone to fix things.</p><p>Support may come, but no one can fix your life for you. That responsibility never leaves your hands.</p><p>Waiting keeps you stuck. Showing up for yourself moves you forward.</p><blockquote><p>&#8220;Only you can fix your life.&#8221;</p></blockquote><div><hr></div><h2>Rule 09 &#8211; Protect Your Relationship</h2><p>Your partner is often the longest relationship in your life.</p><ul><li><p>Parents grow older and leave us.</p></li><li><p>Children grow up and move on.</p></li><li><p>Friends get busy with work and family.</p></li></ul><p>A relationship is not a competition. There is no winning an argument. If one person loses, both lose.</p><p>Protect it, especially when things get hard.</p><blockquote><p>&#8220;Protect your relationship. It is the longest one you will ever have.&#8221;</p></blockquote><div><hr></div><h2>Rule 10 &#8211; Forgive to Move On</h2><p>This one is hard.</p><p><strong>Forgive your parents</strong>. They are not perfect. They made mistakes, often without bad intentions. They come from a different generation, with different tools. You cannot change that anymore. Forgiveness frees your energy.</p><p>Stay in touch. Call them. A short call is enough. Time moves faster than you think, and one day you will wish you had more of it.</p><p><strong>Forgive yourself too</strong>. You will make mistakes. Learn, adjust, and move forward.</p><blockquote><p>&#8220;Forgiveness makes you lighter. Lighter people move faster.&#8221;</p></blockquote><div><hr></div><h2>Rule 11 &#8211; Review &amp; Redesign Your Habits</h2><p>Once a year, I take time to redesign my life.</p><p>I sit down alone, without distractions, and draw a simple timeline with three versions of myself: my younger self, my current self, and my future self. </p><p>I ask:</p><blockquote><ul><li><p><em>&#8220;What did I do well? What mistakes did I make?&#8221;</em></p></li><li><p><em>&#8220;Who do I want to become next?&#8221;</em></p></li></ul></blockquote><p>To answer that, I use a simple framework with five columns:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!kNGF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kNGF!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 424w, https://substackcdn.com/image/fetch/$s_!kNGF!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 848w, https://substackcdn.com/image/fetch/$s_!kNGF!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 1272w, https://substackcdn.com/image/fetch/$s_!kNGF!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!kNGF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png" width="1456" height="399" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:399,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:764817,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/187368692?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kNGF!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 424w, https://substackcdn.com/image/fetch/$s_!kNGF!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 848w, https://substackcdn.com/image/fetch/$s_!kNGF!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 1272w, https://substackcdn.com/image/fetch/$s_!kNGF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9cf1c8b-8bfa-4174-b3f9-9b3262514bdd_3661x1002.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>&#8226; <strong>Keep</strong> &#8211; habits that already work<br>&#8226; <strong>Start</strong> &#8211; habits I want to add<br>&#8226; <strong>Stop</strong> &#8211; habits that hurt me<br>&#8226; <strong>More</strong> &#8211; good habits I want more of<br>&#8226; <strong>Less</strong> &#8211; things I need to reduce</p><blockquote><p>&#8220;Small habit changes, reviewed regularly, shape a better version of you each year..&#8221;</p></blockquote><div><hr></div><h2>Rule 12 &#8211; Daily 30-Minute Walks</h2><p>Walking clears my mind better than anything else.</p><p>Almost every day, I walk for 30 minutes. No phone. No music. No podcasts. Just walking.</p><p>Big decisions become smaller when you walk. Problems simplify. Sleep improves. Clarity follows.</p><p>It costs nothing, but over time, it changes everything.</p><blockquote><p>&#8220;It costs nothing! Walk daily. Clarity follows.&#8221;</p></blockquote><div><hr></div><h2>Rule 13 &#8211; Divide Your Day Based on Energy</h2><p>I don&#8217;t manage my time. I manage my energy.</p><p>I split my day into three phases.</p><ul><li><p><strong>Mornings </strong>are for deep work. This is when my energy is highest. Writing, planning, solving hard problems. I protect this time.</p></li><li><p><strong>Midday </strong>is for communication. Meetings, emails, conversations. Useful work, but not deep work.</p></li><li><p><strong>Evenings </strong>are for life. Family, movement, rest. No big decisions. No hard problems.</p></li></ul><p>I am not productive all day, and that&#8217;s fine. I am productive when it matters.</p><blockquote><p>&#8220;Understand your energy, then plan your day around it.&#8221;</p></blockquote><div><hr></div><h2>Rule 14 &#8211; Three Levels of Learning</h2><p>Learning something new happens in three levels.</p><p>I split my day into three phases.</p><p><strong>Level 1: Consuming</strong><br>You watch videos, read books, listen to podcasts. You understand the idea, but watching someone else do something does not mean you can do it. This level only opens the door.</p><p><strong>Level 2: Practicing</strong><br>This is where learning becomes real. You try, you get stuck, you make mistakes, and you move slowly. The struggle is not a problem. It is how knowledge is built in your brain.</p><p><strong>Level 3: Teaching</strong><br>This is the hidden level. When you explain something to others, you discover what you don&#8217;t fully understand. Teaching forces clarity, structure, and fills the gaps.</p><blockquote><p>&#8220;You don&#8217;t really learn until you practice, and you don&#8217;t fully understand until you teach.&#8221;</p></blockquote><div><hr></div><h2>Rule 15 &#8211; Learn Financial Literacy</h2><p>I never understood why the most important life skill, how money works, is not taught in school.</p><p>Financial literacy is not about getting rich fast. It is about avoiding expensive mistakes and protecting yourself. Without it, decisions are based on guessing and trends, and that usually ends in loss.</p><p>A few simple rules I follow:</p><ul><li><p>Live below your means</p></li><li><p>If you can&#8217;t explain where your money goes, you&#8217;re not in control</p></li><li><p>Always keep an emergency buffer</p></li><li><p>Don&#8217;t rely on one income source</p></li><li><p>Get-rich-fast is a scam</p></li><li><p>Don&#8217;t try to time the market</p></li></ul><blockquote><p>&#8220;Learn how money works before money teaches you the hard way.&#8221;</p></blockquote><div><hr></div><h2>Rule 16 &#8211; Stability First, Freedom Later</h2><p>This is the money model that worked for me.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tPNP!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tPNP!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 424w, https://substackcdn.com/image/fetch/$s_!tPNP!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 848w, https://substackcdn.com/image/fetch/$s_!tPNP!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 1272w, https://substackcdn.com/image/fetch/$s_!tPNP!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tPNP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png" width="650" height="397.32142857142856" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:890,&quot;width&quot;:1456,&quot;resizeWidth&quot;:650,&quot;bytes&quot;:1004055,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.blog.datawithbaraa.com/i/187368692?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tPNP!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 424w, https://substackcdn.com/image/fetch/$s_!tPNP!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 848w, https://substackcdn.com/image/fetch/$s_!tPNP!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 1272w, https://substackcdn.com/image/fetch/$s_!tPNP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd897746b-3d70-4238-a82c-b5ff5187afd8_3037x1856.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>Step 1: Get a stable job.</strong><br>Nothing fancy. Work, get paid. This phase gives stability and a strong base.</p><p><strong>Step 2: Invest what&#8217;s left.</strong><br>Even a small amount. Over time, money and time work quietly in the background.</p><p>Most people stop here, and that&#8217;s okay. But you still depend on one job.</p><p><strong>Step 3: Build side projects.</strong><br>Something you enjoy. Something that takes time. It may fail, and that&#8217;s fine. You gain skills. Or it grows and creates freedom. That&#8217;s what happened to me.</p><blockquote><p>&#8220;Stability first. Freedom later. No shortcuts.&#8221;</p></blockquote><div><hr></div><h2>Rule 17 &#8211; Play the Long Game</h2><p>I invest simply and consistently.</p><p>No daily tracking. No news watching. No stress. I invest regularly and leave it alone.</p><p>Yes, some people got rich fast with things like Bitcoin. Many more lost money just as fast, and those stories rarely make it to the media. That&#8217;s not my style.</p><p>I don&#8217;t chase luck. I build slowly.</p><blockquote><p>&#8220;Simple, consistent, and long-term beats stress and guessing.&#8221;</p></blockquote><div><hr></div><h2>Rule 18 &#8211; Complaining Is a Career Killer</h2><p>Every job has problems. That&#8217;s normal. The mistake is dealing with them by constantly complaining.</p><p>Repeated complaining drains the energy of motivated people and adds weight to those who are already struggling. Over time, you get labeled as negative, people avoid you, and you slowly damage the team culture.</p><p>There are only three healthy ways to deal with problems at work:</p><p>&#8226; <strong>Ignore it</strong> if it&#8217;s out of your control<br>&#8226; <strong>Fix it</strong> by bringing a solution, not just a complaint<br>&#8226; <strong>Leave</strong> if it truly matters and nothing changes</p><blockquote><p>&#8220;Fix it, ignore it, or leave. Complaining kills careers..&#8221;</p></blockquote><div><hr></div><h2>Rule 19 &#8211; Know When to Stay and When to Leave</h2><p>If your ideas are always ignored and nothing changes, it&#8217;s time to leave.</p><p>I don&#8217;t leave just because work gets hard. Pressure and disagreements exist everywhere. But I never stay where there is no respect. Once an environment becomes toxic, that is a clear signal.</p><p>The other danger is staying too long. Comfort can stop growth. When learning stops, risk starts.</p><blockquote><p><strong>My rules:</strong><br>&#8226; Don&#8217;t leave because it&#8217;s hard<br>&#8226; Don&#8217;t stay without respect<br>&#8226; Don&#8217;t stay too long without learning</p></blockquote><div><hr></div><h2>Rule 20 &#8211; Don&#8217;t Burn Out. Don&#8217;t Check Out</h2><p>At work, I&#8217;ve seen two extremes:</p><p><strong>The Burnout Trap</strong><br>Long hours. No rest. No life outside work. Health and relationships get sacrificed with the hope that the job will take care of you. Most of the time, it doesn&#8217;t.</p><p><strong>The Checked-Out Trap</strong><br>Doing the bare minimum. Avoiding responsibility. Waiting for the day to end. Work already takes part of your life. Hiding from it gives nothing back.</p><p>Both extremes lead to the same place.</p><blockquote><p>&#8220;Give your best without burning out. Stay engaged without losing your life.&#8221;</p></blockquote><div><hr></div><h2>Rule 21 &#8211; Colleagues Are Not Friends</h2><p>People at work can be friendly, but work is still work. When you forget that, you overshare, and it often comes back to hurt you.</p><blockquote><p>&#8220;Be kind. Be respectful. Be professional.&#8221;</p></blockquote><div><hr></div><h2>Rule 22 &#8211; Communicate Your Work</h2><p>I&#8217;ve seen many great people do great work that no one knows about. Not because it isn&#8217;t valuable, but because no one is tracking it.</p><p>People are busy. If you stay silent, your value stays invisible.</p><p>If you&#8217;ve built something useful, share it. Write about it. Present it to your team. Talk about it. This is not bragging. Someone out there needs what you built and doesn&#8217;t know it exists.</p><p>Clear communication helps others, and it helps you. Your work gets recognized, your impact becomes visible, and opportunities follow.</p><blockquote><p>&#8220;Good work unseen is good work wasted.&#8221;</p></blockquote><div><hr></div><h2>So my friends,</h2><p>These are the rules I live by today. I&#8217;m somewhere in the middle of my life, and I know I&#8217;ll still make mistakes. But I&#8217;m committed to learning from them.</p><p>If I had to reduce everything to a few foundations, it would be this: </p><ul><li><p>I play the long game. I don&#8217;t rush.</p></li><li><p> I don&#8217;t take things personally, because most things aren&#8217;t about me. </p></li><li><p>I don&#8217;t live my life based on other people&#8217;s expectations.</p></li><li><p>I never lose sight of what matters most. </p></li><li><p>My health. My family. Everything else comes after.</p></li></ul><p>You don&#8217;t have to follow my rules. We all walk different paths and face different realities. Take what resonates with you. Leave the rest.</p><p>If this helped you pause, reflect, or adjust even one small thing, then it served its purpose. I wish you peace, clarity, and a life you&#8217;re proud to look back on.</p><p>Have a wonderful day &#10084;&#65039;<br>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p><div><hr></div>]]></content:encoded></item><item><title><![CDATA[Special Thanks to All Newsletter Members 💛]]></title><description><![CDATA[Hello dear friends,]]></description><link>https://www.blog.datawithbaraa.com/p/special-thanks-to-all-newsletter</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/special-thanks-to-all-newsletter</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Fri, 06 Feb 2026 11:33:35 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/cec1db69-a564-43e3-b373-fdee177f090a_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hello dear friends,</strong></p><p>I just wanted to take a moment to say <strong>thank you for being a member and for supporting my work</strong>. It truly means a lot to me.</p><p>Your support, messages, and encouragement mean more than you know. This newsletter started as a simple way to share knowledge, and now it has become a community of motivated people who genuinely want to grow in dat&#8230;</p>
      <p>
          <a href="https://www.blog.datawithbaraa.com/p/special-thanks-to-all-newsletter">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[⏰We’re Live in 1 Hour. Data Talk with Baraa & Simon]]></title><description><![CDATA[Hey friends - Happy Wednesday!]]></description><link>https://www.blog.datawithbaraa.com/p/were-live-in-1-hour-data-talk-with</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/were-live-in-1-hour-data-talk-with</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Wed, 04 Feb 2026 13:58:18 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/BoWXYHFvPLI" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends - Happy Wednesday!</strong></p><p>You&#8217;re invited to join our &#120279;&#120302;&#120321;&#120302; &#120287;&#120310;&#120323;&#120306; &#120294;&#120321;&#120319;&#120306;&#120302;&#120314; &#120324;&#120310;&#120321;&#120309; &#120314;&#120306; &amp; &#120294;&#120310;&#120314;&#120316;&#120315;!</p><div id="youtube2-BoWXYHFvPLI" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;BoWXYHFvPLI&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/BoWXYHFvPLI?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>We worked together for over three years on a real enterprise data project at Mercedes-Benz.<br><br>I&#8217;ve noticed that many real experts are actually hidden! Most of them simply don&#8217;t have the time to be active on social media or share their knowledge publicly.<br>That&#8217;s exactly why I want to bring these gems into the spotlight!<br><br>We&#8217;re having an open, relaxed conversation about real data projects, and lessons learned.<br>Join us live and drop your questions in the chat. We&#8217;ll answer as many as we can.<br><br>See you there &#128075;</p><p>Have a wonderful day &#10084;&#65039;<br>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p><div><hr></div>]]></content:encoded></item><item><title><![CDATA[How to Become Data Analyst in 2026 (Zero To Lead)]]></title><description><![CDATA[Built from 17 years of real data experience]]></description><link>https://www.blog.datawithbaraa.com/p/how-to-become-data-analyst-in-2026</link><guid isPermaLink="false">https://www.blog.datawithbaraa.com/p/how-to-become-data-analyst-in-2026</guid><dc:creator><![CDATA[Data with Baraa]]></dc:creator><pubDate>Tue, 27 Jan 2026 13:02:35 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/8965fa42-e914-46a7-9541-9e27073f07b1_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Hey friends - Happy Tuesday!</strong></p><p>I was looking at a bunch of &#8220;data analyst roadmaps&#8221; the other day, and I noticed something. Most of them are super tool-based. They basically say: learn SQL, Excel, Power BI, Python&#8230; and that&#8217;s it.</p><p>But tools are only one piece of the job. The bigger skill is learning how to think like an analyst: how to break down messy questions, understand the business, and turn data into decisions.</p><p>So I built my own roadmap. I&#8217;ll take you slowly through every phase, starting from total beginner, all the way to getting hired, then what to focus on after you get the job, and how to grow into senior and lead roles.</p><p>This roadmap is based on my 17 years working in real data teams, and what companies actually expect in the market today.</p><p>Here are the resources &#128071;</p><ul><li><p>I explained the full roadmap step by step in this video &#8594; <strong><a href="https://youtu.be/6MbN0MVaQ5Y">LINK</a></strong></p></li><li><p>And I shared the Notion template with all phases, resources, and a clear step by step guide &#8594; <strong><a href="https://candle-gosling-511.notion.site/Data-Analyst-Roadmap-2026-By-Data-With-Baraa-2f034b251f1280fdbf24d23dfe32a15e?source=copy_link">LINK</a></strong></p></li></ul><div id="youtube2-6MbN0MVaQ5Y" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;6MbN0MVaQ5Y&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/6MbN0MVaQ5Y?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><h2>#1 The Hiring Journey</h2><p>This journey is about building the right skills to get you ready for your first data analyst role.</p><h3>Phase 0 - Absolute Beginner &#129517;</h3><p>This phase is about understanding what data analytics really is and deciding whether this career is right for you.</p><blockquote><p>&#127919; <strong>Mindset:</strong> Mindset: Is data analytics the right career for me?</p></blockquote><p>Just spend like few days reading watching about it and make then decision</p><ul><li><p></p></li><li><p><strong>Understand the Role</strong>: You clearly understand what a data analyst actually does before investing time and effort.</p></li><li><p><strong>Check 10 Job Posting:</strong> Scan job postings to see what companies actually ask for and to align your learning with the market.</p></li><li><p><strong>Make Decision</strong>: Decide if data engineering is the right long-term career for you.</p></li></ul><blockquote><p><strong>Remember:</strong> Ask yourself: &#8220;Would I enjoy this work every week?&#8221; <em>Be honest with yourself. This phase saves you years later.</em></p></blockquote><div><hr></div><h3>Phase 1 - Core Technical Skills &#127793;</h3><p>This phase is about getting you ready by focusing on core skills one by one, so working with data and code starts to feel natural before you even think about data engineering.</p><blockquote><p>&#127919; <strong>Mindset:</strong> I can work with Data</p></blockquote><p>How to Learn: Learn Theory, Basics and Deep dive into Advanced Topics, Do Projects</p><ul><li><p><strong>Data &amp; Analytics Terminology:</strong> Learn core terms like metrics, KPIs, BI, and data quality.</p></li><li><p><strong>SQL</strong>: Explore, clean, and join data to answer real business questions.</p></li><li><p><strong>EDA Project</strong>: Analyze a real dataset to find patterns, trends, and issues.</p></li><li><p><strong>Power BI / Tableau:</strong> Build dashboards that clearly communicate insights.</p></li><li><p><strong>Dashboard Project</strong>: Create an end-to-end dashboard using real data to show your skills.</p></li></ul><blockquote><p><strong>Remember:</strong> <em>Practice more than you consume content</em></p></blockquote><ul><li><p>Learn one skill at a time</p></li><li><p>Focus on understanding, not memorizing, Always ask &#8220;why&#8221; before &#8220;how&#8221;</p></li><li><p>Use AI only to explain concepts, not to write code for you</p></li></ul><div><hr></div><h3>Phase 2 - Data Analytics Skills &#129504;</h3><p>This phase is about <strong>how analysts think</strong>, not which tools they use. You move beyond writing queries and dashboards and start focusing on reasoning, interpretation, and decision-making.</p><blockquote><p>&#127919; <strong>Mindset: </strong>I can think like an analyst!</p></blockquote><p>How to Learn: Just read about it no need to deep dive</p><ul><li><p><strong>Statistics</strong>: Understand distributions, variability, and relationships. Focus on meaning, not formulas.</p></li><li><p><strong>Communication (Storytelling)</strong>: Turn analysis into clear insights non-technical people understand.</p></li><li><p><strong>Analytical Thinking and Problem Solving</strong>: Break vague questions into measurable problems and challenge assumptions.</p></li><li><p><strong>Data Modeling and Metrics Design: </strong>Build meaningful metrics that reflect real business logic, not vanity numbers.</p></li></ul><blockquote><p><strong>Remember:</strong> <em>Clear thinking beats fancy dashboards</em></p></blockquote><ul><li><p>Your main task is to <strong>answer business questions</strong>, not only to write queries or build charts</p></li><li><p>You work with <strong>non-technical people</strong>, so clarity matters more than complexity</p></li><li><p>Numbers are useless without <strong>context, assumptions, and impact</strong></p></li></ul><div><hr></div><h3>Phase 3 - Stand Out Go Beyond the Basics &#129523;</h3><p>This phase is about differentiation, not requirements. You already have what you need to get hired. These skills help you stand out, work faster, and handle more complex data, but they are not required for a data analyst role.</p><blockquote><p>&#127919; <strong>Mindset: </strong>I add extra value without losing sight of the core role.</p></blockquote><p><strong>How to Learn it</strong>: Learn the core concepts first, then practice only the basics. Avoid deep dives. Depth comes later on the job.</p><p><strong>&#128721;Important Note:</strong><em> These are large topics. Do not get lost in tools or delay job applications. This phase is optional and exists only to help you stand out, not to block your progress.</em></p><ul><li><p><strong>Python (Pandas, Numpy, Plotly)</strong>: Use Python to explore data and automate repetitive work.</p></li><li><p><strong>Databricks For Data Analytics</strong>: Learn how analysts explore large datasets on modern platforms.</p></li><li><p><strong>AI Prompt Engineering</strong>: Use AI to speed up analysis, SQL, and documentation.</p></li><li><p><strong>AI Models (High-Level): </strong>Understand what AI models do, their limits, and how analysts use them.</p></li></ul><div><hr></div><h3>Phase 4 - Prepare &amp; Get Hired &#128188;</h3><p>At this point, you won&#8217;t know 100% of data engineering, and that&#8217;s completely normal. The good news is you already have around 70% of the skills needed to start applying. There&#8217;s no reason to wait anymore. Now it&#8217;s time to prepare yourself, put your profile together, and start applying for jobs.</p><blockquote><p>&#127919; <strong>Mindset: </strong>I am ready to enter the market!</p></blockquote><ul><li><p><strong>Get Certified</strong>: Validate skills with relevant certifications. You increase trust and visibility in the market.</p></li><li><p><strong>Build Clean Resume</strong>: Present skills and projects clearly. Recruiters quickly understand your value.</p></li><li><p><strong>Optimize LinkedIn Profile</strong>: Make your profile searchable and attractive. Recruiters can find and contact you.</p></li><li><p><strong>Build Portfolio</strong>: Showcase real projects publicly. You stand out beyond certificates and courses.</p></li><li><p><strong>Start Applying for Jobs</strong>: Apply consistently and interview actively. You gain interview experience and land offers.</p></li><li><p><strong>Improve &amp; Learn</strong>: Fix gaps while applying and interviewing. You continuously improve until you get hired.</p></li></ul><blockquote><p><strong>Remember:</strong> Y<em>ou don&#8217;t need 100% to start applying.</em></p><ul><li><p>Apply before you feel fully ready</p></li><li><p>Rejections are part of the process</p></li><li><p>Treat interviews as learning sessions</p></li><li><p>Focus on explaining, not impressing</p></li><li><p>Keep improving while applying</p></li><li><p>Do not compare yourself to seniors</p></li></ul></blockquote><div><hr></div><h3><strong>End of The Hiring Journey&#127881;</strong></h3><p>If you got a job, congratulations. I&#8217;m really proud of you and happy for you.</p><p>From here, I&#8217;ll guide you on how to grow as a data analyst and build real experience on the job.</p><p>If you&#8217;re still searching, don&#8217;t worry. You <em>will</em> get one. Just keep pushing.</p><p>In the meantime, you can already start looking at the next skills, and if you have time, pick a few to strengthen your profile while you keep applying.</p><div><hr></div><h2>#2 The Growth Journey</h2><p>This journey is about what happens after you get hired: learning on the job, making mistakes, and growing into a strong data analyst.</p><h3>Phase 5 - Junior Data Analyst &#129489;&#8205;&#128187;</h3><p>At this stage, you are officially working as a <strong>data analyst</strong>, but you will not know everything and that is completely normal. Most of your real learning happens on the job. You will ask questions, make mistakes, fix them, and slowly start connecting the dots.</p><blockquote><p>&#127919; <strong>Mindset</strong>: I am learning by doing</p></blockquote><ul><li><p><strong>Understand the business and stakeholders</strong>: Understand how the company makes money and who uses your work.</p></li><li><p><strong>Explore and Understand Data (EDA)</strong>: Explore data, ask questions, and build intuition.</p></li><li><p><strong>Build Domain Knowledge</strong>: Learn the business domain to add context to your analysis</p></li><li><p><strong>Maintain and Improve Existing Reports</strong>: Maintain existing reports and improve clarity and metrics.</p></li></ul><blockquote><p><strong>Remember:</strong> Making mistakes is part of the job.</p><ul><li><p>Ask questions early</p></li><li><p>Focus on reliability over clever solutions</p></li><li><p>Quality is always better than speed</p></li><li><p>Learn company data and business context</p></li><li><p>Take feedback seriously, not personally</p></li></ul></blockquote><div><hr></div><h3>Phase 6 - Senior/Lead Data Analyst &#129504;</h3><p>At this stage, you are no longer just executing tasks. You are trusted with complex business problems, ambiguous questions, and high-impact decisions. You influence stakeholders, shape metrics, and guide others.</p><p>A senior or lead data analyst focuses less on producing reports and more on <strong>driving clarity, alignment, and decisions</strong> across the business.</p><blockquote><p>&#127919; <strong>Mindset</strong>: I take ownership of complex problems and help others see the full picture.</p></blockquote><ul><li><p><strong>Mentor Juniors</strong>: Review work, give clear feedback, and help juniors improve their thinking.</p></li><li><p><strong>Impact Thinking</strong>: Move from &#8220;what was asked&#8221; to &#8220;what really matters.&#8221; Prioritize work based on impact, not volume.</p></li><li><p><strong>Improve data quality and governance</strong>: Ensure trusted, consistent metrics across teams.</p></li><li><p><strong>Advanced Data Modeling</strong>: Build scalable metrics for long-term decisions.</p></li><li><p><strong>System-Level Analytics Architecture</strong>: Understand how data flows across analytics systems.</p></li></ul><blockquote><p><strong>Remember:</strong> <em>Delegate simple tasks and focus on complex, high-impact problems.</em></p></blockquote><ul><li><p>Let juniors handle repetitive analysis and reporting</p></li><li><p>Own the hardest business questions</p></li><li><p>Review work to raise the overall analytics quality</p></li><li><p>Balance insight quality, speed, and trust</p></li><li><p>Help stakeholders make better decisions, not just faster ones</p></li></ul><div><hr></div><h2>So my friends,</h2><p>You can start this path with no degree and no prior experience. I have seen it happen many times. The roadmap is simple. Learn the core skills, build real projects, create proof of your work, and keep improving while you apply. It takes time and patience, but it works.</p><p>If you want a clear structure to follow, you can use the full <strong><a href="https://candle-gosling-511.notion.site/Data-Analyst-Roadmap-2026-By-Data-With-Baraa-2f034b251f1280fdbf24d23dfe32a15e?source=copy_link">Notion Data Engineering Roadmap</a></strong> here &#8594; <strong><a href="https://candle-gosling-511.notion.site/Data-Analyst-Roadmap-2026-By-Data-With-Baraa-2f034b251f1280fdbf24d23dfe32a15e?source=copy_link">LINK</a></strong><br>It includes all phases, resources, and guidance to help you move step by step.</p><p>Thank you for taking the time to read this. I hope it brought you clarity and helped you feel more confident about your next move.</p><p>Have a wonderful day &#10084;&#65039;<br>Baraa</p><div><hr></div><p>Also, here are 4 complete roadmap videos if you&#8217;re figuring out where to start:</p><p>&#128204; <strong><a href="https://www.youtube.com/watch?v=1nVGaNbvuXg">Data Engineering Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=uEfvSWM49pY">Data Science Roadmap</a></strong><br>&#128204; <strong><a href="https://www.youtube.com/watch?v=ITGF5L20zJE">Data Analyst Roadmap</a><br></strong>&#128204;<strong> <a href="https://youtu.be/ILrYwyPd1Dc">AI Engineering Roadmap</a></strong></p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fZ3-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png" width="167" height="175" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:175,&quot;width&quot;:167,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43439,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fZ3-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 424w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 848w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1272w, https://substackcdn.com/image/fetch/$s_!fZ3-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb09b0ad2-c423-426d-8744-ee2c7e872f57_167x175.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Hey friends &#8212;</p><p>Hey, I&#8217;m Baraa, a Data Engineer with over 17 years experience, Ex-Mercedes Benz, where I led and built one of the biggest data platforms for analytics and AI.<br><br>Now I&#8217;m here to share it all through visually explained courses, real-world projects, and the skills that will get you hired. I&#8217;ve helped millions of students transform their careers.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;http://bit.ly/3GiCVUE&quot;,&quot;text&quot;:&quot;Visit My Youtube Channel&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="http://bit.ly/3GiCVUE"><span>Visit My Youtube Channel</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.blog.datawithbaraa.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.blog.datawithbaraa.com/subscribe?"><span>Subscribe now</span></a></p><div><hr></div>]]></content:encoded></item></channel></rss>