The Signal Layer: What to Build When Anything Can Be Built — Lena Hall, Akamai
https://www.youtube.com/watch?v=1KOdiGgMtpY
AI Engineer · 19 min · 210 sentences · sentence-level transcript from YouTube's caption track; each line begins at the time shown

[00:01] [music]
[00:12] How is the conference for all of you so far?
[00:16] Great.
[00:16] Awesome.
[00:18] Um well, I think this was the best most productive year for so many of us.
[00:25] I'm Lena.
[00:26] A few days ago, I solved a production incident on a trail near a waterfall.
[00:32] My friend ran 18 agents while riding his bike.
[00:37] We're literally drowning in abundance.
[00:40] We have more output, more speed, more leverage than any of us have ever had.
[00:47] So, why do we have this feeling like the ground underneath is moving too fast?
[00:54] One of the engineers that I met at this conference said yesterday that it feels like the opportunity cost for not working 9:00 a.m. to 9:00 p.m. 6 days a week is too high right now.
[01:07] So, we're all token maxing.
[01:09] We're all working all the time.
[01:12] But the same abundance that made you fast, it also made everyone else fast.
[01:17] So, now everyone can build everything.
[01:21] Your competitor can build your feature this afternoon, too.
[01:25] So, the cost of the average just went to zero and so did its value.
[01:31] A year ago, the superpower, as we were told, was to be good at using AI.
[01:37] But models got so good and they got so easy and everybody now is a lot more skilled at using AI and everybody's pointing AI at the same goals.
[01:49] Cuz AI gives everyone the same answer because everybody is asking the same question.
[01:55] It It on data and data is a record of what has already happened.
[02:00] So, when you point AI at tasks like, "Tell me what users want.
[02:04] Make more money.
[02:05] What should we build?
[02:07] Make this viral."
[02:08] It answers from the common knowledge.
[02:11] Very competent, very confident, but also very identical to what it tells your competitor.
[02:17] To see something that data doesn't show yet, we need to have a vision, a point of view, a read on where it's going, and then use all that automation to execute it.
[02:28] AI is a really smart convergence machine.
[02:32] So, if you leave it alone, it makes everything the same.
[02:37] There is one decision, though, that AI can't and shouldn't make for you.
[02:41] It is to decide what to point at.
[02:44] So, the job, the new job for everyone of us is deciding what it makes, being the reason the right people choose your version over the identical-looking rest.
[02:55] But also, I'm sure many of you uh walked around the Expo Hall at this conference, and there are so many amazing products, so many tools and vendors.
[03:04] They're all solving important problems.
[03:07] But what Why do they all sound the same?
[03:11] So, when anyone can build anything, what makes me different?
[03:15] What makes you different?
[03:16] Why should anyone pick your version, your product?
[03:20] Um I call this work uh signal layer.
[03:24] And there are two There's two halves to solving it, to getting this right.
[03:28] So, that's how we will walk through it.
[03:31] The first half is knowing your signal, being able to define it very clearly.
[03:37] What you're building and why it's yours and not the average.
[03:40] So, that's the build side, the code, the product, the road map.
[03:45] And the second half is emitting that signal without distortion.
[03:50] So, making sure that your customers um making sure what your customers come to believe about you actually matches what you believe and what you've built.
[04:00] That's the ship side the content and go to market engineering.
[04:05] And I've had an unusual vantage point in this.
[04:08] I've built products as an engineer.
[04:10] I created my own as a founder.
[04:12] I brought other people's products to market.
[04:15] So three very different jobs with one identical challenge.
[04:19] The signal doesn't always survive.
[04:22] So let's start with the build side.
[04:25] So what do we even work on?
[04:27] Everything is implementable.
[04:30] Two years ago the best autonomous coding agents you know solved on the fraction of the tasks on the standard software benchmark and now the best agents are in the high eighties.
[04:42] So we nearly tripled the amount of writing and shipping barely moved a third.
[04:49] The benchmark was measuring the part of software engineering that has a greater and shipping is where all the ungraded parts come back in.
[04:59] So here is the rule underneath it.
[05:03] Anything that you can measure you can train against as Sarah Guo puts it.
[05:09] A compiler is a free grader.
[05:11] A test suite is a free grader.
[05:14] And the instant a task can grade itself you can grind a model against you know that grade until it wins.
[05:22] Automation of code was first because it's the most checkable thing that we have.
[05:28] So implementation is converging for free for everyone at the same time and the most buildable thing and the most valuable thing are almost never the same thing.
[05:40] So the model will build whatever you point it at but it will tell you nothing about where to point.
[05:46] Anything visible is replicatable.
[05:50] So now, some people when they hear everything is implementable, they panic.
[05:54] Um but we can flip the question.
[05:56] The pointing is actually the job.
[05:59] It has always been the job.
[06:01] We just had so much implementation work in the way um that we never had to get good at it.
[06:08] So, how do you decide where to point that?
[06:11] Paul Graham shared some wisdom on this.
[06:14] Where you find something that people genuinely want is by feeling the need yourself.
[06:20] Build something you and your friends need because the market hasn't formed yet, surveys can't see it, and your own need is the only signal that isn't a crap signal.
[06:31] And the best ideas may sound genuinely lame at first, like a guy uh strapped with a with a camera on his head live streaming his his life.
[06:41] That sounds really ridiculous, but it became Twitch.
[06:44] Um and the convergence machine doesn't really, you know, propose proactively these uh weird, specific, genuinely embarrassing ideas.
[06:54] But even with the Twitch example, it worked, but there were a thousand other similar startups I start startup ideas that didn't.
[07:03] So, the weird specific signal is necessary, but it is not sufficient.
[07:10] It's also really tempting to say that we just need to have good judgment and good taste and call it safe.
[07:17] But taste is really just preference under feedback, and preference under feedback is exactly what these systems can learn.
[07:26] Anything you can demonstrate enough times uh with a better or worse signal attached, the machine can eventually imitate.
[07:34] So, broad good taste is not really a differentiator.
[07:39] What actually resists training is more narrow and more durable.
[07:44] So, two things.
[07:46] Taste and judgement about what hasn't happened yet.
[07:50] Because there's no data for an event that hasn't occurred.
[07:53] And then taste and judgement embedded in a relationship that the model can't observe.
[07:58] What this customer in this situation with this history that you share actually needs.
[08:05] The model has read everything ever written about your customer, but it has never actually met them.
[08:12] So, if broad judgement is not safe, and the AI just handed everyone the ability to build anything, what's left to be good at?
[08:21] Richard Hamming uh spent his career studying why some scientists did great work and others who were just as smart didn't.
[08:32] He found that the great ones worked on important problems.
[08:37] And the problem isn't important because it just sounds impressive.
[08:42] It's important when you have a reasonable attack on it.
[08:45] For example, time travel is consequential, he would say, but it's not important because nobody has an attack on it.
[08:52] So, Hamming would tell you to keep 10 or 20 ideas um on important problems in the back of your mind so that when you finally have an attack, a new tool, a new angle
[09:04] I think that only you noticed, then you go for it.
[09:08] But in Hamming's world, the rarest thing was having an attack.
[09:12] And AI just handed everyone an attack on everything.
[09:15] So, the rarest thing is knowing which problem is actually worth attacking.
[09:19] And that judgement comes from being a real person, close to a real domain, with your own battle scars, your weirdly specific experience, the thing that you care about more than is reasonable.
[09:32] And you don't actually need to be first.
[09:34] You just need to be genuinely close to a problem you actually understand where your insight is in the delta between what AI has been trained on and what should exist.
[09:45] So, let's say you did it.
[09:46] You found that sweet spot problem that the one that you had an honest attack on, that you built this thing.
[09:53] It's genuinely good.
[09:54] It's genuinely yours, not the average.
[09:58] You can still lose uh because knowing your signal is only half the job.
[10:03] The other half is getting it from your head into the head of a person that it was meant for.
[10:09] And it's about reaching the right people.
[10:12] And what do most of us do for that?
[10:15] We make content.
[10:16] So, let's talk about what uh AI convergence machine does to that.
[10:23] What happened to the internet in the last 2 years?
[10:26] Open any feed, everything has started to sound the same.
[10:30] The same LinkedIn posts, the same, you know, three bullet points and a bold takeaway, and the same blog post that uh says nothing but actually looks very polished.
[10:42] Um your readers can now pattern match AI in just half a second.
[10:46] So, if a model could have written your post from a one-line prompt, your reader brain just skips it for the same reason.
[10:56] So, AI has really learned the algorithm.
[10:58] It has learned the format that performs.
[11:00] It has learned what gets clicks, and everyone wants to hand the machine a paragraph and say, you know, "Make it viral.
[11:07] Make me rich."
[11:09] It fills every gap that you leave with sameness.
[11:13] So, what do you put in and what do you let it fill in?
[11:17] Cuz these there there are two different ways to use this thing, and they look very identical from the outside.
[11:24] One is you give it an average prompt, and gives you the average output.
[11:28] And you ship one more indistinguishable drop into an ocean of indistinguishable drops.
[11:34] So, you've automated your own irrelevance very efficiently.
[11:38] And two, you can bring in the part that it can't have, your specific point of view, the real story that you were actually in the room for, and then let the machine do the converging work,
[11:49] the formatting, the drafting, the algorithm optimization, the cleanup around the core that it could have never generated.
[11:58] The signal distorts on the way out.
[12:00] So, you can have the signal perfectly clear for you and still watch it fall apart between your brain and your users' understanding of it.
[12:10] And in my experience, it breaks in three places.
[12:14] And there are fixes for each, but they're different depending on product, the type, and the size of the company.
[12:22] One of them is source distortion, which is very common in startups.
[12:26] Founders, actually, they usually know the signal so well that they always have this accidental gift of compressing it past legibility.
[12:37] They often assume the context that the audience doesn't have, and the room hears something technically very cool, but they doesn't they don't really understand why it matters.
[12:48] I helped this one YC company with uh this exact thing recently.
[12:53] Absolutely brilliant founders, genuinely new product, but every pitch that they started um was you know starting with architecture, with the clever parts, with things that they were very proud of.
[13:05] But it really landed as noise because the customer pain has been deleted from the whole story.
[13:12] So, we rewrote the opening to include the thing that the user hated, and this product actually killed.
[13:18] So, the same product, the same week, the next conversations converted into pilots, and then we turned that into repeatable GTM system.
[13:28] Organization distortion is another type of distortion that almost every big company has.
[13:35] As signal travels through layers of management, through legal, through sales, through every department, at every hand handoff, it gets rewound towards the average.
[13:46] And this really doesn't come from incompetence, it comes from investment.
[13:50] So, hand a founder and the person three layers down the same task and the same AI, and you get two different things.
[13:59] Um the founder really sweats the unaverageable details because the outcome is really theirs and they're personally invested and affected by it.
[14:09] And others just ship it to spec, they close Jira tickets, they were asked for, you know, something like compliance, not as much conviction.
[14:18] So, a long delegation chain plus convergence machine is really a factory for automating the signal out of your own company.
[14:27] So, the first instinct usually is to add more process, which adds layers, bureaucracy, and slows everything down.
[14:35] And we don't want that.
[14:37] Um to fix this, we have to help take the signal back and reattach it to the outcome like a founder and add the very thin signal layer to your go-to-market engineering,
[14:48] where its only job is to validate and carry the original intent across the handoffs intact.
[14:55] Machine distortion is another way you can lose signal.
[14:59] You write one careful launch, your claim, your evidence, and your scope is very clear, but then of course AI remixes it um into a tweet, into a sales deck, into a partner one-pager.
[15:11] For example, you might have had this one very narrow eval that scored 94% but it was repeated enough times that your customers actually heard it as a promise.
[15:23] So, we see the same through line.
[15:25] Your signal has to survive the trip undistorted.
[15:30] And this is something you can engineer.
[15:33] So, we need a thin signal layer, a small deliberate function whose job is to make sure that what your users take away is still the specific thing you meant.
[15:43] Say you're building a monitoring tool.
[15:45] There are 12 other tools in this category, but yours does something different.
[15:50] It tells you what not to wake up for, for example.
[15:54] It stays quiet on the noise, so when you get paged at night, you believe it.
[16:00] So, that quiet, that trust earned by silence is your signal.
[16:05] So, first, say it in one sentence with the limit built in.
[16:09] Definitely don't say intelligent AI-native observability platform.
[16:14] Say something like uh stays quiet on anything it can't tie to a real user impact and shows you everything it silenced so you can overrule it.
[16:24] The promise and the scope are welded together here.
[16:28] Then make sure that the limit can't be edited out.
[16:30] So, in the product, every suppressed alert is visible.
[16:34] In the launch, statements like 90% fewer pages uh live next to statements like every silence is visible and reversible.
[16:43] So, when AI chops your launch into a tweet, it can keep the impressive number, but also remove the part that keeps the part that uh keeps the product honest.
[16:55] And before you scale it, check what people actually heard.
[16:58] So, give a readme to an SRE who has never seen your project and ask a person to describe the product back to you.
[17:07] The gap between what they say and what you meant is the distortion that you were about to broadcast.
[17:14] And it's a very lightweight signal layer, and a lot of it is buildable, So, you can automate more of the checking and the catching and the surveying than most people realize.
[17:23] So, step back and ask what all of this, the building, the shipping, the undistorted signal, is actually for.
[17:31] It's for one thing of getting a human or increasingly an agent to choose you and rely on you when they have an infinite identical-looking alternatives.
[17:42] So, that's trust.
[17:44] Trust is the one thing that's left with no greater.
[17:47] There's no benchmark for it, no reward signal.
[17:50] It can't be entirely automated because it's granted slowly through relationship with consent.
[17:57] For example, doctors who open one particular tool every morning, they didn't have that habit trained into them.
[18:05] And what happens if we get this wrong?
[18:08] Getting your signal wrong is actually not neutral.
[18:11] It's negative.
[18:12] Producing averageness is not free.
[18:15] You actually pay for it in tokens, in infra, in the salaried hours of good people, you know, with with customers that take a look at your product once, decide once, and never come back.
[18:27] So, every generic post teaches them that your name isn't worth the click.
[18:33] So, you spend real money to make yourself harder to choose.
[18:37] So, back to the main question.
[18:39] We got faster, but the speed is not where the value went.
[18:44] Uh the value moved up to deciding what is worth building, what is worth saying, what deserves trust.
[18:50] And where does the thing that you actually um that that you meant survives the trip to the people that it was for.
[18:58] So, you don't need to be first.
[18:59] You need a real problem and enough conviction to carry the signal clearly through to, you know, right people to find it.
[19:08] So, when you can build anything, you should build trust.
[19:12] Have the strongest conviction, define the signal yourself, protect it from distortion, and use AI aggressively for everything else.
[19:21] Thank you.
[19:21] Let's connect and happy to chat with you afterwards.
[19:24] Thank you.
[19:26] [applause]
[19:40] [music]