Your AI Isn't the Advantage. Your Judgment Is - Sid Pednekar

AI Engineer · 18 min · 187 sentences · from YouTube's caption track

Each timecode opens YouTube at the start of that sentence. Line anchors (#s42) are the cue ids in the WebVTT, and every line carries its start and end seconds. All transcripts has every talk, and the whole corpus as one file.

1. 00:01[music]
2. 00:12Good afternoon everyone present here.
3. 00:15It's It's been a It's been a great day and an absolute pleasure to be here.
4. 00:22The topic of my talk today is everyone has AI who has the advantage?
5. 00:31I'll be talking about what the orgs that are doing that are leading in AI with the implementation and adoption what are they doing differently?
6. 00:42Um And so before that who am I and what's my POV?
7. 00:49So, I'm Dr. Sid Patnekar.
8. 00:51I am an AI technology and data exec in asset management.
9. 00:57I've spent most of my tenure in hedge funds and investment and academic research.
10. 01:04Uh what I've done and focused on is lead strategy and build specialized teams towards three main verticals, optimizing efficiency driving P&L and reducing costs.
11. 01:19So, um I'll be following the discussion along with two hypothetical companies, company A and company B right at the slider below.
12. 01:30Uh these are hypothetical, um you know, with with made-up workflows, but we'll be following their journey along um the rest of this presentation.
13. 01:42So everyone has AI, who has the advantage?
14. 01:47Um before we get started there, first let's see what the lay of the land is and recent studies have shown that only about 37% of enterprises that surveyed are showing a positive
15. 02:03contribution to their EBIT.
16. 02:06And only about 6% of those would be qualified as high performers.
17. 02:12So, that's about 5% contribution to their EBIT.
18. 02:15Other studies earlier in the year have shown that about 66% are saying they're having a productivity increase, but only about 40 and 20% are actually seeing cost reductions and
19. 02:29revenue growth.
20. 02:30So, as we know, access of AI is widespread, yet the impact remains uneven.
21. 02:40So,
22. 02:42[clears throat]
23. 02:43the question I would ask, or how I think about this, is really in terms of three verticals.
24. 02:51And the way I think about these three verticals should apply to organizations and individuals alike, and it should apply to functions regardless of where you are in that organization.
25. 03:07Um So, the three main vertical pillars that I think of are number one, design the right problem.
26. 03:15Number two, build shared capabilities.
27. 03:19And number three, compound the advantage.
28. 03:22Now, before we dive into each of these pillars, there is an idea that I think goes through all these verticals.
29. 03:31And I think the best leading firms are taking advantage of that and capitalizing on it.
30. 03:38As we know, throughout time, the only constant in this world has been change.
31. 03:44What's different in the AI and superintelligence era is that intelligence has become cheap.
32. 03:52Regardless of what your unit of intelligence is, whether it be software, analytics, recommendations, reports, AI is creating an abundance in all of it.
33. 04:03And um as we know, more answers don't necessarily create more value.
34. 04:10So, what is scarce?
35. 04:12What is a scarce resource in an abundant world?
36. 04:17What what are companies taking advantage of, the leaders at least?
37. 04:22It's judgment.
38. 04:25What is judgment?
39. 04:27Judgment is choosing what matters and how to act when there's no single obvious answer.
40. 04:33It's the creativity that lets you explore what possibilities are worth exploring.
41. 04:38It's the taste that tells you what good looks like in your given context.
42. 04:43It's the decisions where you can weigh what trade-offs are worth making.
43. 04:49Judgment is ubiquitous.
44. 04:51It exists throughout your organization.
45. 04:54On a daily basis, your C-suite The C-suite is asking questions, taking advantage of judgment judgment all the time.
46. 05:02So are the software engineers, the AI leaders, the portfolio managers, and the data scientists.
47. 05:08So, the question that they're focused on is given judgment is a finite asset, a limited capacity, the main question becomes where is our best judgment worth spending?
48. 05:25Like for you to hold on to that thought.
49. 05:28With that, we'll dive into our first pillar.
50. 05:30Design the right problem.
51. 05:32So, questions uh a question that um the leading organizations are asking all the time is they're obsessed over what is the right problem to solve?
52. 05:45Right?
53. 05:45It's tempting to start with the tool.
54. 05:47Today we're surrounded with better models, harnesses.
55. 05:51We're surrounded with all these AI tools.
56. 05:53We're surrounded with co-pilots.
57. 05:55But that isn't the way about, is it?
58. 05:59At least that's not the way the leaders are approaching it.
59. 06:02Now, let's go back to our hypothetical um two companies.
60. 06:05Let's say they're from asset management.
61. 06:07Let's say, uh, we're tracking the workflow of two research analysts in these hypothetical, um, organizations.
62. 06:16Well, let's say organization B starts with the tool, the co-pilot.
63. 06:21They're asking, "Where can we add AI to the analyst work?"
64. 06:25They're looking at the current existing process to say, "Earning transcript comes in.
65. 06:31I discovered a summarization workflow.
66. 06:34Let me pass all of this in through my fire hose.
67. 06:37Analysts get earning summaries faster.
68. 06:41Win-win, right?
69. 06:43Well, not so much, at least not compared to the guys who are leading.
70. 06:47And such a workflow of of being a faster horse introduces one key, um, nuance.
71. 06:54That is, you are losing context as you have information, um, I guess reduction as part of your summarization.
72. 07:01So, what What is the hypothetical organization A doing in this?
73. 07:06Well, they're obsessed with the right problem to ask.
74. 07:09They could be asking, "Why are our material signals reaching us too late?
75. 07:14Where do we focus the attention, the AI, the bandwidth, the capability on?
76. 07:19Where is our bottleneck, right?"
77. 07:21And so, it becomes this redesigning of the workflow or at least the reevaluation on what to focus on.
78. 07:28That's what they're doing different.
79. 07:30Now, this consideration isn't particularly defined finance, it's across the the realm and function.
80. 07:35You know, you're asking the same question on what to focus on, whether it be research capacity, decision speed, quality of your data, latency, reliability.
81. 07:47It it it traverses all of that.
82. 07:50And studies show this.
83. 07:52They show the leading studies, um, on average spend their attention on fewer, higher-quality decisions than the other cohort.
84. 08:03So, leaders are being more selective in where they focus their attention and what they focus their attention.
85. 08:09So, it's great.
86. 08:10The leading companies uh have um an idea of what the right problems are.
87. 08:15Where do they go from there?
88. 08:17Well, they also concentrate their investments in the highest value workflows.
89. 08:25I get it, and I've been uh I've been culpable of of something similar where, you know, AI is almost creating too many opportunities.
90. 08:33And experimentation can be a good thing.
91. 08:36Um but one needs to separate experimentation and the resulting innovation theater, or worse, the productivity theater, with actual value generation.
92. 08:48Going back to our two um hypothetical companies, what does this mean?
93. 08:51Company B is looking at how do we launch the most number of AI pilots?
94. 08:57And what that ends up looking like is a document summarization bot here, a co-pilot there, um a a data retrieval bot here.
95. 09:06It's scattered all over the place.
96. 09:08Whereas, what company A is focused on in their investments is potentially use cases like end-to-end workflows on the research um on the research pipeline.
97. 09:20They're focused on aligning engineering, analytics, AI capacity, and judgment towards a singular focus.
98. 09:29And research has shown that the leaders spend more than 80% of their investments on these high-value use cases.
99. 09:41Transforming key business functions and creating new offerings.
100. 09:46Perfect.
101. 09:47We We know they're focusing on um finding the right problem, and they're also spending deep investment in select workflows.
102. 09:56Well, they're also doing something different.
103. 09:59They're reimagining how work is done.
104. 10:03I think this is this is key.
105. 10:06And it goes back to what we discussed previously, which is judgment.
106. 10:09They're redefining and reorganizing functions, roles, capacities around this key element of judgement.
107. 10:19What does that mean for our hypothetical company?
108. 10:21Well, company B might be focused on as we discussed I'm getting my earnings transcript, I'm getting my research my research reports.
109. 10:29How do I summarize it?
110. 10:30Maybe I make that faster.
111. 10:32Maybe I update my financial models faster.
112. 10:34Maybe I send my recommendation to my PM faster.
113. 10:38Company A is focused on an entirely different ballgame.
114. 10:43Hypothetically, they could be asking the analyst to define the investment thesis.
115. 10:47And they're watching and gathering evidence that could refute that thesis or support it.
116. 10:53They'd be monitoring continuously.
117. 10:55They'd be investigating exceptions.
118. 10:58And they could be deep diving on you know, select examples that could lead to actual generation of value.
119. 11:09So, the winners just don't just automate, they redesign.
120. 11:13And studies show that the cohort of high performers are 75% more likely or in practice, they actually do redesign their workflow versus 25% of the cohort that doesn't.
121. 11:26So, where does this leave us with our two hypothetical companies and designing the right problem?
122. 11:32Company B adds AI to existing workflows.
123. 11:35They're completing individual projects and then moving to the next initiative, whereas company A is rethinking how work is done.
124. 11:43They're redesigning processes around AI and they're obsessing of the the the right problem.
125. 11:48That's that's the difference in how organizations put AI to work.
126. 11:53Great.
127. 11:53So, they've picked the right problem.
128. 11:55What what happens next?
129. 11:58Well, we all know in order to actually enable that capacity, you need to build shared capabilities across the org.
130. 12:06And what's what's a trend that's seemingly emerging for for some time now is that the lines between technology and business are converging.
131. 12:16And we're seeing this everywhere.
132. 12:18We're seeing engineers that are moving closer to business outcomes.
133. 12:21We're seeing business professionals that are building tools and automations.
134. 12:25And as you can see and imagine, you can have forward deployed engineers, you can have forward deployed product managers, but you could also have the inverse, which is forward deployed
135. 12:36portfolio managers.
136. 12:38And it's really this combination of getting the right people in the room by breaking down organization silos that the leaders are really leaning on.
137. 12:50Studies have shown that more and more of the large enterprises are viewing their technology arm as a business growth function.
138. 12:59And that's creating an edge for these for these companies.
139. 13:04So, the other sort of vertical inside building shared capabilities that is probably a personal favorite of mine.
140. 13:13It's standardizing the core and personalizing the edges.
141. 13:17And this is something that isn't new to the technology world.
142. 13:21We've we've built infrastructure, we've built, you know, shared modules and system design.
143. 13:25But what's interesting here today is that's taking a very different shape with the capabilities out there and with the org and the breaking down of silos.
144. 13:34And this could look very different depending on where you sit.
145. 13:39You could be building shared cores for you know, a team that looks very different with analysts and and clients.
146. 13:47You could be doing that with you know, a bunch of analysts or you can do be doing that for software engineers or data scientists.
147. 13:55With the data scientist example in particular, that could look very interesting where instead of having one-off workflows that that is really common in the industry, you could build a shared core
148. 14:08of the data sets, their semantic layers, the tradeoffs of what worked, what didn't, what you know, what what some data sets do good off, where are the gaps, and and so on and so forth, such that
149. 14:21each new personnel becomes almost a plug-and-play module in the system where they can then stand on the shoulder of their predecessors.
150. 14:31So, what should the next person not have to rebuild?
151. 14:35[clears throat]
152. 14:36Now, what's also interesting is, um, you know, the enterprise wasn't really built for agents.
153. 14:43Um, agents, they they work across workflows and applications, they they take contacts, they uh deliberate, they take actions, whereas really the enterprises are focused, um, previously on uh single human
154. 14:57or a collection of them interacting with the single application.
155. 15:01So, the leaders are cognizant that something needs to change and that they need to modernize, um, their infrastructure, and they're very self-aware of where they are in their journey.
156. 15:14And so, studies show that, you know, 75 71% of the orgs are modernizing their core infrastructure to support AI.
157. 15:21And, um, you know, 6 to 10% or 23% of them are investing 6 to 10% of their annual revenue in in core system modernization, um, to take advantage of this.
158. 15:34And a common complaint here or a common challenge here is, um, you know, data quality and and the ability to reuse data.
159. 15:43Um, so, great.
160. 15:44We, you know, we we have the right people in the room, we, um, have you know, we have the right knowledge there.
161. 15:51What is What do we do next?
162. 15:53And then comes the concept of, "Hey, how do we make this knowledge reusable and accessible?"
163. 15:58And that's where we have, you know, depending on on the adoption and where where they are, you can have different types of team agents, where you can have expert agents being subject matter experts,
164. 16:09you can have workflow agents that work across streams like Slack bots that are creating and opening tickets, they're closing them, and what have you, and then you can have really chief of staff kind of agents that keep
165. 16:22a tab on what the state of the organization is and what needs to be done.
166. 16:26So, um you know, going back to our workflows, A again is looking at this very differently in terms of shared capabilities.
167. 16:34[clears throat]
168. 16:34Now, the last pillar here that I want to draw your attention to is well, when does this system really compound?
169. 16:42What happens when it's deployed?
170. 16:46Well, the leading companies, what they're doing is they're actually thinking about it slightly differently.
171. 16:51What are failures that can give us an edge that we can learn from?
172. 16:56If if there's a success, how do you make it part of the system?
173. 17:00And the way they think about this is, you know, the individual learned, but did the system?
174. 17:05Is there a way perhaps, when they've encountered something where they need to make a correction, that that knowledge is fed back into the org, either through a new tool, a context,
175. 17:14or or or what have you.
176. 17:17And um what's what's key here is preserving the evidence along with those learnings.
177. 17:24So, um really the last vertical here is AI frees capacity.
178. 17:30Where does it go?
179. 17:32Being cognizant that you need to redesign your system and really focus it on key metrics that you're evaluating, you're monitoring, and you're creating a fly flywheel off.
180. 17:45So, where does this leave us for companies A and B?
181. 17:49You know, company A has their entire work redesigned.
182. 17:53They're building capabilities that compound, and they have shared capabilities built.
183. 17:59So, I want to leave you off with one final question.
184. 18:02Everyone has AI.
185. 18:03Who has the advantage?
186. 18:05Thank you.
187. 18:07[applause]