Imagination Engineering: "Live in the future and then build what's missing."

AI Engineer · 16 min · 166 sentences · from YouTube's caption track

Each timecode opens YouTube at the start of that sentence. Line anchors (#s42) are the cue ids in the WebVTT, and every line carries its start and end seconds. All transcripts has every talk, and the whole corpus as one file.

00:01[music]
00:13Hi everyone.
00:13Thanks so much for coming.
00:14I'm actually really surprised that the room is so full cuz imagination engineering is like a really weird term.
00:21I'm really surprised that you showed up to learn more about it.
00:24Um the reason I called this talk imagination engineering is because I've been thinking about in how incredibly capable the recent models are, especially today with Fable 5 coming back.
00:37And I think that the new bottleneck will be to come up with like crazy ideas because it's going to be really easy to one-shot absolutely everything and anything very soon.
00:47And so I think that the thing that we can reflect on that will be the most valuable for the world right now is how to stretch our mind and how to
00:56invent things that don't think are possible right now.
01:01And the reason I took this um that I created with ChatGPT this image, it's the Library of Alexandria, which was like the center of knowledge uh many thousand years ago.
01:12And I feel like we're in a very similar period in our in the human history right now where we should be thinking about how to consolidate all the knowledge and how to
01:22create more knowledge for our species.
01:26Um and so I thought I thought today I could share with you a really weird experiment that I started uh a week ago.
01:35And I was one of the or if you don't know, I work at YC.
01:39I lead design at YC and I have the privilege to work with wonderful, wonderful minds.
01:45The partners there are incredible.
01:46The engineers that I get to work with are phenomenal.
01:49And um there's a wonderful person that I used to work with at YC and he's now at Conductor.
01:55Um his name is Lewis and he created a Slack channel in the Conductor Slack called Lewis Thoughts.
02:01And ever since then, he's been sharing his stream of consciousness of everything that hits his mind.
02:06And it is a way for everyone on the Conductor team to see what's going on in his mind as he's thinking about features and how to make the product better.
02:13And I was heavily inspired by his approach, and I did the same for the YC Slack, and I created Eve Thoughts.
02:19And for a week have been brain dumping everything that has crossed my mind.
02:24And 2 days ago, I asked Opus 4.8, I wish it was Fable, but it was Opus 4.8 on Saturday to make a website that encapsulate all the thoughts that I had in the last week.
02:37And it came up with something that is quite magical and phenomenal, and I kind of felt like um it was AGI.
02:45And I'm excited to share with you the result and to share the wonder and the awe that I feel towards technology currently.
02:55Um maybe to take a take a step back before I show you the website is I work at YC, and one of the big reasons why I work at YC is
03:04many probably know about this wonderful mind, Paul Graham.
03:08He's arguably one of the most intricate minds in our generation, and it's one of the reasons why I work at YC.
03:15And um what I think is truly phenomenal about PG is that not only he's a phenomenal thinker and phenomenal brain, but he also shares his brain and how his
03:25mind works with the world.
03:28And one of the main reasons why YC has been so successful is because his essays are still echoing to this day, and people are applying to YC because of his essays.
03:38And um I've been thinking, you know, we we hear very often about like building in public, you know, building open source or like sharing how you build things.
03:45But what about thinking in public?
03:48And it's basically what PG is doing, thinking in public.
03:51And this is the experiment that I wanted to run with Eve's thoughts, the Slack channel on the YC channel.
03:56The YC Slack.
03:58It was what if I thought in public and I allowed a few people that I highly trust at YC to have access to my stream of consciousness.
04:05And it does feel a little bit sci-fi.
04:08Um but at the same time it's sort of an experiment that I really wanted to see the light of.
04:13Um and see where it goes.
04:15So I can show you an experiment I can show you actually what it looks like.
04:21Uh evebufar.
04:24com And so this was an iteration uh no it was actually like an aggregation of all the thoughts that I've been dumping in this Eve Slack channel for a week.
04:38And it picked up on the fact that I love art.
04:41And so it allows me to customize the background here.
04:46Um it picked up on some of the quotes that I truly admire.
04:49It picked up on the projects that I've been working on at YC.
04:52Picked up on some of the media that I've been doing.
04:55It picked up on the tools that I use on a daily basis.
04:59It picked up on all the books that have changed my life.
05:03Some of them are in French because I grew up speaking French up until I was 21.
05:08Um the books that I want to read, some quotes.
05:11One One my favorite quote of all time is PG quote that says live in the future and then we'll build what's missing.
05:17I feel like it's a great prompt for everyone here.
05:20How can we live in the future and build and then build what's missing?
05:24Um another So there's this famous quote by Steve Jobs like computers are the bicycle of their minds and Gary always says that with Fable and these insanely capable models
05:36it's like a rocket mind like a rocket ship for the minds.
05:39It's no longer a bicycle.
05:41Um which I loved he made me laugh like on Sunday when he said that.
05:45Um and it also picked up on like a train of thought.
05:50Um, and like many, many thoughts cuz my brain has many, many thoughts.
05:53It's actually like sometimes overflowing with thoughts.
05:55So, I was able to capture everything as I was brain dumping in the Slack channel.
06:00Um, I can also share a little bit more about the fun things that it came up with.
06:05Like for example, um, it loves it knows that I love paper sheeters.
06:09Paper, if you know, it's a a new design tool.
06:13Um, I can show you the website if you want.
06:16I love their product.
06:18And I specifically love their sheeters.
06:22I think I can do it here.
06:23Specifically love their sheeters.
06:24They're all cloud code compatible and you can use them for all your creative projects.
06:27And so, uh, whoops, it picked up on this.
06:32And it allows me to apply sheeters to my background.
06:36I can hide this.
06:38And you can you get to see the most beautiful pieces of art in human history with some very fun sheeters.
06:45Just kind of fun.
06:47You can do it this here.
06:48And then you can even like customize all these things.
06:52And I think the future of design will be just a lot of sliders.
06:58Um, and I can revert.
07:01And it also allowed me to uh, I can like do dark mode for the reader.
07:09Um, it allows me to customize absolutely everything about the font and typeface and the width, everything.
07:15Oh, if you speak foreign languages, it also converted or translated everything that is on the website depending on whatever language you want.
07:23But I think going back to the how to think in public and how to build in public, I wanted to experiment with, okay, what if I made sort of a dashboard of
07:31what this website consists of.
07:33And so, what is the stack of this website?
07:35And also some of the an early version of a design system to keep everything consistent.
07:41Um, I also experimented with toolkit to allow to hold myself accountable to make sure that everything about this um this project as a webpage is uh complete.
07:53And so, Claude made this really lovely list of all the things that I should be that I should hit including like an open graph picture and things like that.
08:02Um, but yeah, there's so many things that I want to show here.
08:05So, I asked it to create a voice on MD which um it picked up on all the writings that it could find on the internet that was written by me including my tweets and everything
08:15and then it made it distilled it into an MD file that is my tone and what makes me unique as a person.
08:23And it's kind of crazy to read it.
08:26And I asked it to do the same for my for the design language of this website.
08:31And whenever I make a a change to the design of this website or create a new uh component, it automatically updates it.
08:39Um, and I can also show I created a few skills for myself that I can in invoke at any given point.
08:45Um but the real real fun project that I wanted to show today was we're in in imagination engineering and so, thinking about how the most beautiful fertile minds in history were thinking and what is the commonality between all of these beautiful minds.
09:01And so, this morning started at 10:00 a.m. at my favorite coffee shop in the marina uh with Opus 4.8 because Fable was not out at this point.
09:10I created this really fun tool.
09:12I call it Shape of Minds and it's a way for us to find commonality across different dimensions of the most beautiful brains in the history of humanity.
09:24Um and I can show you a little bit.
09:28It is uh highly responsive.
09:30You can just hover over all of these beautiful minds and it tells you what makes this person unique or in the dimension of thinking for example, how is Bach
09:43unique?
09:44And it's all like you can see them the spikiest minds uh based on this different dimension.
09:50So, I wanted to explore their thinking, their obsessions, their quirks, their origins, you know, it's interesting cuz here for example, there are a lot of Germans in these uh in these great minds.
10:04Um their routine, prolific output, workaholic, unsurprisingly I guess.
10:10For love, interests, worldview, religion, habits, knowledge.
10:16And because I didn't want to bore you too much with all of this overload of information, I asked Fable to come up with the highlights, the most interesting things that it picked up on
10:26uh when it came to the commonality or spikiness of some of these minds across the different dimensions.
10:32And there are really interesting things and I'm going to discover them with you because I haven't had time to read them before uh presenting here cuz this was generated about 20 minutes ago, right before.
10:44Um so let's see.
10:46I guess people these people like to to argue.
10:49Um a lot of them were childless.
10:54Uh not sure what this means.
10:57Um oh yeah, naps naps were very popular among the best minds.
11:03Um they barely ate.
11:06This is an interesting one.
11:10and yeah, anyway, all of this is public so if you want to uh look at the highlights, it's um it's quite soul nourishing and mind nourishing to look at this.
11:21Um and I also created a design so if you had not um picked up on this, the entire design language of this tool that I built this morning was
11:29in celebration of the Fable 5 campaign that came back.
11:33Um and so I asked uh Fable to extract all the butterflies from this and then turn them into individual components that I can use for the design language of this project.
11:47Um what else can I share?
11:49Um oh, this is a MD of it's a glossary of all the information that is displayed on this project.
11:56Super easily readable by the agents and it's a lot more efficient than having the agent look at this page, obviously.
12:03And funny enough, I made this page this morning when I started working on this project and I knew that I had a a deadline to hit and so I made a timer for myself
12:13uh when I started 10:10 a.m. so that I knew exactly how much time I had to work on this project to accomplish the task that I needed to accomplish.
12:22Um and yeah, it's all like software on demand.
12:26Whatever like whatever stream of consciousness you have, you should just ask an agent to do it for you.
12:32Um like all of this is AI.
12:34I have generated this picture which I kind of thought was cool.
12:38You can probably recognize some of these cool faces like Da Vinci, Salvador Dali, Marie Curie, Nikola Tesla, Einstein.
12:47Um and yeah, they're only I have 5 minutes left.
12:51What can I share?
12:54I can share I can share so I love to make people smile.
13:01I love to make people smile when I can.
13:03And um a great way for me to make people smile is to use a lot of emojis um especially in the company Slack.
13:10And um it was always a pain to find the emoji that I wanted to use to make people smile in the Slack.
13:15It was like very inefficient for me to find that.
13:18So I created this tool for myself where I can just like search for a random fun stupid Slack emoji as a reaction um for my Slack and same thing for these here.
13:30They're kind of fun.
13:30I specifically like this one.
13:33And this is like the regular iOS emoji picker, which I kind of always struggle with.
13:39I never find the thing that I'm looking for and so I just built it for myself and you can like by a click just copy.
13:45Another fun thing that I built is I always, you know, we're all students of life and we're all trying to learn as much as possible and with these these new models we can
13:55and
13:56learn at a pace that was never possible before.
14:00And so whenever you have a stream of consciousness about something that you'd like to work on you should just ask it.
14:06You should you should just get ask a a model to prepare like a little like report for you on this topic and that's what I started doing a few few days ago.
14:14All these things are things that I would have that I love to would love to deepen my understanding of and would still make it very efficient.
14:23And so I just explored a few concepts like the 10 principles of good design and um like Renaissance patronage is also something that I'm fascinated by right now.
14:35And so it just cooked up like a short very short report for me that I can digest as I'm on my way to work or I'm coming back from an event or something like that.
14:44That's why I'm so excited about Cloud Workspaces as well is because it's going to be very possible very soon with Conductor Cloud to be able to spin off a bunch of agents on the go
14:58as I'm like traveling from one place to another.
15:03But yeah, feel like I can I can stop there.
15:08I don't want to overload you with a lot of things, but another interesting thing that I created is like this the backlog of all the changes on this website
15:16as I was making the final tweaks to the shape of mine a few minutes ago, 25 minutes ago.
15:22And you can see like the evolution of that repo over time.
15:26Um But yeah.
15:30I guess I can I can end early, and if you have questions, I am happy to take it.
15:35Uh to take questions.
15:37All of this is an experiment, and I would love to learn from you guys on how you're experimenting with models.
15:43Um Yeah.
16:02[music]