How a Remote Company Builds AI Fluency — Em Shreve, Automattic

AI Engineer · 15 min · 105 sentences · from YouTube's caption track

Each timecode opens YouTube at the start of that sentence. Line anchors (#s42) are the cue ids in the WebVTT, and every line carries its start and end seconds. All transcripts has every talk, and the whole corpus as one file.

  1. 00:00All
  2. 00:01[music]
  3. 00:12right.
  4. 00:12Hi everybody.
  5. 00:14Can you hear me?
  6. 00:16All right.
  7. 00:16So, uh, my name is M. Shrieve and I work at Automatic.
  8. 00:22Um, and if you're not aware of what Automatic is, we are the company behind WordPress.com and Tumblr and a number of other properties.
  9. 00:32Um, and we're a fully distributed company uh with over 1,400 uh people in 82 countries.
  10. 00:40Um, and I'm here today to talk about our approach to uh, AI enablement and upskilling our organization um, to use all of these uh, new tools and ways of working.
  11. 00:56Um, so our bet is that you don't just get good quality learning or work out of just handing people the tools.
  12. 01:07you need to give them real time to learn and uh experiment.
  13. 01:14Um so what we've been doing is running these two week um enablement programs where we bring people in in person for a twoe immersive experience.
  14. 01:26And uh the way that we do that is um through 50% facilitated learning um through our uh learning and development team and our AI enablement team.
  15. 01:39We pull together workshop hosts from within the company to run workshops and hands-on um activities.
  16. 01:48Uh and we'll look a bit at what that curriculum looks like shortly.
  17. 01:53Um and then 50% real project work.
  18. 01:56So, we have folks bring in um real work that they want to get done or a tool or dashboard that would help them and their day-to-day work.
  19. 02:07Um or these can also be creating new skills or MCPs to enable them to work faster outside of the program.
  20. 02:17And another large part of this is uh encouraging peer sharing.
  21. 02:23um so sharing their own workflows to show um kind of the art of what's possible.
  22. 02:30And uh as they work throughout the two weeks, we also do a number of uh project demos at the end of each day.
  23. 02:41So we've uh we've ran three flavors of this.
  24. 02:45um our main set being for engineers where we go uh a lot more in depth um getting into applied AI.
  25. 02:55We've also um experimented with crossf functional programs um with product engineering and design getting together in a room and discussing kind of the future of of how we all work together
  26. 03:08um with with these new tools.
  27. 03:11And then we've also extended into non-technical teams and run workshops with our finance group, our executive leadership team um and other functions as well.
  28. 03:25So our engineering curriculum starts the first few days uh covering the basics skills and how to create them.
  29. 03:35um learning how to use MCPS and specdriven development um as well as kind of the foundations of how to use AI responsibly and how to um apply it in a way that's mindful.
  30. 03:49Um and then we start getting into deeper topics.
  31. 03:53Uh creating MCPs um for new functionality, getting into the hook system of codecs and claude and being able to extend the harness that way.
  32. 04:05Um up to uh autonomous agents and running routines and such in the background.
  33. 04:13Um and then we end on some different applied topics.
  34. 04:17Um so again automatic is behind WordPress.com.
  35. 04:22So uh we normally run a workshop on applied WordPress AI um and some of the cool features that are in WordPress core uh around AI as well as uh being able to create your own personal assistant.
  36. 04:36So we really try to walk people um from the foundations up into uh the ability to start creating these new things for themselves.
  37. 04:49And one thing that we found out is you cannot just write this curriculum once.
  38. 04:53As we're all aware, AI is constantly changing from day to day, week to week.
  39. 04:59The top model might be different uh depending on the latest release.
  40. 05:04Um so we're constantly needing to update the curriculum and stay current to make sure when we running these programs, we're teaching the right thing and we're not teaching six months out of date.
  41. 05:17Um, another interesting part I wanted to highlight here is we have our own uh internal uh MCP server called context automatic.
  42. 05:28And this allows us um to rapidly add new tooling sets for MCPs that might not exist or that we want to build our own um like governance and observability
  43. 05:40layers on.
  44. 05:42Um, and one of the cool things that, uh, I'll highlight shortly is, uh, some of the projects coming out of these cohorts is extending these abilities.
  45. 05:55So, as people go through the capabilities, um, compound and we're able to do more as a company uh, because of that.
  46. 06:04Another main focus of our program is that these aren't just a number of people that we're sending through.
  47. 06:14We're also wanting each person we send through um to be a multiplier uh within the company and extend our reach to the folks that we can't get to yet.
  48. 06:27Um, so so far this year we've ran seven of these cohorts of groups of about 45 people.
  49. 06:35Um, and we're aiming to get around 600 people through these programs by the end of the year.
  50. 06:44Um, which is about 2/3 of our engineers as well as uh some of those other focus areas that I highlighted at the beginning.
  51. 06:54And we would like to equip all these people with uh ways of sharing their knowledge out and again extending our reach.
  52. 07:03So we've tackled this in a few different ways.
  53. 07:07Um we are beginning a guides program or um I think other companies call this like their champions program.
  54. 07:16And what we want to do is extend our team's reach into other areas and have these um like top practitioners that we've identified within the company be able to help us out and uh continue
  55. 07:32spreading the knowledge.
  56. 07:35Um because we're distributed, we also have began these local AI gettogethers.
  57. 07:41So people that have gone through the program um are able to then run these like little events within their regions and um run workshops and we'll help support that as well.
  58. 07:56Um and we've done about 10 of those so far in various different areas of the world.
  59. 08:01Um and it's been been exciting to see like what some of these people that have gone through the program have have gone on to do and teach.
  60. 08:09Uh we also um organize these things called AI ride alongs and these are little workshops that we run um basically showing how you work, how you use a different tool.
  61. 08:23Um because what we found is seeing someone in your similar role or um in in a similar job to you, being able to see how they use it uh is a lot more
  62. 08:36um easy to grasp than just you know talking about the concepts.
  63. 08:40Um and then we're also attempting to build a shared skill and MCP infrastructure.
  64. 08:48So again that context aid C um system that I mentioned but also uh encouraging people to create and share skills and build uh on top of each other's work
  65. 09:01so that we're all kind of building um towards the same kind of platform.
  66. 09:08And then we have an always on uh help Slack channel where we also ask people that have gone through this program to help out um and just kind of
  67. 09:19be available for anyone newer uh to working this way to have a place to come and ask questions at any point of the day.
  68. 09:31So, I'm going to share a few of the the metrics that we've been tracking and um improvement we've seen throughout the program.
  69. 09:40Um, one of these is intentionality and um just applying to applying AI to your work in a more thoughtful way.
  70. 09:50Maybe these people came in at the beginning just using it as a chatbot or um you know not fully using an agentic workflow.
  71. 10:01Um so having people be a bit more intentional at how and when they apply AI.
  72. 10:07Um flow which is like how well they're able to integrate AI into their workflows.
  73. 10:14um if people feel as if um they're able to use it in a way that makes sense for them and not just using it for AI's sake.
  74. 10:23Um and then the the sharing part again is very important to us so that we can continue um reaching other people in the company and um kind of making everyone
  75. 10:37uh a a teacher and an expert on these topics.
  76. 10:42Um we also track uh individual lift on various metrics such as um skills and custom commands um how comfortable they feel using and applying MCPS and uh other topics like context management
  77. 11:00um and what we've seen uh from doing various surveys uh after the program.
  78. 11:08So we'll do one 72 hours after uh 30 days after and 90 days after.
  79. 11:15People will continue growing within those 90 days and um being able to apply things more and like they've had more time to experiment and try things.
  80. 11:29Um so we're still seeing people like gain confidence and experience uh even once they've gone through the program.
  81. 11:42Um so I wanted to highlight just a few of the things that folks have built um just within the two weeks of the program.
  82. 11:53Um one of these is uh an agentic analytics system.
  83. 11:58So uh we have WordPress has a uh e-commerce platform plugin called Woo Commerce and some of the people that went through our program um created a a gentic system for asking questions about your store and getting back answers.
  84. 12:17Um a number of folks that go through uh build on top of context a C. Um so one of our earlier cohorts
  85. 12:26[snorts]
  86. 12:27um they wanted to be able to use uh some of these tools for support um and built a Zenesk connector um which now we've had adopted through various teams throughout the company.
  87. 12:39Um we've built other providers in there that uh might not have a native MCP or again because we wanted to add additional observability there.
  88. 12:51Um we've been building out our own agent skills directory.
  89. 12:55Uh we don't prescribe a single tool so folks are able to use codecs or claude or uh any other number of tools open code etc. Um so we wanted to build our skills directory in a way that can be used across all of those.
  90. 13:13Um and the whole skills directory actually came out out as a project from one of these cohorts as well.
  91. 13:20Um and then finally another one I wanted to highlight here is uh guided admin support.
  92. 13:28So, um, during a help session, say you want to show someone exactly where something is, uh, within the dashboard, um, they built a tool using, uh, cloud code that allowed them to be able to,
  93. 13:45um, guide and lead a session, highlight different parts of the screen.
  94. 13:50Um, and this actually came not from an engineer, but one of our support folks um that felt a bit more comfortable after going through one of our programs.
  95. 14:01And that is the end of my presentation.
  96. 14:07But the one takeaway that I wanted people to take from this is uh give people real time to actually experiment and learn.
  97. 14:18um you can't just throw a bunch of tools at them and expect their way of working to change.
  98. 14:23You need to to make space and give an environment for learning um and and make that like the star of whatever your education program is.
  99. 14:34And uh I will be available for questions at our booth which is uh the automatic booth right over on the other side near that stage and the swag pickup.
  100. 14:47Um, so I'll be there for a little bit after this talk if you want to talk about anything I talked about here.
  101. 14:54Um, or you'd like to hear more about how uh how WordPress.com and Woo Commerce are uh embracing AI um with our official connections and MCPs.
  102. 15:09Um, so please stop by the booth.
  103. 15:11Um, and yeah, thank you.
  104. 15:15[applause]
  105. 15:30[music]