On today’s episode of the Me, Myself, and AI podcast, Andrew Palmer, senior editor at The Economist, describes how organizations can experiment with generative AI while balancing speed, quality, and risk. At his own organization, Andrew and others test artificial intelligence with human oversight to develop editing and publishing efficiencies.
As the host of The Economist’s Boss Class podcast, Andrew speaks with leaders as well as early-career professionals, and highlights interesting insights from recent conversations around skills and hiring.
Subscribe to Me, Myself, and AI on Apple Podcasts or Spotify.
Transcript
Allison Ryder: How do we experiment with AI in ways that are productive but also safe? Today’s guest explains how he’s spurred new development projects with AI and recounts how various leaders he’s spoken with think about the technology.
Andrew Palmer: I’m Andrew Palmer from The Economist, and you’re listening to Me, Myself, and AI.
Sam Ransbotham: Welcome to Me, Myself, and AI, a podcast from MIT Sloan Management Review exploring the future of artificial intelligence. I’m Sam Ransbotham, professor of analytics at Boston College. I’ve been researching data, analytics, and AI at MIT SMR since 2014, with research articles, annual industry reports, case studies, and now 13 seasons of podcast episodes. In each episode, corporate leaders, cutting-edge researchers, and AI policy makers join us to break down what separates AI hype from AI success.
Today, we’re joined by Andrew Palmer. He’s a senior editor at The Economist, where he’s the author of the “Bartleby” column and the host of the Boss Class podcast. His current podcast season explores how the use of generative AI is changing management and jobs like ours. Andrew, welcome.
Andrew Palmer: Hi, Sam. [It’s] nice to be here.
Sam Ransbotham: Some of our listeners may not be familiar with The Economist or the Boss Class podcast. Can you give us a quick intro?
Andrew Palmer: The Economist, for almost all of its history, has been a weekly news magazine. Now, of course, we’re available in lots of different formats. We’re published out of London, but we’re global in our scope, and we cover economics, business, politics, science, technology, and much more. The Boss Class podcast is a serial narrative series podcast that I host on management and the workplace. We’ve had three series to date, and, as you said, the last one was specifically devoted to this thorny topic of generative AI in the workplace.
Sam Ransbotham: It is thorny, and I think you do a good job of exploring some of that thorniness. One of your colleagues, Ludwig Siegele, said on an episode — and I pulled this out — “The Economist embraces change. We think technology is good and should be used.”
I always find that pro-innovation bias a little bit interesting because I have a background in computer security, where we may have a little different bias about whether technology should be used. But in this case, I think I agree with The Economist. How would you describe the journal’s overall philosophy toward AI?
Andrew Palmer: I would say “open-minded experimentation” is probably the way to think about it. We have not rushed headlong into it. We have a variety of internal projects to see how we can use it in our journalistic processes. For example, we fact-check everything that we do. There’s a research team there, which has to pull through a ton of stuff. Is it possible to make their lives easier while still having humans do the critical work of checking?
Similarly, journalists have to conform to a style guide, a particular way of working. So can we make it easier for them to check that their copy is doing what it should before it gets to editors, who then are the humans in the loop? There’s a lot of internal stuff.
And then we have experimented with things like AI-generated transcripts of podcasts that are available to people on our site, and we have more secretive, “If I told you I’d have to kill you” kind of stuff around what we might be doing in two to three years. So there’s a whole panoply of things that we’re doing, but we’re always very, very clear that we have a particular brand associated with high-quality, human-intensive processes, and there’s a lot riding on us getting this right. We move fairly cautiously as well.
Sam Ransbotham: One of the ideas I think that came through [in] a few episodes is this idea of a “jagged frontier,” that artificial intelligence has really amazed you in some areas but [has] also been unexpectedly disastrous in others. How does that affect the way you think about experimenting?
Andrew Palmer: I think it probably comes back to that overarching mindset of being cautious so that you don’t thoughtlessly embrace the technology, let alone if it’s public-facing. So everything goes through an experimentation phase. One of the things that’s become apparent — and you’d see this in every kind of organization, I think, [that’s] grappling with this — is that you need to have really experienced people in the loop. For us, [those are] editors who’ve been in the newsroom for a very long time, working out what counts as quality, providing feedback on the experiments that we run so that over time it gets better and better and better, and asserting a pretty high bar for what counts as good enough.
That’s the way in which a mindset gets translated into actual processes for evaluating and checking. And it’s a new way of working for us. [For] most of our history, the journalists have kind of controlled absolutely everything, and now it has to be much more collaborative, especially with this technology.
Sam Ransbotham: What’s surprised you? What’s been the biggest positive surprise and maybe the biggest disappointment?
Andrew Palmer: I’ll take an example of my own, playing around from the latest season as a sort of roller coaster. So you know, almost every journalist on earth now is doing vibe coding. I’m no different there, but at the time, it seemed like we were really breaking new ground. That’s all recorded, but I’m a non-coder, absolutely no idea what I’m doing. You’re the expert in this conversation for sure.
We have a style guide, which I mentioned to you, which is basically our bible on how you should write, all the sort of grammar, hatred of Americanism you’ll be shocked to know — all sorts of rules like that, which you can thumb through a big PDF to get to. You can leave it to your editor, but ideally you would have something that could basically just check your copy against this. Ludwig Siegele, who you mentioned earlier, had been waiting for a year to get developer time to build this.
It was relatively simple, but [in a] busy organization, lots of people with different things to do, this was low down the queue. The magic of this was I went away, and in 75 minutes had built an extension, which did check copy against the style guide. Now when I say, “I built,” I was more like a sort of puppet. I had no idea really what I was doing, but by using Claude, this thing was generated. That was kind of amazing to me. I felt like I’d achieved something, which was totally beyond my purview, [and that] I just would have been utterly unable to do, and it clearly bypassed our internal bureaucracies.
Then, the kind of disappointment that you mentioned is that actually, we’re not going to be able to just push this out magically to people the next day. There’s an awful lot of governance to think around on this. The behind-the-scenes stuff around what architecture, what software, what our data processes are all had to be thought through. In practice, what I had built wouldn’t have worked scalably.
So anyway, at that point, a bunch of people who really knew what they were doing took it over. And it did result in something fast. It definitely accelerated the process, gave them ideas to work with, but it was also clear that I wasn’t going to be able to sort of magically bypass all organizational processes and change things.
I don’t know if that’s disappointing or not, actually, but there are other examples where this thing is just giving me kind of nonsense answers, hallucinating, all the stuff that you talk about in the show week in, week out. But I think that’s probably the best example of moving from this sense of euphoria, like a whole new world has opened up, to being brought back down to earth.
Sam Ransbotham: There’s a truism in software: If you ask any software engineer, “How far along are you? Is it close to done?” Oh, they’re 90% done. And that first 90% takes about half the time or a quarter of the time, and that last 10% is really hard, and it always takes a lot of time there.
And I think that’s what we’re seeing maybe with vibe coding. It’s doing that 90% pretty quickly. It’s making the initial screens or whatever, but like you say, there’s a lot more to that process. [When] I think about extrapolating with artificial intelligence, I think we have a tendency to draw those lines linearly or even exponentially, but diminishing returns may be the more normal shape, especially, as you describe there, with all the other processes.
Andrew Palmer: Can I ask you something, Sam? Are you seeing vibe-coded apps for yourself, and do you notice a difference?
Sam Ransbotham: I’m super into coding in general. That’s what I do as a hobby, and I love it. What I find is almost exactly what you’ve described, that this ability to prototype something quickly is amazing. You can just throw up something and get a sniff test of “Is this worth any further investment?” without, like you say, waiting on your bureaucracy to come along and take a year’s backlog.
But you can’t fool yourself into thinking that’s actually going to be production code. And so you learn a lot from that, but I don’t know about actually dropping anything in there into production, because by the time I get the code, I’ve rewritten every bit of it before it actually goes into something that’s production. But it gave me that sniff test pretty quickly.
Andrew Palmer: One of the people we spoke to was Anton Osika, who’s the boss of Lovable, one of these big vibe-coding platforms, Swedish based, and he had this nice phrase — “Demo, don’t memo” — as a way of thinking about this [that’s] really good for prototyping. Don’t do PowerPoints. Don’t write long documents. Just build the thing and show what it can do. But he was also very clear that you do not want to be putting stuff directly into production environments, which sounds totally consistent with what you’ve said.
Sam Ransbotham: I know you talk about jobs a lot, but one of the things you touched on there was this delay that you had waiting for the style checker to come along through the normal bureaucratic processes. And you were able to sort of get a quicker smell on that. My sense is that most organizations have giant backlogs of projects.
Andrew Palmer: I’m reminded of a conversation with Hannah Calhoon, who’s the head of AI at Indeed. You may indeed have had her on your show. [It’s a] big jobs marketplace, as everyone knows, and she described the organizational problems that come from [when] suddenly everyone can generate a lot of code, which means a ton of code has to be reviewed by people. It’s a bit like a sort of waterbed effect, right? I mean, the lumps of work are disappearing in one place, and they’re popping up somewhere else.
I guess the question is: I think you said that you would basically do the sniff test, but then you’re writing everything from scratch again. Is there a risk of going halfway down a route with vibe coding and then realizing, “Actually, we didn’t want to start from here, so we’re going to need to redo it again?” Thinking that through is part of the organizational challenge of this. There’s clearly a technical challenge, but actually [the way] we design things to avoid really bad outcomes is kind of also a blocker to fast progress.
Sam Ransbotham: But we don’t have to know that yet, though. We’re all, like you said, experimenting. Everyone’s experimenting with this. We don’t have to know exactly how these are going to fit into organizational processes yet without learning some. All these tools that we’re talking about, they’re going to improve. [With companies] like Lovable that you mentioned and others, they’re going to get better over time. I think we’re sort of in charge of our destiny here in terms of how that plays out and what we choose to invest in and what we don’t choose to invest in.
Andrew Palmer: I do agree with that in theory, and then there’s a whole load of incentives at work in the system, which in practice constrains your freedom to maneuver. So if you have a bunch of people in the C-suite who are under a lot of pressure to realize productivity gains, it’s quite possible that they’ll run. … We’ve seen it, right? Part of the story of the initial years of generative AI is running toward stuff without necessarily thinking about the organizational consequences.
Sam Ransbotham: Talk about those incentives. What incentives do you see out there within organizations that are in tension?
Andrew Palmer: Lots of boards are putting a lot of pressure on CEOs and their peers to come up with very material returns on investment. That can be cost savings in terms of letting people go, or it can genuinely be a jump in output. Neither of those things [is] necessarily great. It may be that you’re cutting people prematurely. It may be that you’re actually sacrificing quality over quantity.
I’m trying to think of an example. Johnson & Johnson was another guest on the show, and they had a very conscious, sort of “let a thousand flowers bloom” approach to generative AI in the initial years. I don’t think they had disastrous outcomes, but they also quickly found … this problem of bottlenecks emerging in various places.
It’s the waterbed again, right? That very big organization had lots and lots of people independently come up with the same kind of workflow to improve, so something like invoicing, making that faster, when all that would do is create a whole bunch of invoices that would then land on finance who weren’t expecting them, right? So there was a sort of chaos problem.
But more importantly, the lack of prioritization meant that there was a lot of work being done. Only 15% of projects were delivering 85% of the value. The rest of it, maybe there was benefit, people learning, etc. But in terms of a payoff, not so much. So they have now pivoted to a much more priority-driven, centralized approach where there’s a central AI council.
[It] sounds a bit Star Wars, [having] a central AI council, a central data council signing off on stuff. But it feels much more intentional, much more directed. You see surveys with C-level executives saying, “We haven’t seen massive productivity gains yet. In the next three years we expect to.” At some point, they’re either going to have to say, “Well, none are coming,” or they’re going to be bound into a kind of like “We’re going to make this happen.” The incentives to show results, they’re pretty powerful.
Sam Ransbotham: My more cynical take is I think we see a lot of job cuts due to AI announcements that I deeply suspect [are using] AI as a scapegoat. You have a choice of saying, “All right, I made a really poor decision and overhired,” or “I made really poor decisions or it’s this AI thing.” It’s really nice to point to the exogenous thing.
I want to come back to something that you mentioned before. We were talking about coding, but I think it’s a bigger issue in general. Maybe we could expand on that. Your waterbed is that you created an ease of creation, like with these tools that [have] the ability to generate. I mean, it’s even in the name: generative AI. We don’t have an evaluative AI. That’s not a huge massive trend out there. GenAI is the topic, not evaluating.
I think we’re seeing that certainly in science. Open repositories like [Internet] Archive have been overwhelmed with submissions, because the hard part is less about the generating and more about the figuring out what’s worth consuming, particularly in our time-based attention economy. How are we going to work around that?
Offer some hope. Do you have any thoughts about what’s going to happen about the world when we are able to generate everything so quickly?
Andrew Palmer: The example that comes to mind and the one that I just played around with just by myself was in the recruitment space, where there is this sort of uncontrolled generation of content on the candidate side, and then on the recruiter side, you are forced to use AI to cope with this bombardment. So there’s this sort of strange arms race.
My example of this was I just signed up to an auto-apply software provider, put in some sort of details, really scant details. … I could have spent more time on it. [I] sort of went off, puttered around for like an hour, came back, and found that I’d applied to a hundred jobs. I had no idea what they were, and they included being the head of operations for the city of New York and director of the Iran and Afghanistan Veterans [of America]. I mean, you can probably tell from the accent why I’m not the obvious person for this. It seemed sort of ludicrous, right, that you could fill up people’s inboxes. So I’d like to apologize to the Iran and Afghanistan Veterans association.
But, obviously, on the other side of that, then you need to have this automated response. No one is happy with this. It’s like a really bad equilibrium that’s been generated, and you can see that in other places, too.
So what’s the way out of it? I guess more humans might be one way out of it. You could intentionally insert humans into processes on the recruiter side and kind of see if that works in some way, but that doesn’t feel very scalable.
You could be transparent about your AI policy, saying, “It’s fine to use AI, but this is how we want you to use it,” or have an AI-specific kind of question that proves how you would use your AI fluency to [the] best advantage, whatever it might be. There’s some evidence — it’s anecdotal — that being transparent about AI use can actually reduce the amount of bogus applications. And then I guess the very long-term answer, which is a little too nirvana-like for me to buy totally.
Sam Ransbotham: Give us the dream.
Andrew Palmer: Well, this is what people in this world say: Eventually the AI is going to be so good that it is going to hunt out candidates. There’ll be what they call reverse apply. So you don’t, as a candidate, need to worry about applying to anything. The AI is going to sort of know from your entry on a site like Indeed exactly what you are suited for, understand your preferences and experience, and, basically, they’ll come to you — no need for all the kind of slop that’s already in the system. Maybe that will be the case over time. I’d really like to know whether you think that’s plausible, but it seems like we’re going to spend a long time getting there, and in the meantime, it’s kind of bad for everyone.
Sam Ransbotham: I think we [can] make some analogies to the deepfake detection that’s going on. Every time we improve the deepfaking, we improve the deepfake detection, and we go back and forth. So as you generate applications for a job, you’ll have the application for a job detector. We’ve seen this with, for example, search engine automation where you put the right keywords on your website, and you get “hired” in the search engines. We work through many dynamics like this.
I think actually on your episode you had a recent graduate, Kat Harrison-Gaze, who was talking about the experiences of applying [in] the job market. Can you give some grounding in an example?
Andrew Palmer: Kat was at Oxford, so in a U.K. context, [she’s at a] very, very prestigious university, clearly very smart, should be someone who employers want. There are lots of things feeding into this. We shouldn’t blame this only on AI, but she described two worries.
One is the process of applying and “How do I navigate this?” She has a suspicion of AI. She’s worried about cognitive dependence. She valued her own ability to think things through. It was like, “If you touch this thing, it’s going to infect me and change my ability to think,” was kind of part of it.
And then the second worry was just more generally, “If you think about a career in decades, where the heck do I put my chips? What is the career that makes sense going forward?” Both of those seem to me to be totally reasonable worries. It is really hard to navigate the recruitment process right now. I don’t think not touching AI is the answer, by the way.
So the advice to Kat was, “Use AI, don’t shy away from it. That’s not the way to think about it.” And the advice for employers was, “Here’s this very smart person who is determined to think independently. Take a look at her.”
Sam Ransbotham: What you’re describing, I think, is as we move toward machine-to-machine interaction … formerly, back in the old days, people would walk around from office to office and apply for a job and maybe drop off a resume and meet someone in person — that became online. What you’re sort of describing is a future where your factor talks to my factor; your agent talks to my agent. And much like the ballplayers who have agents to negotiate on their behalf, you’re kind of describing where you’d have recruiters negotiating on the behalf of the company, agents negotiating on behalf of the employer, and there’s not necessarily any need for those to be humans, and that can be a machine-to-machine interaction. Is that the future we’re headed toward?
Andrew Palmer: I kind of hope not. I guess it depends. … In the first stage, I can totally understand that. It’s almost essential, right, at this point, because it becomes hard to see how it can scale. But as long as there are humans in workforces — and, by the way, this is a process which is done exceptionally badly by humans right now. It’s a really difficult process to get right, but a lot of it can be improved by humans taking the time to test whether someone is a good cultural fit by being honest. “This job is good for these reasons but bad for these.” Those kinds of things don’t have to be done by humans, but they generally work better if you have humans talking things through. So humans have to be in the loop at some point, I think. As long as we are working with other people, [then] cultural fit, the values of an organization, all of those things are totally essential to a good hire.
You could imagine a kind of machine-led, skills-based process, testing whether someone can do the job. But, actually, what motivates them? Why are they joining? Would they be a good fit? Do I want to work with this person? All of those kinds of things. I don’t feel like an agent is the right way to answer those questions.
Sam Ransbotham: Maybe it’s just because that’s what I’m comfortable with in terms of people [who] I work with … but as you say, we do a poor job of that historically. We make biased decisions. We make decisions based off of attributes we should not make those decisions on. I find it somewhat appealing that perhaps the increased automation could help us at least see that or at least raise potential candidates [who] our biases may have kept us from.
Andrew Palmer: That’s true. [Psychologist] Danny Kahneman, obviously, was very, very pro the algorithm being in every process and would bet that was way better than any human. I think probably it’s a combination of both, right? I mean you have a rules-based algorithmic way of stripping out bias in the way that you ask questions, whatever it is. Still, fundamentally, there’s something important about getting on with someone [who] is quite an important part of a hire.
Can I ask about arms races? Sorry to kind of turn the tables, but you’re in cybersecurity, right?
Sam Ransbotham: Yeah, that was my dissertation research back in the day.
Andrew Palmer: That sort of arms race problem — you’ve got an AI sniffing out weaknesses and an AI trying to patch them. What’s the end point with that, and what’s the role of the human in that world?
Sam Ransbotham: I’d love to know the answer to what that’s going to be, but certainly it’s big. We’ve seen so much automation on things that used to be human penetration testings and these sorts of things. That’s all become largely automated, but there’s something fundamentally clever about people [who] figure out ways of both protecting and designing incentives that, I think, still [are] winning out in many ways.
Now, what happens is, as we get the incentives clear and we get a structured set of rules, the machine sort of takes it to the hyper-refined level, but then someone will come up with a different approach or a different idea. And, unfortunately, in security the common problem is that the humans are the weakest link. We could attack your password all day long, but it’s going to be much easier just to go in your office and take a look at what you’ve got written on the sticky note on your desk or trick you into revealing it. So I think we’re seeing that the mortals may be the weaker link here.
I mean machines because only machines can react that quickly. But I’ll pull back to one of your episodes on the Oura Ring. The one way of attacking a company would be a refund attack. I mean that’s not what we think of as a traditional cyberattack, but a refund attack might be complaining about something wrong with a product in order to get a refund. And you had the example of the Oura Ring. … Why don’t you describe it? The AI agent diagnosed the issue, checked the policy, and then ordered the replacement.
Andrew Palmer: Yeah, it was exactly that. We’re talking to Mike Krieger, who’s one of the people at Anthropic in their new products division, cofounder of Instagram. He was talking about what was on their road map, and obviously, inevitably, we started talking about agentic stuff. He recounted his best customer service experience at that point. The Ring [camera] seemed to have a battery problem, interacted only with an agent. And this thing basically sort of decided for itself [that he was] entitled to a new Ring. It asked for his address, and off it was packaged. And he regarded that as the single greatest customer experience he’d ever had.
To your point, though, what’s to stop the AI [from] just giving you batteries for life? That’s in the guidelines, right? It’s like if there’s a certain threshold number of or percentage rate of refunds that are given out by an agent, then you stop, and you’re kicking it to a human or another AI model.
So there’s a lot in the governance there. And on that I had a conversation with Bret Taylor, who’s the chairman of OpenAI but the [co]founder of Sierra, which is another customer service agentic startup. And again, metrics were super important in getting this right. So initially, they were thinking, “OK, so any call that doesn’t require the agent to hand off to a human is a successful call.” And then they realized, “OK, well, this is totally gameable. So we’ll just never hand off to a human.” Hundred percent success. Everyone’s happy. And obviously that’s not right. So now they have a combined metric of proportion of handoff calls but also Net Promoter Scores from customers who’ve experienced interacting with the agent. So that blended metric seems to work.
That feels totally obvious, but it is kind of the bread and butter of implementation of good management. What’s the problem you’re trying to solve? How do you measure success? It’s totally fundamental to this being got right. And that’s a simple example of how they’ve got to a decent metric.
Sam Ransbotham: Yeah, that measurement is a big thing. I think one thing that’s happening is that these tools are helping us measure things differently, so we can measure things we never could measure before. We’re collecting a lot more data, and that’s great. But it is pointing out that many of the existing measures may be … I think your phrase was gameable, that once people figure out what that metric is, then they will do something.
Let me switch to you. Our show is Me, Myself, and AI. How did you get interested in this? Tell us a bit about your background.
Andrew Palmer: I’ve been with the magazine since 2007, [and I’ve had] multiple writing and editing jobs covering a variety of things, from Latin America to finance to [our] data journalism team, Britain [editor], etc.
Most recently, I’ve been writing on management and work. And most of what we do here at The Economist is look from the outside in. It’s big impersonal forces at work, macroeconomic, geopolitical, technological. I’m the person inside the workplace looking out, and sort of looking at humans as a byproduct of that, like how we all interact.
I’ve been doing that for a while, and very obviously, AI is affecting the workplace and affecting us as employees and affecting managers, and raising all sorts of questions. So it was a very natural thing for me to start to write about it. And I think it’s one of those super-interesting intersections of you’ve got this incredibly scientific, cold sort of machine technology, and then you have this unbelievably messy soup of emotions, which is what a human is, and putting them together is really interesting to observe.
[Here’s] a little sneak preview, but it won’t be a sneak preview by the time this goes out: I’m writing this week on the one thing that everyone can agree on. It’s great that AI is going to get rid of grunt work or drudge work. I’m not totally sure about that, because, for humans, drudgery, in the right dose, is really good. It’s really good. There’s a bit of agency, because you can get stuff done. You can kind of relax a little bit because you can’t be tote on the entire time. There’s some evidence that mind wandering is really good for creativity. So there’s a problem with the idea [that] we’re all going to be maxing out on higher-order tasks the entire time. We’re just not built for that. So that’s the kind of territory that I’m in.
Sam Ransbotham: I think that’s pretty fascinating. It is true that only by sort of pausing and thinking and reflecting, and it takes a bit of not constantly being on, to have those sorts of ideas. That’s certainly counter to the “Oh, you’ll get rid of the drudgery.” Now, on the same hand, there [are] certainly lots of our jobs that are true drudgery, and so I think the trick is we try to figure all this out. How much drudgery is the Goldilocks amount?
Andrew Palmer: Again, you get back to incentives. A manager of a certain mindset might think, “OK, puttering around is not something I want anyone on my payroll to be doing ever,” right? “Let’s go out there and do sort of cognitively intense stuff all the time. It’ll be amazing.” So there’s also a kind of mindset shift there, like we couldn’t get rid of drudgery before — it was just part of life. What if it’s an option to get rid of it all? How would you think about that?
I spent some time at an air traffic control center once, where their job is to think about, “What’s the optimal performance environment that you do not want these people to be below their A game?” So there’s a really interesting balance they’re trying to strike there, between you don’t want to overload, so [you need] limited session timings then and mandatory breaks, but you also don’t want to understimulate because [with] too much boredom, basically your attention starts to veer off in ways which are not great if you were in charge of air traffic. So they have thought about it, right? It’s sort of a human factors discipline. And, weirdly, it’s probably coming to every office, just in a much less high-stakes way.
Sam Ransbotham: One of the things that you mentioned there was that before, we didn’t have the ability to automate these things, and so we didn’t have to make any choices. Now that we have these abilities, we have to make some hard decisions. What kind of skills help people make those choices? I’m in a university, help me out here. What should we be helping students learn? What kinds of skills help them make those sorts of decisions?
Andrew Palmer: Oddly enough, I use the term human factors, which is its own discipline, right? But it’s always been quite narrowly defined, sort of how do you get the best out of an air fighter pilot or whatever it is? But I do think there’s something about understanding human performance that is really important in understanding how the sort of complementarity of humans and machines works. There’s something around management discipline itself, right? How do you design a good process? How do you avoid bottlenecks, right? Regulating the flow of work in a way that you don’t have everything just bunching up somewhere else in the system requires you to think at an organizational level and to think about systems and processes.
So, basically, systems thinking, all management training, all of that is super useful, I think, in thinking this through, and a bit of introspection. Maybe the best thing about this technology is that once you start to use it, it forces you to be introspective about, “What am I good at? Where am I likely to have a sustainable advantage? What do I like to do? What do I not? Do I really like the idea of doing a hundred percent higher-order stuff? Is that credible for me?” I don’t know how you train self-awareness, but in the process of trying the thing out, you start to, inevitably, I think, have those kinds of internal conversations, and they’re useful.
Sam Ransbotham: Even to answer those questions, we’re going to need a lot more information about people and about how they work, and that’s a little bit back to your measurement thing. That in many ways comes in conflict with my desires to keep my own personal information guarded. At the same time, these systems could probably help me understand a little bit about my own self, and how I work, and [in] what situations I work best.
I think, overall, that one of the things I think you’re bringing out in many different cases and many different examples is this need for nuance, this need for not always going too far, not always doing too little. Experiment some, but don’t over-rely. I think that’s really the overall theme that I got from your podcast, which is this idea of bringing some nuance to all these decisions. And I think that nuance doesn’t always play well in our current “Do these 10 things to make you a better AI person.” I think a theme from what I’ve pulled from your work is clarity and nuance. And I think that’s really hard.
Andrew Palmer: It is really hard. Another way of framing it, but it’s like the worst way to market the podcast, is to be boring. So master the essentials, the basics, right? What is the thing that you’re aiming for? AI adoption is not a metric in its own right. So what’s the problem you’re trying to solve? Think about workflows end to end rather than a single thing, where work might just be being redistributed. All of those kinds of questions are just common sense, but as usual, that takes you quite a long way.
Sam Ransbotham: Andrew, thanks for taking the time to talk with us. If listeners want to hear your podcast or hear an experiment where you’ve created a bot to create your own voice in a podcast — I thought that was a fun example — Season 3 of Boss Class is going on right now with The Economist. Thanks for taking the time to talk with us.
Andrew Palmer: Thanks, Sam. It’s been fun.
Sam Ransbotham: Thanks for listening today. On our next episode, we’ll shift gears to health care and speak with Carla Goulart Peron, chief medical officer at Philips, about how AI is enhancing, not limiting, the human element in the medical space. Please join us.
Allison Ryder: Thanks for listening to Me, Myself, and AI. Our show is able to continue, in large part, due to listener support. Your streams and downloads make a big difference. If you have a moment, please consider leaving us an Apple Podcasts review or a rating on Spotify. And share our show with others you think might find it interesting and helpful.