Smart Talks with IBM: How Infrastructure is Powering the Age of AI
en
January 29, 2025
TLDR: Malcolm Gladwell interviews Ric Lewis, IBM's SVP of Infrastructure, discussing how hardware capabilities facilitate large language models and showcasing creative AI applications in businesses like banks and coffee shops. They emphasize the importance of infrastructure for AI potential realization.

In this episode of Smart Talks with IBM, Malcolm Gladwell engages with Ric Lewis, IBM’s Senior Vice President of Infrastructure, to understand how advancements in hardware capabilities are fueling the artificial intelligence (AI) revolution. They explore the intersection of powerful infrastructure, data handling, and AI applications, providing insights into how businesses can leverage these technologies to transform operations.
Key Themes
1. Infrastructure's Role in AI Development
- Importance of Hardware: Lewis emphasizes that the ability to run complex AI models—such as large language models—relies heavily on advanced computing hardware. This includes using high-performance GPUs to perform significant amounts of matrix math necessary for AI predictions.
- AI and Infrastructure Evolution: The podcast discusses how innovations in IT infrastructure—from traditional mainframes to cloud computing—have evolved over decades, allowing for enhanced data processing and real-time applications in various industries.
2. Creative Applications of AI
- Real-World Examples: The conversation illustrates several practical applications of AI in everyday settings, like banks and coffee shops, showcasing how these innovations can optimize customer service experiences and operational efficiency.
- Customer Support Revolution: Lewis highlights how employing AI to improve customer support processes can lead to quicker resolutions, ultimately enhancing customer satisfaction and reducing operational costs.
3. The Explosion of Data
- Data as an Asset: The episode stresses the growing challenge businesses face due to the exponential increase in data generated globally. Lewis notes that effective data management and storage solutions are now core to the success of AI-driven initiatives.
- From Data to Insight: Companies that can harness and derive insights from their data are well-positioned to maintain a competitive edge in their industries.
Key Insights from Ric Lewis
- Get Started with AI: Lewis advises businesses to start exploring AI applications now. Begin with simple projects to witness immediate benefits and learn from the outcomes as they evolve.
- Cultural Shift: The discussion underscores the need for a cultural shift within organizations to embrace risk-taking and innovation, given the rapid pace of technological change.
- Hybrid IT Strategy: The episode elaborates on the significance of hybrid computing—combining on-premises systems with cloud solutions—to secure data while maximizing its availability for AI applications.
4. Future Trends in AI
- Ongoing Innovation: The conversation hints at ongoing advancements in AI technology, with Lewis suggesting that AI's full potential is still emerging. Organizations should be prepared to adapt as new breakthroughs redefine business capabilities.
- Potential for Job Enhancement: Contrary to popular fears that AI may eliminate jobs, Lewis believes it will enhance jobs, allowing workers to become more efficient and focus on strategic activities.
Concluding Thoughts
This episode of Smart Talks with IBM offers a compelling look at the essential role infrastructure plays in enabling AI technologies. As organizations strive to innovate, understanding the intersection of hardware, data, and AI is crucial for success. Lewis’s insights encourage businesses to act now in leveraging AI, fostering a culture of experimentation, and investing in the right technologies to reap the benefits of this transformative era.
In summary, infrastructure is not just an enabler; it is foundational to scaling AI capabilities and driving significant business value. By embracing these changes, organizations can unlock new opportunities and better serve their customers in the age of AI.
Was this summary helpful?
Do you want to see into the future? Do you want to understand an invisible force that's shaping your life? Do you want to experience the frontiers of what makes us human? On tech stuff, we travel from the minds of Congo to the surface of Mars, from conversations with Nobel Prize winners to the depths of TikTok, to ask burning questions about technology, from high tech to low culture and everywhere in between. Join us. Listen to tech stuff on the iHeartRadio app, Apple Podcasts or wherever you get your podcasts.
Hey everyone, it's Robert and Joe here. Today we've got something a little different to share with you. It's a new season of the Smart Talks with IBM Podcast series. This season on Smart Talks, Malcolm Gladwell and team are diving into the transformative world of artificial intelligence with a fresh perspective on the concept of open. What does open really mean in the context of AI? It can mean open source code or open data.
But it also encompasses fostering an ecosystem of ideas, ensuring diverse perspectives are heard and enabling new levels of transparency. Join hosts from your favorite Pushkin podcasts as they explore how openness in AI is reshaping industries, driving innovation and redefining what's possible. You'll hear from industry experts and leaders about the implication and possibilities of open AI. And of course, Malcolm Gladwell will be there to guide you through the season with his unique insights.
Look out for new episodes of Smart Talks every other week on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts and learn more at IBM.com slash Smart Talks.
Hello, hello. Welcome to Smart Talks with IBM, a podcast from Pushkin Industries, My Heart Radio, and IBM. I'm Malcolm Gladwell. This season we're diving back into the world of artificial intelligence, but with a focus on the powerful concept of open, its possibilities, implications, and misconceptions. On today's episode, our season finale, I'm joined by Rick Lewis, the Senior Vice President of Infrastructure at IBM.
Rick has had a remarkable career focused around product innovation. He was actually a few years into retirement when IBM came calling with an opportunity he just couldn't turn down. Thankfully, Rick came out of retirement. And today he oversees a vast portfolio from storage and software to global customer support operations. And he's engaged in one of the key problems facing companies today, an explosion of data.
In talking with Rick, I can see that this problem of having so much data is also an incredible opportunity. Because if you're able to leverage that data to get the most value out of it, then you can use it to help bring your business into the future. We talked about the serious computing power needed to scale AI, as well as the ways that infrastructure storage solutions can be essential to enabling this new world of possibilities. It's a really great conversation, so let's get to it.
I'm here with Rick Lewis. Rick, welcome. Thank you. Here we are in the IBM's New York City headquarters at One Madison Avenue. I'm going to start with, you're a hardware guy. I'm a hardware guy. I grew up doing hardware chip engineering.
But like I tell a lot of people, a chip engineering project is actually a giant software project with a piece of hardware at the end of the project. I think if you have that analytical brain, you like to solve problems, you like to get things working, you can do that in software. But does being someone coming from a hardware background mean that you think about problems in a different way?
I think one thing that you do from a hardware background, and especially a chip background, is a chip span costs millions of dollars. So you're a lot more likely to make sure everything has a great chance of being perfect from the get-go, where if you start kind of from a software background, your general mindset is, I don't know, try this, see if it works. I don't know, try that and see if it works. And you kind of iterate, iterate, iterate.
Chip people are a little more uptight about, okay, if this first round of the chip breaks costs us from building another new round of the chip. Yeah, so you're a little more. You guys are spending more time planning and- Planning and verifying, tons of time verifying. Yeah. So you began your career as you look back. Yes. Correct. And you were there for how many years? I was there for 32 years. Yes. And your last job there was-
was leading the software-defining cloud business. I had grown up a hardware guy, I had done all kinds of hardware projects, big complicated Unix servers and things like that, and then grew out of R&D and more into the business realm.
Then I'm much an innovator at heart. I really like innovating new concepts, things like that. What I learned is I enjoyed innovating business models and software projects as much as I did hardware products and projects. Getting teams inspired toward doing that was really a deep fascination for me. I ended up doing it
a fantastic variety of experiences and had a successful run and honestly retired intending to retire and do some of my outside activities and things like that. And then how long did you stay retired before IBM can come? Almost two years. And when I first got the haul, I thought, no, I'm having too much fun. But I would say
Three things really got me thinking hard about it. One, the industry that we're in, the IT industry, I think it's the golden age. And what I mean by that is, for 20 years of that career, IT is kind of in the back office. Say, make sure that stuff doesn't crash. And can you please reduce the cost as much as possible? Because it's not that important to the main business. It's just a back office function. You can see it right now. IT is at the forefront of all business revolution. It happened with the internet.
It happened again with cloud and how that changed every ounce of business, not just IT business, but all business. And I think it's happening again with AI. So to be in that career that long and to miss the kind of this age where it's like, this is front and center, this changes everything about all businesses, not just technology businesses.
I was kind of feeling like, gosh, you trained to be in these really awesome environments. Why wouldn't you do that for a little while longer while you still can do it? That combined with IBM and IBM seeing the talent pool, the brilliant people at IBM.
I worked with a ton of brilliant people before. I saw a chance to work with even a larger staff of brilliant people, and then the assets that IBM had, which they'd already been doing a lot of experimentation in AI. They're working in quantum, the deep rich heritage of successful projects. I thought, who wouldn't want to see if they could be part of that next great wave of IBM?
I kind of decided, all right, I'm going to put the outside interest on hold for a while and get back in the game. How long between the phone call, the first phone call, and you saying yes? It was a while. It was probably six months. Arvind's, our CEO, teases me about that a lot. Yeah, I don't think six months is that long. It took a while. You were in retirement.
I know, exactly. It's one thing to compare. I'm working here and doing this stuff versus working there. It's really hard to compare. I'm doing exactly as I want to do every single day when I wake up. And now I'm not going to do that again. It took a while for me to get over it. I can't miss this wave. And I'm really, really happy that I did because we're doing some amazing, fun things. And I'm getting challenged in ways that I never did. So it's really fun.
Talk a little bit about your job here at IBM. You oversee a kind of massive portfolio. It's a big group. So I run the infrastructure organization. There's three main groups of products at IBM. There's the infrastructure group, which I run, the software group, and the consulting group. And infrastructure is built up of mainframes, which is called our Z portfolio, our servers, which is our power portfolio storage.
By the way, those businesses include the supply chain to build all of that stuff, so that's in the group. Then I have the worldwide customer support organization. It's called TLS Technology Lifecycle Services, which is a network of about 13,000 people around the globe that make sure that everything runs and works when you buy IBM products.
And then also our IDM Cloud, which is how we host applications and deliver as a service products for our client base. So there's a lot. I think it's about 45,000 people total. Do those components of the infrastructure group, are they aligned in their trajectory or do they
Are they on different paths? I'm just curious what sort of navigators are both. It's interesting you would ask that because I think of all of the challenges coming to the new company. There were things I expected, things that I didn't expect, but getting that culture right in that group has been a big challenge. IBM has a great culture toward quality products, toward
Emphasizing passion for the client and making sure that the client is happy and for delivering innovation on a scale that, you know, for more than 100 years has been extremely powerful. But with success comes some challenges.
And with that success, you can tend to get a little bit insular, like you don't keep an eye on the competition as well. You can get more siloed where this is my business unit, this is my business unit. I compete with the other business unit. That's not a good thing when you're a company. And you can get really risk averse, meaning you feel like, hey, this is a successful business. I don't want to do anything to mess it up.
So I don't need to try new things. Well, that's exactly the recipe to kind of be shrinking and infrastructure had been shrinking for a little while. And so a lot of what the challenge was for me was to invigorate that risk taking and get to a growth mindset where you're trying new things and seeing what works and what doesn't work and changing some of the models, like investing a little bit less in hardware for some software differentiation that goes into the hardware.
It's been very successful so far and it's been a good journey. It's almost four years now. Give me an example of what was a really hard problem that you've dealt with in those four years. Boy, a really hard problem. Interesting. Are you interesting as a better word than art? One of the first things that I kind of chewed on a little bit is I talked about how we have Z power and storage. The Z and power product lines are well known in the industries.
is really fit for purpose computing that have strengths that Z runs most of the world's economic backbone. If you use a credit card, 90% of credit card transactions for the globe go through these Z mainframes. They're in every bank.
It's a big business. It's well known in the industry, same with power, very tuned and optimized for smaller operations than our giant Z mainframes, but really mission critical workloads for retail, for insurance, for banking, for all of that.
Are storage business not so well known? In fact, when I came, I thought, did they have storage? Well, I have storage when I come in. So I got online and I thought, it's still hard for me to tell. Did they have storage or not? Now I own a storage business. So one of the things was not just to get the market perception up, but to invest in that business. Because if you look at infrastructure overall around the globe, it's growing at 5% a year.
The infrastructure business had been kind of flat to declining. And so a challenge was how do we grab onto the growth? Well, one of the biggest growth areas due to the explosion of data in the world is storage. So what do you do to kind of get on that growth rate? So we did a lot of reinvigoration of the innovation in that, a lot of software value add, a lot of doubling down on the things that are working, portfolio rationalization, where you segment the market and you say, OK, we're going to do less of this and really go big in these areas.
And that's been probably the most dramatic turnaround inside the group is our storage thing. When you say it's a hard problem, it's not just, oh, how do we do the math? No, it's cultural, it's strategy, and how do you get the strategy said? It's segmentation, it's product strategy at a granular level, across a bunch of dimensions, and then putting the investment behind it. It's a big challenge, it takes a long time, but it's working, so we're happy with that. Yeah, tell me, give me a little bit of perspective on, you've been there four years,
Imagine we're having this conversation four years ago. Yeah.
What sorts of things have happened over the last four years that have surprised you, that you didn't see come or at least, are we having exactly the same conversation four years ago? No, because I didn't know what I was in. I'll tell you some of the biggest surprises. I thought from the outside, and you hear from a lot of customers, especially 10 years ago, we're all going to cloud, we're all doing it. So I thought, well, I wonder if the mainframe business is struggling when I get inside of there.
I found the opposite to be true. The mainframe business is actually flourishing because transaction demand across the globe has done nothing but grow. Even more surprising was the level of innovation that the team was already doing in mainframes before I got here was astounding. For example, they were building AI technology into the mainframe processors.
three years before chat GPT made everybody talk about it in the industry. So that was really pleasantly surprising. So that was wonderful. Other surprises, I knew about the kind of the IP of IBM and the mystique in that. And I used to joke with people, especially on the outside, I said, I can't wait to get in there and see what's in the big blue toolbox, right? What are all the things they have going on? I way underestimated the size of the big blue toolbox and what was in there, meaning
the amount of really hardcore research that we're still doing into how to build chips and how to get to things beyond two nanometer and that kind of capability, packaging, industry leading packaging technologies. That's in my hardware kind of patch quantum. The next thing that'll come after we're done talking about AI.
All of those things were surprising, but it wasn't just that. It was then the software innovations that are going on, heavy investment in AI technologies before it was really popular to be talking about that. But as I saw that, I thought, this is going to get really fun because I had a good feel for where the industry was going.
I just didn't, and I knew, man, I know that talent is really good and there's brilliant people there, but I didn't know the level of IP, frankly, that IBM had at its disposal. And now you're seeing that in things like Watson X and things like AI in mainframes, et cetera. Building on that, since you brought up AI, can you walk me through what has to happen from your perspective, from the infrastructure perspective, to make the AI
explosion work. Everyone wants to do more of this stuff, but clearly there has to be some underpinning of it. I would tell you, I think that people feel like where we're at right now in the AI journey had to do with one specific piece of software. I think the inflection point for that whole thing really
at its root was around hardware, meaning the algorithms needed to do larger language models and all of that had been around. They'd been talked about in the industry. But at some point, you hit a tipping point of hardware capability where it's like, oh, now we can do this in a brute force way, massive amounts of matrix math to get weights correct so that you can do the right level of predictions that enable large language models.
And once we got to that horsepower, and that's why you hear about giant GPUs that are driving this and the sales of those, et cetera, it's because we just barely got over the hump where you can do these big hard things in terms of hardware capability to do it. Give me a layman. Give me a sense of when you say there was a kind of threshold where suddenly these things became possible. Yeah, I don't know if there's an exact number, but
And more basic question that I get from a lot of people, my friends and family outside is, why GPUs? What is a GPU, a graphics processor have to do with AI? Well, graphics processors are really good at this thing, matrix math, because they're figuring out
how do I map a pixel? And as I move an object across the screen, it's essentially matrix math to figure out, okay, what does this pixel on the screen look like and what's it's doing? And as you've gotten more high resolution graphics, more high resolution monitors, et cetera, it's a lot more pixels and a lot more math and a lot more matrix math about how you compute that. The first big thing that kind of started to look like that, it turns out, was
crypto and crypto mining. And so you saw graphics companies starting to sell to crypto. The technology got to a certain point and there were use cases like Bitcoin and that that kind of said, hey, we need to do a lot of this matrix math to be able to do that. So graphics chips were a natural fit and that kind of sustained. But meanwhile, behind the scenes, a lot of this AI, AI is about
numeric calculations having to do with weights and matrices that say, you know, giant consolidated things that predict what's going to kind of happen based on what other things have happened, just like predicting where pixel goes. But it's really about being able to do enough data ingest to be able to do, and then the calculations to be able to simplify things like entire sets of language or giant chunks of the internet to get enough weightings in there to be able to say, okay,
we can predict what you would say in this language based on all of the volumes of stuff that we've seen that when you start talking like this, the next word is likely, oh, it's this. To get to that point, that threshold.
We got there because, was it because we simply threw a lot more resources at the problem? Or is it because the underlying technology got suddenly or gradually so much more efficient? It's always yes and yes, but the industry for a lot of years would talk about Moore's Law. Rick, oh, quick. Will you define for us?
for those who have forgotten it. Yeah, so Gordon Moore at Intel coined this thing. It was basically that the horsepower I'm going to translate it roughly of technology will double every couple of years.
We're still on Moore's Law. Moore's Law changed a little bit for a while. It was always about frequency. Things would go faster, faster, faster. That kind of petered out. But what happened is rather than faster, faster, faster, we did more and more and more. So rather than one operating unit,
going a lot faster on its throughput, you put 10 operating units on a chip. Now you put 100 operating units on a chip, now 1,000. Some of these problems, the matrix math problem, scaled parallel extremely well. You don't have to do something really fast. You just have to do a lot of the similar things in parallel at the same time. So again, that extension of Moore's Law, more and more hardware on a chip to be able to do more and more of those calculations in parallel and come up with hands.
Was that threshold predictable? In other words, do people in the industry like you sit down X number of years ago and say, when we get here, AI is going to become much more of a... It's funny. The horsepower, that, very predictable.
The use cases, not always so easy to kind of figure out. That's where the human spirit kind of gets involved. I think for some people, they say, oh, I saw that coming. But people have been predicting kind of the rise of AI for 25 years. Oh, well, then when we get to this next generation, oh, when we get here, it kind of hadn't happened. There's always a magic point where you kind of get to where the technology and the use case, and somebody does something to kind of make it
catch on, and I think we're at one of those moments in AI for sure right now, and I don't think it's, you know, people have said, oh, this is just the latest wave of, you know, I used to hear, I've heard this about a lot of technologies, but AI is the technology, the future, and it always will be. I used to hear that. You're not airing that now, right? It's like, no, it's prime time. It will change everything, just like some of these other things changed everything.
I noticed sort of personally, when I speak somewhere where I'm listening, an audience somewhere over the last, let's say, 12 months, there's always a whole bunch of AI questions. And if I go back two years ago, there were no AI questions. So there's been this explosion in popular fascination with what's going on in AI. It seems like the last year. I agree with you. In your world,
when did the explosion of of of conversation around the start it's uh...
I love this question because IBM had a fairly big effort in business called Watson before Watson X. And this is going back kind of 10 years. I'll give you another kind of example. I knew about a lot of tablet technology before there was an iPad, a lot for 10 years. There were a lot.
But it kind of takes a magic combination of the technology, the user experience, the software, and the need and the market ready for it to kind of go, now it's a thing. Now we all have either an iPad or we have the Google equivalent. And so I think this is a little like that, meaning IBM was on the right track with Watson.
Some of the hardware wasn't there. The use cases weren't exactly figured out. Some of the early use cases didn't pan out perfectly. But the good news about that is it's back to that culture of risk taking. You don't look back on that and say, oh, we shouldn't have done that. That was a bad idea. No, you look back on that and say, what did we learn? How should we try something new? How would we pivot this time? That's what we've done with Watson X and now that's a growing healthy piece of our business and very important to our strategic future. So we're all in.
I've always invested in it by the gap between insider sense of what is happening and outsider sense. It absolutely is that in this case. We've all been talking about and thinking about AI and is it time for that and what does this mean, et cetera? And yet none of us really predicted that actual moment, which is kind of early 2022, where it was like, oh, now you have a simple
human interface of software innovation combined with large language models.
There's a moment there where you're like, oh, unlike, you know, I think all of us are frustrated if we ask our phone. Hey, tell me about this. And it says, I found this on the web page. That does you no good. But, you know, all of a sudden with chat GPT and some of these other things, you could ask a question and it would give you a clear answer. Sometimes it's wrong, but at least it was like, I'm getting an answer rather than, hey, I don't know, if you have some references, good luck to you. And that's really changing. Talk about
the kind of macro trends that are going to shape your infrastructure battle. Yeah, we've talked about a few already, but I'm actually going to go a little different direction. So macro trends first.
And this one has been before even this AI conversation that we've had, explosion of data. As humans, we don't think exponentially very well. We really struggle with exponential thinking. We think linearly, oh, they'll be more, they'll be more, they'll be more. But we don't think, well, when it's like, no, they'll be more, and they'll be 10 times more, and then they'll be 10 times that more. That's what's going on with data right now in our industry.
It's one of the reasons that that storage business is doing so well. Is there just more and more and more data? You'd say, well, how can there be more data? It's just life and that thing. The things that we care about, video capture, video images, the you.
I don't know, from my parents you needed a drawer with all your family photos. Now we need gigabytes and gigabytes. You knew how many pictures my wife has taken of our children you would. Exactly. So that's your case. Now think of companies who used to just think about their transaction data, what's the ledger say, that now have video assets of all of their campaigns and their marketing, they're trying to figure out
what campaigns are working the best. It's just an explosion of data and that's not going to stop. Dealing with that and more importantly, getting value from that data is a massive trend in the industry. Second trend, AI. This is the AI, not like we were just talking about, about how it changes, how I search for things or how I learn about things.
But I would argue dealing with that data. How do I figure out what's in all those video streams? How do I figure out, okay, I want all of the chunks of my corporate video that have to do with client buying some specific product or something. That's a different problem. It's not just, okay, we'll look it up in a spreadsheet and here's the math associated with that. That is a huge trend in the industry. You're seeing it play out in this regard. It's a little different bent on AI.
fraud detection is the one that we cite in our mainframes. It's a similar problem where it was kind of a traditional AI problem, look up a rule. If somebody does two small transactions, then a massive one, it might be fraud, right? Because they were seeing whether it worked. Now, to detect fraud, you might be saying, okay,
two transactions, then a huge one. Plus, does this entity have a real address? Second, is there any web traffic on better business bureau kind of things that says this is a bad business? That couldn't help you with fraud. So it's a lot more of a, it's an existential problem. It's a holistic problem that takes a lot more than just
little chunks of rules, et cetera. And then the third one after AI is the nature of hybrid IT or hybrid computing. For a while, 10 years ago, when cloud was on the rise, I think the notion of hybrid computing basically having to do with things in the cloud versus things that people still have on the premises inside a business was almost a religious argument.
Now it's the reality and the reason is because that data that I talked about is the lifeblood of these companies, particularly IBM's companies. Our clients usually, that data has to be secure. They have to be able to get value from it. It is the lifeblood of the company. If you go to an ATM and you can't get your money out to our financial transactions,
If that lasts a day, you're probably going to change banks. So it's like life or death for these companies. So having that hybrid infrastructure so that they can still hold their data, yet still interact with clouds and still get value from it from AI, that's kind of the magic where we play and it's a huge business opportunity. It is a true inflection point for the industry. I'm going to go back.
I interrupted you when you were in the middle of a religion. We were talking about what has to happen for AI to scale from the infrastructure standpoint. You gave one example that I got you off in a tangent. Can you go back and talk? Very sort of practically. So I'm a big company. I have all these dreams of AI.
of how I'm going to use this strategically. So give me a very granular sense of the works you have to do to make that dream possible. So let me first say what the company has to do and then maybe I'll say then how do I help them if that makes sense. So if I'm a company and I want to do that, so it turns out
I am a company, meaning I want to use AI in my processes. I mentioned that I have a global network of 13,000 employees that support our infrastructure around the world. That challenge is a great challenge for AI.
That means I have data for every customer situation for 13,000 employees globally around the world on what was their problem? How did we fix it? What next steps did they have to do? How did they remediate that? That data is extremely valuable to me, because if I can get better at doing that than anybody else in the world, that brings my costs down. I sell more products, I sell more service, I sell more anything. So what I have to do to get there is I have to figure out, okay, what's my objective?
I have a couple objectives. One, I want customers to be able to support themselves without even calling me first off. And I don't want when they call for the first answer to come back to be, did you try rebooting? Because I think that irritates every single one of us. Of course I tried rebooting. I've had a laptop, of course.
Well, okay, well then tell me, okay, what firmware version, all that other stuff? Okay, we know this interaction. So that's kind of the problem set. Do I want that to be customers solving their own problems? Well, even for my support agents, I want something in their pocket on their phone where they say, I'm seeing these symptoms and says, oh, this happened and around the globe, here's kind of specific. So there's my problems. What does it mean for infrastructure on the back end? So first,
I got to get all that data together, right? All of those customer, all that customer support around the globe, et cetera, that needs to be stored. That's a big set of data. And some of it's not just fix and that kind of thing. Some of it is, okay, what was the firmware version? Who was the tech? Because it can matter. Is this their first time fixing this problem? Is it their 150th time? What's their level? It's a very complicated problem.
ingesting all that data takes an architecture, we have a product called Scale, which is one of our storage projects that actually makes it easy to ingest all that data, get it organized, et cetera.
have a model, it's a whole different process to kind of say, did we train our model? We can train our own models inside of IBM. We have a granite set of models, those models we fine tune, and then we inference based on those models. So we can do that inferencing in our cloud. I have a cloud set of infrastructure or in my power servers. We can do inferencing with our capabilities and say, okay, based on what I'm saying, here's what the remediation that you should do for that customer.
We already are doing that today. We've seen over a third of our support calls have had significant reduction in the amount of time that it takes to resolve that support call just by what I said right there. Does that?
I'm really been curious about this. If I had reduced something like AI into that equation, as you just did, and you said, we've already seen 30%, did you say 30% reduction? 30% of our interactions have seen significant reduction in the time. Was that your primary goal to reduce the time of the interaction? In other words, if everything else was the same, but what you were doing was shrinking the amount of time that would you start victory? One of the primary goals.
To us, in that business, Net Promoter Score, the satisfaction of a client is the supreme goal. What makes them satisfied? Doesn't cost me a fortune, happens really quickly, and if I can do it myself, I'd be thrilled. It affects all of those. It kind of says, it got resolved faster. It didn't cost me an arm and a leg, because the deck was barely here, because it's a common problem, or I solved it myself without even calling on.
All of those objectives would kind of hit across all this. Now you see it. So that's a little microcosm. That's just me and my customer support business. Now think of how many problems for businesses around the world there are like that. It's not like a new AI application that changes the entire user experience.
those will come. But right now, it's kind of practical, which is, I just want to do what I'm doing better and faster, and I can get immediate economic return from those things. How long did it take you to just stick with that example of the customer interaction reducing 30% of the time? How long from the very beginning of that project to that 30% reduction was how long? Less than a year.
And one of the challenges, and this is interesting, with a very large organization, as you can imagine, just like you're seeing in the industry.
We don't have a problem of generating ideas for how AI could help us. We actually have a problem filtering the thousands of ideas from our employees and from everywhere. It's like, hey, we could use AI to solve and filtering down and saying, okay, which of these will have a return on investment quickly and at a level that sustains, that's worth kind of going and investing in the infrastructure and the software and kind of making that happen. Is that unusual?
If I talked to you 25 years ago and said, do you have a problem of too many good ideas or too few? What was your said? In this specific area, probably too few, because at some point you reach diminishing returns. So for example, let's use this example. Can those 13,000 technicians go faster? Can they spend less time driving to the side? I mean, there's only so much you can kind of do on those things.
But if you can get them an answer to the problem and maybe even avoid them having to visit at all because the client helped themselves, that's a step function. So that's why people are kind of talking about there's a business revolution coming with AI where there are some step function changes that can be there. And notice I didn't say I'm going to have less of those agents.
That's not my objective, my objective. And I think that's the fear in the industry about AI is going to eliminate all the jobs. No, I just created 13,000 super powered agents that can do more. And so I'm not just going to support IBM products. I'm going to go out and support other people's products because I know how to do that really well. And once I have the data on how to fix their problems, I may just have a customer support business that seem dependent on my boxes. So I think that's where people sometimes get it wrong. And the AI thing is,
It's like, you know, do word processing eliminate the need for writers? No, it enabled writing instead of mucking around with mimeograph machines and clicking and clicking typewriters. It may have enabled too much writing. Yeah, maybe. Can I give you a hypothetical? And I asked this because I ran, I was in some comments and I ran just some guy from the IRS who was really, really, really, really excited about AI. So let's suppose they call you up.
And they say, you're going to talk to me with the IRS. I call you up. And I say, Rick, clearly there's something that we could do for the IRS if we worked together. Yeah. Who would your answer be?
Of course. No, I think we sell to a lot of government agencies. Yeah, can imagine in the business that we're in. We enable a lot of Social Security transactions and things like that through our mainframes.
And I think we're in the business of helping whatever client get the most out of their data and be able to secure it and be able to do analytics with it. And IRS has a heck of a lot of data. So yes, we would help them. Do you know how the amount of data they have compares to some of the corporate clients you have?
I don't know specifically for the IRS how much data they have, but I would assume it's a whole lot. It's mountains. But that's our business. I mean, it's interesting. Sometimes people that, what's the most, you know, what is it that IBM has that's of great value? Is it a server? Is it a storage array? Is it, you know, software and all that? What we have is
the most important entities in the world have their data on our stuff, the most important data in the world. It's not pictures of your grandkids and things like that generally for us. It's all of the financial transactions that happen globally. It's the world's economy is running through our systems. We take that really seriously.
You would be distraught if you lost one photo on your laptop, whatever. But if we lose a transaction, somebody moves a big amount of money and it's like, don't know what happened there. It is a massive deal, right? So that doesn't happen. You want to go back to my IRS example? Yes.
One, is it reasonable to assume that somebody, IBM or somebody else, could in a short period of time put together not just the AI capability to audit returns, but also the infrastructure support for that in a reasonable amount of time for a reasonable amount of cost, or is it going to the moon or is it
It definitely, I mean, so we're already doing that kind of thing, right? Across a network of banks and others, essentially all credit card transactions for all of the world go through our systems. So that in some ways is more volume than the tax returns of the US people and their W2s and all that stuff. And we do that stuff too.
I try not to describe it too much in detail, but we definitely do a lot of that. In fact, I think if you think, okay, what is super critical data? Who would be doing the business transaction processing? It is most likely us in almost all cases, whether it's government things or private or banks or that kind of thing. That's what we do.
Rick, we're going to end with where we always end with a couple of quick fire questions. Okay. Here we go. What single piece of advice would you give to businesses trying to use AI in an effective way? The simple version is get started. By get started, I mean, think of what is something that I want to improve. The things that we have traction on right now in the market are around business process, automation, digital labor, those kind of things.
My other little piece of advice there is keep it simple to begin with. You're going to learn a lot. But getting started means you'll start that learning curve. I even advise my friends, like, hey, should I be playing around with some of this AI stuff? And I say, yeah, because I think it will help you start to be more comfortable. And you may find a use case personally for that. I think the same is true for businesses. The first step in that journey is always
with what data. Notice when I talked about our customer support people, I thought about, okay, what's the data? The data is all of those logs of all of those service engagements around the world. And what could I do with that? Well, I could use that to get to a knowledge base that really helps.
and hopefully that I can do it in multiple languages because it's global and I can, you know, all of those things, that was kind of my data sent. That one's not super simple, but we've had a lot of experience in AI for other people that might just be, how do I automate filling out travel expense reports for my company? We can help people with that. We have consulting, we have Watson X tools, we can do that like this and we're doing it globally for people around the world. Pick that thing, what's the data you have in that case?
It's data of expense reports and it's like, okay, we can help you automate that for people where they could do it just by a verbal interface. What did you spend? Where did you go? Who were you with? Okay, we filled out your travel expense report for you and you don't have to mess around with it.
We were playing with this idea where we would pick a business and go in there and do a, it would be AI makeover. Yeah, I love that idea. Okay, what's the, what is the ideal business to do? We only have a couple months. We don't want to spend a cajillion dollars. We want to be able to show tangibly and quickly what AI can do. What's an ideal business to do that in? It can be a small business, but we're not talking, this isn't a grand corporate thing there.
Ah boy, small business that we could do in AI makeover. Customer support is one of my favorites because I have it on the business side where I provide customer support. I have it on the consumer side where it drives me nuts when I have to go through 30 layers of phone menus. Speak to an agent. Speak to an agent. Speak to an agent. That for any
business, I think, is just right to be able to kind of say, why do I have to click through this message? I just need to tell you in human language, here's the issue. And I'll be really good about telling you details about, you know, I tried to set up this thing for my bank and I did that. They can go through all the menus.
automate that process. I think it would change everything because all that frustration as a consumer would go down dramatically. And it's all, you know, why are you making me the B-Boo press one, press five? Exactly. Well, don't offload to me, offload to AI. We can help you with that. Here's my version of that. It drives me crazy. Every morning, I go to the same coffee shop and I get
a cup of tea and a croissant. And here's what happens. A person has their screen and they go, I go cup of tea, croissant, sparkling water. Like at least 20 keystrokes.
And then the screen is turning around. At this point, we're like 45 seconds in. I'm like, why is this? First of all, it's not for me, all those keystrokes. It's for their internal. Correct. Correct. Correct. So they're burdening me in order to service her back in. You should be able to walk in, go up and they go, I'm not going the same thing. Yeah. And you just go, yes. And then it's... Boom, we're done. Can we do AI makeover of my coffee shop?
You notice I quickly jumped more to banks than your coffee shop because I think I'm a business person. I'm not trying to kind of do a deal on one coffee shop. But this is interesting because it takes me back to something you said that I thought was really important. When you were talking about when you were using AI and your customer service thing, it was clear that your goal, you could have any number of goals going in. It could be to
cut costs. It could be to dramatically improve profits, but your goal quite specifically was to improve the experience of your customer, right? So you were using it to that. All the other things come from that. That is actually one of the beautiful pillars of the IBM culture is delighting clients is actually where all of the good stuff comes from. So my coffee shop thing is the same principle.
Right now, they're making my customer experience worse, and they don't want to. Their eyes are glued to the screen. At a moment, when I walk in and I want to say, hi, how are you doing? We could have a conversation. They're too busy busy keeping your book. So this is the same thing. If they understood, they had an opportunity to prove the experience, their customer experience. I would not be surprised if a chain comes along where that is their value proposition. I would not be surprised at all.
Yeah. Yeah. Right? So, I mean, and when those things kind of catch hold, it becomes a revolution. You know when the guy comes to do, like, to redo your roof and they put a sign out front, like, you know, Joe's roofing? Yes. You guys could do the same with my coffee shop. But, like, I, B, M, M, M, M, was here. Exactly. Exactly. In five years,
The mainframe will be... Going strong. The mainframe going strong and with new capabilities, continuous new capabilities. I think when we announced the last version, Z16, the latest version, I should say, and we said, hey, there's AI processing built into it. This was before everybody was talking about that. I think a lot of people thought, what's that for?
We did it specifically for traditional AI, fraud detection, etc. This next version, not only do we have the traditional AI built in, but we have optional cards that you can plug into it to allow you to do large language models for the enhanced fraud detection cases that we talked about where it's more than just what transactions were happening. If you take that and say, okay, the next generations,
We have more transaction volume than we've ever had in mainframes today. The business is growing. It's strong. We keep innovating. In five years, it'll be going strong. But people, what you're saying is in the context of...
For years, people were predicting, weren't they, that the mainframe was going to go away? There were pundits in the market that said, everything will go away. No one will ever have a box. It'll all be online. I think this is something I've learned big time in my long career in the IT industry is, don't believe everything you hear. So I went back for my master's degree at Stanford after I had worked a while
as a hardware designer and everybody told me, be sure to do your master's in software hardware is dead. I went on to work for 30 plus years in hardware and infrastructure. Now software became important and I'm glad I had that extra training in software because it helped me in hardware.
But hardware wasn't dead. Then I heard all infrastructure will go into the cloud. There won't be any. That hasn't happened. It's not happening. Then I heard there will only be one cloud because one of the players will dominate. There's not one cloud. So I think it's as humans, we like to oversimplify and go, oh, it's all going to be this.
And kind of what I've learned is fit for purpose matters in everything. It matters in size of infrastructure. It matters in the stack that goes along with solving a specific use case. If you're willing to design something that's the best at that use case, if you're willing to design the coffee shop that is the best at greeting me, there's a spot for you and there may be a big business in doing
So oversimplifying is really dangerous. When you heard all those predictions, did you believe them at the time? They looked like they were trending in that direction. I'll tell you some right now, which might be useful. There will only be one GPU company and they're going to end up taking over the world. It's a pretty obvious answer whose economic value is risen dramatically. I don't think that's going to be the case. In fact, I think that 90% of
processing for AI actually happens at inferencing. And inferencing is not as GPU and hardware intensive as the other things, and is a lot more amenable to fit for purpose. So the model size will matter. The tuning matters a lot as we're learning. We have a product
around instruct lab that's really focused on tuning. So that was one thing is there'll be one GPU. The other thing is that the biggest model will win, I think, is another thing that's kind of people are saying right now and don't believe that. I believe there will be fit for purpose models. It takes a lot of money to run to create a huge model and then to run a huge model or to even infer off of the huge model.
I don't need a massive training GPU set thing to solve my 13,000 people customer support issues. So why would I feel like I got to go farm that out for a big expensive thing? I can do that on a small box. In some cases, I might even be able to do that on a laptop.
The other thing I'll say in this, we are so early innings in AI, a lot of things are going to change. So anybody kind of saying, it will all be x, y, or z. I just think you have no idea how this is going to play out. And it's up to us to go figure out how it plays out. Yeah. Yeah. All right. In five years, AI will be dot, dot, dot. Still new. It will have moved a bunch in five years.
but the potential for the disruption in the world will still be very early innings in that process. And I think that's super important to realize. That's why I say, get started, start thinking about how that could change, because it'll be some little things first, but it will continue to snowball. This is a common observation that we, the invention of the capability massively predates the understanding of the capability.
I love that. Yes. Recording shows on television is invented in the 60s, probably the VCR. We don't really understand what it's used for until
The odds, what is really good for is being able to tell a story sequentially over time because you know that the person will all have seen the episode before. So you get the sopranos and Hollywood wanted to ban the VCR in the beginning. Yeah. Because they thought it was, they thought the point of it was, they thought, they didn't understand. No, no, no. It's storytelling. Yes. Actually, your business is getting better. Yes. Yes. Took them 20 years to figure that out, which is to your point.
Why would we know what AI was for in five years? That's why you hear people say, oh my gosh, AI, that will just eliminate jobs. No, it'll make jobs better. That's how I view it.
What's the number one thing that people misunderstand about AI? Is that it? I think that would be the human kind of understanding part of it, the technology part of it. I think would be what I was talking about fit for purpose, meaning that it isn't just going to be a GPU arms race, all of AI. I don't believe that at all. It will change everything, but it's not just going to be a GPU arms race.
Uh, next question. What advice would you give yourself 10 years ago to better prepare you for today? I'm changing this question. Okay. I want to say let's imagine that, uh, what was your, what, what college did you go to? I went to three of them. My undergrad was Utah State University. My MBA was Santa Clara University and my master's in double E was Stanford. Okay. Anyone of those three calls me up and says, we want you to give the commencement address.
And imagine that it's, let's just say for sake of argument, it's just to the stem people. Those are the relevant parties here. What do you tell them? Boy, what do I tell them? Let's see, I think I would start with
life as a marathon, not a sprint, would be the first one. The second thing I would say that in that spirit is be sure to set yourself some big, hairy, audacious goals and don't be overly disappointed if you don't hit them all.
Going after those big, hairy, audacious goals will get you on a path where you will learn so much, you will achieve more than you ever could imagine you would have achieved. That's what the advice I give to my kids is. Yeah. Set some big goals, get after it. You may or may not achieve them, but you'll be better for the whole process when you're done.
By the way, as someone whose kids are a lot younger than yours, is it actually useful to get advice to your kids? Or just a pointless exercise? TBD. We're still on the journey, and I think we will be for a long time. I don't know. How are you already using AI in your day-to-day life today?
Personally, I would say it's replacing a good chunk of my search. I'm less likely to go blindly stumbling through a bunch of web pages looking for stuff. I'm more likely to ask a question from a few AI engines kind of see, get me in the right direction, then I'll go bumble through a few things. At work, I can tell you
Code development right now, we are seeing massive improvements in code development and support products. We have like Watson code assistant. That is really showing immediate return for a code developer. And I think that'll, that will again be a tool that increases productivity for code developers immediately across the globe. Yeah. Last question. What's the one skill that every technology leader needs that has nothing to do with technology?
being able to inspire a set of people toward a common goal and collaborate to achieve it. That's at the core of everything, everything. What's a lovely way to end? Thank you so much, Rick. Thank you. This conversation left me excited. I'm now imagining the potential for new use cases for AI in all sorts of different businesses.
Rick didn't seem sold on my idea of a coffee shop makeover, but it's clear there's lots of opportunities here to increase speed and efficiency, to achieve your objectives, and to dream beyond the current applications for this technology. At the end of the day, the scaling of AI will rely on the right infrastructure to support it. With the right tools, you can solve problems that are unique to your industry and improve the experience for your customers.
you
Smart Talks with IBM is produced by Matt Romano, Amy Gaines McQuaid and Jacob Goldstein. We're edited by Lydia Jean-Cott, mastering by Jake Korski. Theme Song by Gramoscope. Special thanks to the eight bar and IBM teams, as well as the Pushkin marketing team. Smart Talks with IBM is a production of Pushkin Industries and Ruby Studio at iHeart Media.
To find more pushkin podcasts, listen on the iHeartRadio app, Apple Podcasts, or wherever you listen to podcasts. I'm Malcolm Gladwell. This is a paid advertisement from IBM. The conversations on this podcast don't necessarily represent IBM's positions, strategies, or opinions.
you
Was this transcript helpful?
Recent Episodes
From the Vault: The Nature of the Diamond, Part 3

Stuff To Blow Your Mind
In this episode of Stuff to Blow Your Mind, Robert and Joe explore various historical interpretations of the diamond, from divine tears to both a potent medicine and a deadly poison. (part 3 of 4) (originally published 1/23/2024)See omnystudio.com/listener for privacy information.
February 01, 2025
Weirdhouse Cinema: Dracula (1931)

Stuff To Blow Your Mind
Discusses the iconic 1931 'Dracula' adaptation directed by Tod Browning, featuring Bela Lugosi's most renowned performance.
January 31, 2025
The Invention of Cotton Candy, Part 1

Stuff To Blow Your Mind
This podcast episode explains the origins and connection between cotton candy and Dragon's beard candy, a culinary tradition from China.
January 30, 2025
Listener Mail: The Memory of Trees

Stuff To Blow Your Mind
Listen to Stuff to Blow Your Mind and Weirdhouse Cinema listener mail.
January 28, 2025

Ask this episodeAI Anything

Hi! You're chatting with Stuff To Blow Your Mind AI.
I can answer your questions from this episode and play episode clips relevant to your question.
You can ask a direct question or get started with below questions -
What was the main topic of the podcast episode?
Summarise the key points discussed in the episode?
Were there any notable quotes or insights from the speakers?
Which popular books were mentioned in this episode?
Were there any points particularly controversial or thought-provoking discussed in the episode?
Were any current events or trending topics addressed in the episode?
Sign In to save message history