The debt crisis: AI edition
Podcast: Play in new window | Download
Subscribe: Apple Podcasts | Spotify | Amazon Music | Email | TuneIn | RSS
What happens when you feed years of messy content into AI? In this episode, Bill Swallow and Alan Pringle dig into the content debt crisis, including increased system costs, neglected localization, and the fallout of “just use AI” mandates. They share practical insights to help organizations get back on track.
Alan Pringle: Is your content updated? Does it reflect the latest information? Is it created for all the different locales that your company serves? Is it in different languages? That is another pile of debt that when you start looking at AI, all the problems will be very brutally magnified, and you’re going to have to address them to really have a large language model that works at all.
Related links:
- Balancing automation, accuracy, and authenticity: AI in localization (podcast)
- Forbes: AI Costs More Than The People It Replaced
- Taming AI: Using AI for content conversion at scale (podcast)
LinkedIn:
Transcript:
Disclaimer: This is a machine-generated transcript with edits.
Introduction with ambient background music
Christine Cuellar: From Scriptorium, this is Content Operations, a show that delivers industry-leading insights for global organizations.
Bill Swallow: In the end, you have a unified experience so that people aren’t relearning how to engage with your content in every context you produce it.
Sarah O’Keefe: Change is perceived as being risky; you have to convince me that making the change is less risky than not making the change.
Alan Pringle: And at some point, you are going to have tools, technology, and processes that no longer support your needs, so if you think about that ahead of time, you’re going to be much better off.
End of introduction
Bill Swallow: Hi everybody, I’m Bill Swallow.
Alan Pringle: And I’m Alan Pringle.
BS: And today’s episode is going to focus more on the content debt crisis, AI edition.
AP: And it’s also going to be the complaint edition, surprise, surprise, because there’s a lot of things in the AI world right now that are still making me cranky. And I am sure we will talk about them at some point.
BS: Yeah. So with the rise of AI, I think it’s kind of holding a microscope to a lot of the technical debt that we’ve been seeing over the years in content operations in general, whether you have outdated authoring formats or content that’s not being updated on a regular basis, new delivery formats not necessarily meeting the needs of the users, and so forth. And all of that is kind of compiling or snowballing into a bigger problem once you start feeding all of this stuff into AI.
AP: Right. And it’s interesting to me how everyone’s talking about AI as being this productivity tool. In a lot of ways it is, but that’s not what the focus of this is. In a way, it is also sort of a consultant for you. As you just mentioned, Bill, when you start looking at AI and delivering it, treating it as a delivery endpoint for your content, a distribution endpoint, you are going to start to discover that your processes on the back end for creating and distributing your content are not what they should be. So it’s kind of like this consultant saying, Hey, you need to do better over here. And that is where a lot of this debt is coming from, from my point of view.
BS: Mm-hmm. The unfortunate part of that consultant is that it’s not offering advice on how to fix it, but it certainly is pointing out the issues.
AP: It’s like, “This is screwed up. Full stop.” So, I mean, part of why we’re here is to talk about some of those kinds of debt. And let’s just start with one technical debt. And I’m saying technical in the sense of the way that you perhaps use software to put together your content. Let’s kind of focus on the content operations world.
BS: Mm-hmm.
AP: For example, if you are delivering content via unstructured desktop authoring tools, of which there are many, and you can templatize things and make your content seem more consistent, but there’s a problem with a lot of desktop published or content generated from the desktop publishing world. It’s more focused on look and feel and fit and finish, particularly if you’re delivering for PDF. And yes, people are still doing that. So there’s a lot of time and effort spent on that look and feel, that fit and finish. And frankly, that time should have been invested in adding intelligence to the content to explain, you know, things under the covers about what user is this for? What is the model of this particular thing? All of that kind of metadata, that kind of categorization. Desktop publishing, at least from my point of view, doesn’t really do a great job of helping you catalog that kind of stuff. So that’s a problem.
BS: No. It is a problem. Also, with desktop publishing, you can kind of confuse AI a bit if you’re using desktop publishing inconsistently. So if you’re using formatting tools to override formatting to make things look like headings or make certain paragraphs look like children of another paragraph, doing those manual finesses is great for print because, as you know, most people will look at that and understand the hierarchy of information, understand what’s going on with the content that they’re reading. But anything digital isn’t necessarily going to pick that up.
AP: Right. Yeah.
BS: Especially if you’re looking at something like bare bones HTML, if you’re using CSS to override the size and prominence of a standard paragraph as opposed to using a heading, that is not necessarily going to be picked up as a heading, even though a reader would actually see that as a heading while looking at the HTML page.
AP: Right. What a human reader can figure out from formatting cues, if those cues aren’t set up in a way that a large language model, a computer, can understand, there’s that huge disconnect, and that’s where that debt starts piling up. And then another angle here in this content creation world, if you are using multiple different tools to create your content, there’s a good chance that content under the covers is not going to be processed the same by a large language model. So there’s another deficiency right there on top of that. And this is very common, for example, if you have had mergers, acquisitions, and you’ve basically created a larger company from many different companies. And they all still have, especially in legacy content, things created the “old way,” and all the old ways start to pile up and cause problems because your large language model can’t properly basically figure out what is the heading in this particular chunk of docs versus what it is over here. So it can’t parse it as well. And again, this all goes all the way back to the way that you created that content. And it’s a clue, hey, you need you need to fix this. And I I think beyond that more technical, the way that you create it, there also there are also issues with the content itself.
BS: Mm-hmm.
AP: Is it updated? Does it reflect the latest information? Is it created for all the different locales that your company serves? Is it in different languages? That is another pile of debt that when you start looking at AI, it’s gonna be all the problems in regard to that are also gonna be just very brutally magnified, and you’re going to have to address them to really have a large language model that works at all.
BS: Yeah, because not only do you have the technical debt on the source content side and on the published content side, but you also now have technical debt growing on the AI side because you need to spend more time and energy refining the how that model works with your content in order to achieve the correct results.
AP: Right. So you’re having to do a lot of overrides and we I don’t know if overrides is the right word, but you’re having to do a lot of additional processing and figuring out so it will parse things correctly. And there are a lot of companies today that still have problems keeping content updated to the latest and greatest. So unfortunately, people turn around and call support. Or today they start hitting up the chatbot. But guess what?
BS: Mm-hmm.
AP: If the chatbot doesn’t have access to the latest and greatest because frankly it doesn’t exist or it’s not hooked up to it. It’s it’s just like the poor people in support. It’s not going to know what to do and it’s going to spit out probably very authoritatively wrong outdated information. Again, yeah, it’s be it’s goes all the way back to
BS: That’s yeah.
AP: In your content creation process, how are you accounting for updates? How quickly are you getting them in place? How are you handling them in both your source language and how are you handling them in your other languages? It’s one thing I do want to bring up here, and and and I may be biased here, but I don’t think localization is getting enough attention on the AI distribution side. It’s been talked about for a very long time in regard to machine translation, AI assisted translation.
BS: Mm-hmm.
AP: But I don’t just like I think sometimes localization is a second thought for a lot of companies, which still blows my mind in 2026. And by the way, we’re recording this in July 2026. So what we say right now may be outdated next month. Who knows?
BS: Who knows?
AP: There is that issue. I’m curious, you have a more of a localization background than I do, but I do see that being a potential debt problem, part of this debt crisis that we’re talking about here.
BS: Definitely, because if you’re pushing your content out to AI, do you have targeted audiences in mind? Or is it going to be a free-for-all of people going in and using that AI to get answers to their questions? if you are localizing your content, I think probably the best practice here would be to somehow bundle for consumption all of the guides in all of the different languages together. So you have product XYZ and you have it translated in three languages. Then you put all of those copies together and give that to the AI so it can draw its associations as well as it builds out you know its understanding or I hate to use understanding because the AI doesn’t understand things. It’s very easy to make slips in that way. But so that AI can actually draw those relationships. So, you know, if you’re looking in English or you’re looking in Spanish or you’re looking in German, the same query in those three languages will retrieve pretty much the same result. That’s proper for that language. And we talked with someone last year on the podcast, Steve Maule from Acclaro, about AI in translation.
AP: Yeah.
BS: And his focus was more on using AI as not so much a generative tool, but you know, a tool for aiding in AI, basically the next step from machine translation to neural machine translation to AI translation. And kind of the benefits and drawbacks at the time. Again, that was a year ago. So many of these things have probably changed again. But if you are translating content you may want to go back to that podcast and take a listen to what he had to say. and we’ll put a link to that in the show notes for this one.
AP: Yeah, again, I keep going back to this idea that we talked about at the beginning, how delivering via AI just puts this magnifying glass to what you’re doing and uncovers things that are wrong. But as you had mentioned, it doesn’t necessarily offer advice on how to fix it. And we will talk about that probably to wrap up the podcast. But what I also want to mention too. More and more, there’s actual real debt involved, not just the more indirect debt we’re talking about with the content debt, the technical debt. The AI companies, the providers, at one time had very generous offerings as far as the amount you could hit their APIs, the amount of tokens that they offered, whatever else.
BS: Definitely.
AP: But now, the days of I guess you could say subsidized token use, they’re pretty much over. And now the actual real cost is being passed on to the people using these large language models. And as a result, the actual price, the cost of using AI is skyrocketing in all these organizations. And there have been a lot of news reports lately about very
BS: Mm-hmm.
AP: And there have been a lot of news reports lately about very big firms, and I will not name names, but you know them all, their household names, basically having to do a 180 and tell their employees, hey, you need to chill a little bit on your AI use because you’re burning up the tokens, converting PDF files to PowerPoint. And yeah, I get it.
BS: Mm-hmm.
AP: Doing that conversion is probably not the most efficient use, productive use of AI tokens. But this gets into kind of, I don’t know if there’s such a thing as cultural debt, but if your company is sending this message, and a lot of companies are, use AI for everything. And you know, they’ve got these leaderboards up showing these people use this much AI this week, you know, that sort of thing. You are encouraging a free-for-all. So, instead of saying, here are the good uses, this is where we think you need to focus your use of AI in coding, in content creation, in whatever else, this whole idea of just use it. You got to use it a lot. And now that’s coming back and biting people in the backside. So companies are scrambling and telling people, calm down.
BS: Mm-hmm.
AP: Chill out. Don’t use the AI as much. So it, there’s a mixed message there. And it’s because there was not good communication, nor was there good thought put into how workflows should incorporate AI. And I think that cultural thing right now is a huge problem. And everybody’s focus on the cost and the non-subsidized token use when they need to be going back and looking at, well, look at your comms. Look at what you were telling people six, twelve months ago about AI. It’s kinda on you.
BS: Mm-hmm. Yeah, basically don’t let your nine-year-old run around in a toy store with your credit card.
AP: Yeah, pretty much.
BS: That’s pretty much what’s been happening. And yeah, we’ve been seeing lots of reports. There was one in Forbes last week, where, you know, companies are saying that the cost of using the compute power is more expensive now than the people it was supposed to augment.
AP: Exactly. So I think the reality of what AI can do maybe is starting to sink in, maybe a little, but at least exposing people to the true cost of it on a corporate level, it may
BS: Mm-hmm.
AP: I’m probably being too positive here. What? Me being positive? It may result in some recalibration about how companies are telling people to use AI and maybe thinking a little more on a cultural level, all the way starting with communication. Here are the workflows you need to apply AI to. This is where you can apply it.
BS: Mm-hmm.
AP: And then there’s also the whole vibe coding discussion. I don’t know how much we want to get into it, but we all know, right, there is now an industry, you know, people are now going in to clean up vibe coding because, yeah, just because you can vibe code shouldn’t mean doesn’t mean you should be vibe coding. Because who was going to maintain and clean up that mess? So again.
BS: Well, we’re cleaning up a lot of vibe coding now.
AP: It’s another cultural issue that should have been addressed, but in this AI rush, everybody was like, use it, use it, use it, without thinking about how they should really how they should really apply it and basically sort of reimagine the way they do work in a productive way. And that does not mean let the AI do everything from my point of view.
BS: Mm-hmm.
AP: So I guess we probably need to kind of wrap up and talk about what people can do when all of their ugliness is amplified and magnified by AI. And it really it’s about rewinding and going back and looking at from the start, especially in the content world and the content operations world, how are you creating that content? Are you doing it in a consistent way? Are you building in intelligence into your content that an LLM can pick up to better understand the context of that content you’re providing it? Is your localization workflow efficient? Is it getting content turned around quickly so people in other markets are not six or eight months behind in the latest and greatest information. And by the way, yes, that still happens today, believe it or not, that people are months out and getting it because they are in another location. It’s shameful, but it still happens. It does.
BS: Mm-hmm. Yeah. And there’s also, you know, how are you feeding your content over to AI? How are you providing it? Are you just having the AI team you know scrape web pages and PDFs, or are you supplying something that’s a little bit more targeted and tied to the content itself, and maybe supplies some of that intelligence over?
AP: Yeah, because I think Sarah’s talked about this on a previous podcast. A company was noticing that their LLM was kind of not using PDFs or not weighing them, or and I’m again I’m personifying big time here. my apologies.
BS: Yeah. It’s easy.
AP: Was yeah, was not really it was not giving the weight to the content in PDFs. And when the company kind of did some reverse engineering, they realized it was because that PDF what they didn’t have a lot of context.
BS: Mm-hmm.
AP: There wasn’t a lot of basically metadata built in that the LLM could basically parse. So it’s like, I’m gonna kind of put that to the side because it doesn’t have the richness that I need to do things well. So it it’s about looking at how you write. How are you delivering this content? And one possibility here, and it’s, well, there’s several structured content where you have metadata built into your content. You have tagging that offers semantic context.
BS: Mm-hmm.
AP: That’s one way to do it. And it’s not the only way. I mean, we have a lot of clients who use it, but it absolutely is not the only way to do it. Knowledge graphs can also be part of this solution. And sometimes knowledge graphs and structured content can play together to provide that rich feed of information that LLMs prefer and can do a better job with. So it’s not a one-size-fits-all solution when it comes to how to create that content or how to best hand it over to AI, but I think it is kind of a one-size-fits-all that if you aren’t doing things right foundationally, AI is going to kick your tail.
BS: Mm-hmm. Pretty much, yeah. And I think the best way to look at it is to consider AI another delivery target, just like you would a portal, just like you would a PDF or what have you, a help system. When you consider it as another endpoint for your content, another, you know, place to deliver to, it makes it a lot easier to start scoping what you need to do to reach, the requirements for that particular target.
AP: Agreed. So content people look at it as a delivery point and also look at as a job aid too to help enforce style guides, to help enforce taxonomy, whatever else. So it’s not just about content creation.
BS: Mm-hmm.
AP: It’s also that part of your thinking needs to be a content distribution point, like Bill mentioned. And it can be hard to think of it as both of those things, but in the content world, it absolutely is.
BS: And I think that’s a good place to leave it. So thank you, Alan.
AP: Thanks, Bill.
BS: And we’ll see you on the next one.
Get more insights on AI and content operations in our monthly newsletter!
About the author
