What’s the BUZZ? — AI in Business

Improve Your User Experience With Generative AI (Guest: T. Scott Clendaniel)

Andreas Welsch Season 3 Episode 6

In this episode, T. Scott Clendaniel (VP & AI Instructor, Analytics-Edge) and Andreas Welsch discuss improving your user experience with Generative AI. Scott shares his perspective on making business applications more accessible with AI and provides valuable tips for listeners looking to get more business value from AI projects.

Key topics:
- Democratize AI with user-friendly access
- Explore LLMs' unexpected UX benefits for business users
- Distinguish LLMs from past UX trends
- Guide AI leaders on integrating LLMs into applications effectively

Listen to the full episode to hear how you can:
- Democratize access to LLM-driven insights in natural language
- Ask Generative tools for help to improve prompts
- View LLMs as a new user interface
- Use Generative AI to understand user behavior and preferences

Watch this episode on YouTube:
https://youtu.be/5HgkawZdihU

Questions or suggestions? Send me a Text Message.

Support the show

***********
Disclaimer: Views are the participants’ own and do not represent those of any participant’s past, present, or future employers. Participation in this event is independent of any potential business relationship (past, present, or future) between the participants or between their employers.


Level up your AI Leadership game with the AI Leadership Handbook:
https://www.aileadershiphandbook.com

More details:
https://www.intelligence-briefing.com
All episodes:
https://www.intelligence-briefing.com/podcast
Get a weekly thought-provoking post in your inbox:
https://www.intelligence-briefing.com/newsletter

Andreas Welsch:

Today we'll talk about how you can use Generative AI to improve your user experience in your applications. And who better to talk to about it than someone who's been teaching hundreds of teams on AI and analytics over the years? Scott Clendaniel. Hey, Scott. Thank you

T. Scott Clendaniel:

So much for joining. Yeah, I am so excited to be here. I can hardly contain myself. Thank you for inviting me.

Andreas Welsch:

Awesome. Hey, why don't you tell us a little bit about yourself, who you are and what you do.

T. Scott Clendaniel:

Sure. So first of all, I am older than dirt. I actually started in the field in March of 1986, so I've been doing this for quite a while. I absolutely love helping people learn all about artificial intelligence, machine learning, data science, all those fields. Done a heck of a lot of consulting. And I've had clients you may have heard of Audi, Biogen, Mercedes, Los Angeles Times, folks like that. And so now I'm trying to transfer that knowledge to others and bring more people into the field.

Andreas Welsch:

Scott, should we play a little game to kick things off?

T. Scott Clendaniel:

Okay.

Andreas Welsch:

Alright, wonderful.

T. Scott Clendaniel:

Do I win a free car?

Andreas Welsch:

Probably not.

T. Scott Clendaniel:

Okay. Alright we'll do it anyway.

Andreas Welsch:

But how about reputation and reputational points? Excellent. All right. Look, so this, game is called In Your Own Words, and when I hit the buzzer, the wheels will starts spinning. When they stop, you'll see a sentence. I'd like you to answer with the first thing that comes to mind and why, in your own words. And to make it a little more interesting, you'll only have 60 seconds for the answer now. Are you ready for What's the BUZZ?

T. Scott Clendaniel:

As ready as I'm going to get I am.

Andreas Welsch:

Okay, perfect. Here we go. If AI were a song, what would it be? 60 seconds on the clock, go.

T. Scott Clendaniel:

If AI were a song, what would it be? I'll tell you what it would be: Help! By the Beatles because that's where we're going with this, help. I need some info help, not just any info. How would that be?

Andreas Welsch:

That would be awesome, right? We all can use a little more help. Fantastic. And well within time, I've seen a lot of creative answers. But, help is, perfect. Why don't we talk about the actual topic of the show around user experience. Look, I think we've all obviously seen Generative AI in the news last year, still in the news this year. Good thing. I think this year it's more about where the rubber meets the road. Implement AI, get your pilots out of your lab into production. But I also see that it obviously democratizes access to AI-powered applications and those insights. So whether you're a senior executive or you're a first-year student, English, it is the new programming language, which makes it so universally applicable and accessible. But I wonder, from your perspective, what's so remarkable about Generative AI when it comes to user experience?

T. Scott Clendaniel:

All right, so let me throw a question out to you and the audience at large: when you go to send an email. Andreas, we're gonna start with you. Yeah. What programming language do you use?

Andreas Welsch:

Good question. I don't know what's under the hood, but

T. Scott Clendaniel:

So when you go to the web, which programming language do you use? You probably just use a browser, right? Yeah. When you go to create a presentation, you use some type of app. So the whole process of creating software and the point of creating software was to put things into apps so that people didn't have to reinvent the wheel over and over again. But somehow that memo seems to have been skipped to our friends in the artificial intelligence community, whereas, no, you have to be a ninja. In Python to do anything? No, you have to be able to do this. You have to be able to code, you need to know IDEs. So not only am I gonna teach you all the statistics, but I'm also gonna teach you computer science and all these obscure languages and all this kind of stuff. Really, we don't require on your driving test to be able to understand compression ratios on a gas pass powered engine, right? Or at least mine didn't. So the whole process of applications to simplify things and make things easier. It's also about user experience, but programmers, a small group of folks, not programmers, but bro-Grammers. Thank you to Nicole for giving me that phrase is the fact that no. You have to be able to do everything I can do before you can touch your information and then consider the screen that you see when you go to ChatGPT, as an example. It's largely a blank screen with a place to type. You don't need to code anything. You don't need to know how to do it. Even GUI interfaces, it's basically you type your answer and hit enter. And so the beauty is people who have been scared off from our field for a long time now have access to things that they never would've had before. And I think it's remarkable. A lot of the stuff that AI does now, it did before. It did search before you could generate text before. So what's the difference? Why is it so popular now? And I'm going to be really controversial here and I'm gonna say it is not so much that artificial intelligence has improved, it's that we've simplified the user interface.

Andreas Welsch:

I love that. I remember working with customers a couple years ago on AI first pilot projects. We didn't call it AI then, we called it machine learning, because we wanted to be very precise and and accurate. And accuracy, for example, was one of the variables or, one of the piece of information that we wanted to display to business users. And they saw 80% accuracy and I thought, that's awesome. And they tried it out and the results were garbage. I said actually, if it's 95 or 97%, that's when it gets really good and 99%, that's where you wanna be. And they couldn't believe that 80% was garbage. To your point, if you don't, absolutely, you need to expose that if you, make it simpler to begin with to interact with these systems. That's a huge opportunity.

T. Scott Clendaniel:

That's well and it's funny'cause you even talk about the labels. We now call it artificial intelligence. Back when I started, it was data mining and no one uses that phrase anymore. And then it was KDD. Knowledge, discovery and databases, and then it was predictive analytics. No, that's not good enough. No. It's gonna be machine learning. No, it's gonna be data science. Lots of the stuff has been the same the whole way through, but we keep changing the name just to make things harder for people. And that's a great example. If you type in any of those things, you're gonna get similar results back. Because we have removed that complexity.

Andreas Welsch:

No I, really love that. And, again for, business users, I think it makes it so much easier to finally get the results and get useful results without the complexity of having to understand the technical details in, the background. So by the way, for you in the audience, if you have any questions for Scott, feel free to pop them in the chat and we'll take a look in a couple minutes and take some of those as well. So speaking of business users, what do you think there is the potential for them, maybe what's an unexpected aspect of large language models that you've seen for improving the user experience there?

T. Scott Clendaniel:

I think a lot of it is it opens doors. And what I mean by that is I can tell you that I, myself and probably the worst graphic designer in the history of the universe. I may have the heart of a DaVinci, but I have the skill set of a one-armed troll with a really bad hangover. So I can have ideas, oh, I'd like to have this image to be able to convey this message, an actual business use case. I wanna convey this message to others, and it's very complicated, and I'm trying to think of how to do it. There is no way in hell you could give me all the tools in the world and that was not gonna be helpful. But now I can go into one of the Generative AI tools and say, okay, I'm looking for something that sort of looks like this. I can prototype all kinds of different things, and I'm not even saying that's gonna be the final result, but the amount of time savings, I wouldn't have even ventured into that realm before. Now play around. I get a little more self-confidence. I'll try refining my prompts over time. I never would've done that. I love adobe Photoshop and all those products, they're lovely, but, yeah, that was not gonna help. This removes that fear and removing that fear allows business users to do all types of tasks that they would've been afraid to approach before.

Andreas Welsch:

Yeah. I like how you, also broaden the definition, if you will or the variety of Generative AI if you, in business, a lot of the use cases that we see today are still focused on text and text generation, summarization. What are the key points out of this meeting, out of the meeting minutes or even things like Bard or now Gemini. Summarize this YouTube video for me. If you can access it.

T. Scott Clendaniel:

Absolutely. Let's just take a simple example. It is very hard for most people to sit in a series of meetings back-to-back. There's been all kinds of research that even a fifteen-minute separation between meetings does wonder, the human brain to be able to recover just a bit when you're even have something as simple as an AI assistant in a meeting. To take the notes, I have to worry less. That I'm typing and writing and summarizing the point and listening and coming up with my response all at the same time. It seems simple'cause we have to do it all the time, but it does get complex. Instead, I can really listen to what's happening and form my response and not be just obsessed with note-taking. It's frees up that cognitive load for me to do the things I hope I'm better at.

Andreas Welsch:

I'm really excited to see where this is going. Maybe even get some coaching. What are the questions that I should be asking, following the conversation? And having context about me. Yeah.

T. Scott Clendaniel:

Can I share a magic trick

Andreas Welsch:

with you? Oh, only by exception, yes.

T. Scott Clendaniel:

Okay, perfect. Actually, one of the things that if you are new to Generative AI, one of the beautiful things is if you get stuck, you can ask your question about Generative AI. In ChatGPT or whatever, or Gemini or whatever your weapon of choice is. If you are stuck or you get an instruction that you don't fully understand, you can clarify and you can say what do you mean by that? And a lot of times students won't do that in a full classroom setting because they don't wanna feel embarrassed. They don't wanna feel like, oh, my boss is gonna think I'm an idiot if I didn't catch that last thing. But if you're in something like Gemini, you can actually Gemini for. Use Gemini for some tips on how to create better Gemini products. That is one of the things that I think just opens up all kinds of possibilities.

Andreas Welsch:

I love just the power, right? That, now is, at our fingertips. It's not the first time that we also hear it's all about language. A couple years ago we've talked about chatbots as the new thing, as the new interface for voice commands in the enterprise and what have you. And I think it hasn't quite happened yet whether it's in an office where you have an open space and everybody's talking to their assistant. It gets a little loud and annoying maybe or let alone field service.

T. Scott Clendaniel:

I've been in those environments. Yes, I understand.

Andreas Welsch:

All of a sudden you trigger your your desk neighbor's assistant to do something or whatever that maybe we've seen that with Google Assistant, with Alexa in our homes when they suddenly go off. Or now even let alone field service or on an oil rig where it's just impractical that somebody speaks to that system. Given all the environmental conditions and noise and everything. So what do you think is different this time then when it comes to language, and voice, large language models? What's different this time compared to chatbots from a couple years ago?

T. Scott Clendaniel:

I'm so glad you asked that question because fortunately I was prepared with a response because that is this guy, your cell phone. Why? Because, most people in the past 10 years have given up to a large extent on calls back and forth within the office. They've just surrendered. But what do we use all the time? Text messages. Text messages is the primary mean of communication, especially for folks younger than I am, which is most everybody. But that, that, that sort of interface we're really comfortable with and we use it all the time. And one of the other things that helped us was the fact that with the rise of search engines over the past 20 years is the fact people are used to typing in questions. And so I don't have to fool about the timber of my voice. I can take as long as I want. It's basically texting to a really smart. And for the moment, we're gonna keep the hallucinations and the accuracy issues off to the side for right now. But in general, we have this whole means of access using an interface that we're so familiar with, which is you're basically a giant text message system when you're using one of these LLMs.

Andreas Welsch:

So that's your answer?

T. Scott Clendaniel:

That's my answer.

Andreas Welsch:

Oh, okay. Good.

T. Scott Clendaniel:

Even remember the question'cause that happens to me.

Andreas Welsch:

Yeah. All, all good. So I see an Anil here is asking in the chat if you have any tips how to deal or handle copyright issues when using UX generated from GenAI tools.

T. Scott Clendaniel:

Yes, I do. Think of all of the Generative AI tools in one of two realms. One would be brainstorming. Help to come up with some different ideas, developing prototypes, that type A. Number two is being able to come up with different ideas that you couldn't have thought of on your own. So you're brainstorming. The system's brainstorming back to you. That's like a good first draft in terms of the copyright issues. Do not use anything that comes out of Generative AI. It's already been pretty well established that you can't copyright stuff that comes out of Generative AI. And I don't know if anyone else noticed, but in the past month the patent office has now said that anything, any patent that's written or comes out of AI will not be recognized. And that patent is, so this is. Your first step field, this is your brainstorming field. This is the area where I'm gonna come up with new ideas and test some things out. So in terms of copyright, avoid it like the plague. Think of it as coming up with the different ideas. If you're gonna have an image, take the image that you created as a good example, and then send it to whoever your internal artist is, or do it on your own. Wonderful. Thank you. And yeah, to be really careful. Yeah.

Andreas Welsch:

Yeah. When it comes to UX, one of the tools that I was really surprised by was one that Tobias Zwingmann mentioned a couple months ago when he was on the show and there was Vercell AI. And you can give it a prompt and you say, Hey, create a layout for our website to do lead capture, for example, or as a landing page or a sign up for a newsletter or something else, or even more complex things. And using Generative AI, it does come up with the design and it shows that to you and you can make modifications and you can transfer that over to a actual programming language. So that's where I got excited because it's not just text generation, not just image generation or synthetic voice or video, but there are other really powerful and, useful applications where you can use

T. Scott Clendaniel:

Let me tell you an opportunity that's missed a lot by organizations that I think that Generative AI can also help with. For decades, when I worked in marketing, I was desperate to understand what exactly customers were thinking. I either had to sit down with the customer service department, listen to phone calls, come in or look at messages from email requests or whatever else. One of the things you wanna look into is the ability to actually capture what the first prompts that someone used for an internal. Tool were for several reasons. One, it helps you improve the UX of the product overall, even when it's not a genre of AI interface. But number two, what was their starting point? We, in business, have a nasty tendency to talk to ourselves. We come in and we can't erase what we think we know, so we just assume that everybody else knows that we assume that they want this new benefit or this new feature or whatever else. You have a non-stop collection of user-generated research information. Take some time to read some of it for heaven's sake. I'm not saying read all of it, but you can also ask your Generative AI tool to review what different questions or comments that have come through. What are the most common aspects? Because you wanna learn about your customer, you want to hit the customer needs, and a great way to understand why people don't like your particular UX approach. You would really want to ask them the question if you've only got buttons on a website, you can't do that. But if you can capture what people are entering into your customer service team through the actual text, you will have amazing insights that you didn't have before.

Andreas Welsch:

So in a way, even use Generative AI to summarize the, information, the raw data that, that you're getting and, draw some, conclusions Absolutely from it.

T. Scott Clendaniel:

And that's where RAG comes into play, and I think that's gonna become more and more important. There was some research that was released by Wharton University of Pennsylvania, I guess two weeks ago, three weeks ago, or that's where I found it. I don't know that they generated the research, but that's where I found the articles from a Wharton professor was the fact that if you have a solely isolated, resource to create your own genre of AI interface does not tend to do well at all. Because it loses all the language clues. So we've got the specialized information. So I fixed that problem, but now I've still got the interface problem. So that's why I think RAG's gonna help because it's going to allow the best of both worlds.

Andreas Welsch:

Yeah. And make it tangible and preserve that context. Even now, now I'm, wondering if, you're an AI leader, if you want to become an AI leader in a business, what do you need to be aware of then when you want to introduce large language models? Be it for improving the user experience or be it for other reasons.

T. Scott Clendaniel:

Yeah. One of the things that I'm a little worried about is the fact that we now wanna call everything artificial intelligence, like everything in the world. And this is a funny but true story because I was like, gosh, and this was five years ago, AI on this, AI on that, oh, our product has AI, AI everywhere, right? And I was like, wouldn't it be funny if someone said that they used artificial intelligence in a toaster? I will be darned if in 2017 I didn't find an old ad. For a toaster with artificial intelligence. Alright, stop using that phrase for everything. Just because it's an interface with a computer does not make it artificial intelligence. So I think as a leader, there are a lot of folks out there, bless their hearts executives who come back from the golf course and our lady CEO EO is playing with other lady CEOs and our guy CEO is playing with his guy CEOs, and they're all playing golf and they come back and say, okay, we gotta do AI. Why? Because everybody else on the golf course is doing AI. And I can't go out on the golf course and say, we're not doing AI. I don't wanna be embarrassed. What? That's terrible. So when you're talking about this field, don't do AI because you want to be able to say you are doing ai. You need to find an appropriate problem where this is gonna be a good fit. So throwing around the terms all over the place is not going to help you. Also, everyone is now using that phrase. So whatever type of market advantage you thought you had 18 months ago by using the phrase, artificial intelligence is gone now because everyone else is saying it's, you're not differentiating yourself. So that's the first sort of problem area. The second problem area is plain old statistics and machine learning. Our old friend logistic regression. Decision, trees, random parts, anybody remember those? Algorithms that we use for problem solving. You're lot more likely to get a higher ROI from solving problems like fraud detection response analysis, email, open rates, all those simple, binary outcomes with a simple algorithm than you are to go full out and buying all these platforms for artificial intelligence. Crawl, walk, run. You don't have to be full speed at the moment to be able to make this stuff work. Take it easy.

Andreas Welsch:

That really brings it back to the basics, right? And also a bit of that misconception that Generative AI now renders everything else obsolete in all of the logistic regression and statistical methods and so on and it does not, right? ChatGPT does not generate your demand forecast. It probably does, but not very accurately. There is that. Now one other question here in the chat I think is really interesting. That's how soon will we see commerce where users can purchase goods or services within the chat interface versus using a specific app? What do you think is it, a multi-year journey? Is it just connecting another API, like a plugin like, like Kayak or something else that you can already connect in ChatGPT, what do you think?

T. Scott Clendaniel:

I think you could probably jury-rig it today. I wouldn't necessarily recommend it, but yeah with enough blood, sweat and tears. You can actually use a genre of AI interface today as to be able to purchase goods. I don't recommend it because it's still very buggy, but yeah, I absolutely think that in 2024 there're gonna be a bunch of products that offer that. Remember that the purpose of Amazon creating the product, which shall not be mentioned. Hint, hint, it rhymes with Marexa. The purpose was not for people to be able to play music. The purpose was they thought that this amazing device is gonna be in every room in the house and people are gonna be making purchases with it all the time. At one point, they had 10,000 folks working on hardware, software, all that. That's a lot of folks, and they completely missed the boat, in my humble opinion, on the interface of the power of things like. Chat GPT, but they thought that e-commerce was gonna be solved by this. I'm not sure that people particularly want to go into that type interface or trusted enough. So I don't think the issue is that we can't do the technology when it's gonna happen. It's when our customers really gonna prefer that.

Andreas Welsch:

What I think is really interesting about that point and, obviously I'm using some of those devices myself and have been using them for a while, is it at least personally I want to see the item. I want to see what does it look like? Is it large? Is it small? Is it white? Is it black? Is it a shade of white or a shade of blue so in, absence of the visual cues and information, just relying on language and then also trusting that the device accurately understands what I mean or gives me the options. And, then if it's reciting the options what was option number one again, out of those three or out of those five? And are these even the three that I want to see?

T. Scott Clendaniel:

If you went into a store today with a live salesperson, 70% of all communication is nonverbal. Yeah, it's tone of voice, it's body language. You lose all that when you have a text interface. You're not gonna have any of those components. And we still have a hard time getting sales professionals to understand what we want, and this is what they specialize in life to be able to do. So if we're expecting to get. That type of clarion communications, let alone your excellent point about the fact, but this doesn't help me see it. This doesn't help me hold it can I hold it up to my couch and make sure it matches or whatever.

Andreas Welsch:

Yeah. I love the VR by the way. See what this looks like in your room. I. Yes. For, some things. That's really helpful. Yes. For a bunch of batteries or your dish soap. Not so much, but definitely. All hey we're, getting close to the end of the show and I was wondering if you could summarize the key three takeaways for our audience today when it comes to Generative AI and improving user experience with it.

T. Scott Clendaniel:

Sure. Number one, encourage employees to use it as a tested ground for brainstorming, not for final results. Two, trying to ban it is a terrible idea'cause they're gonna use it anyway. And you would rather have some type of level of control on understanding what they're doing. Three, I would say use it as a way of researching what people are really interested in and understanding customer needs. Just don't think of it as a bandaid. Think of it as a fantastic way to improve the overall customer experience. Those would be my top three.

Andreas Welsch:

Wonderful. Thank you so much. Scott, it was a pleasure. Thank you. I love being here. Thank you for sharing your expertise with us and for those of you in the audience for learning with us. I think it was a very insightful session. Really appreciate you giving us that, that broad overview and bring it back to, business and what really matters.

T. Scott Clendaniel:

You bet. I hope I can come back one day. Take care.

Andreas Welsch:

Yeah. Awesome. Thank you so much.

People on this episode