This podcast is brought to you by the Wharton School at the University of Pennsylvania. Can machine learning help us better understand how habits are formed? That was the goal of a group of researchers, including our next guest, Katie Milken, his professor of operations, information and decisions here at the Wharton School, also author of the recently released book, How to Change.
Katie, great to have you back with us. Thanks for your time. Thanks for having me. I'm delighted to be here. Thank you. And I guess the interesting thing to start out with here is the term habit and habit forming is looked at in a variety of different ways, depending on kind of different sciences that are out there. And you note this in the paper right out of the gate. Take us through a little bit of how habit and habit forming is viewed in these areas.
Yeah, well, habit formation has been studied really differently by psychologists and economists and neuroscientists. Some are trying to look at markers in the brain that predicts how habitual behaviors. Some have studied it in animals. In fact, we have a lot of great data on what looks like habit in animals and animal models. Economists like to study it experimentally, trying to see if they can design conditions that produce habit. And psychologists sometimes collect self-report data on how habitual behaviors have become. But to our knowledge, our work is really the first to look at habit formation happening in the wild.
So in a naturalistic way, people going about their daily lives and habits taking shape and to try to actually apply machine learning to explore, well, how do those habits take shape? What are the factors that underlie habit formation? How long does it take? And we do so with data sets from two different settings because we want to see how generalizable are the insights we can draw. One is looking at data on people's habit formation happening naturally when they join a gym. And the other is looking at caregivers and hospitals and how they form habits around hand sanitizing before entering patient rooms. So really different context.
Why those two areas? Is there something within the component of habit forming that is interesting about those two areas specifically? Well, gyms have been sort of the fruit fly of habit formation research. So an enormous amount of work in this literature focuses on gym attendance as the outcome and the reason is it's something that's quite easily to measure without requiring people to report to you and not lie. Their behavior rate. So when you enter gyms that's typically tracked, that's how they make money. They don't let people in who aren't members. And so this is very convenient. Unlike something like smoking or diet or nail biting, things that you might think of as natural candidates for habit research. The problem with those is somebody has to report to you, oh yeah, I've been my nail sayer. I didn't or I ate healthy today or I didn't. And people are often loath to do that truthfully. So gyms are really, that's like the workhorse. That's where a lot of habit research has done. And then we wanted to go beyond that and we were looking for a dataset that would similarly have objective measurement of behavior rather than self-report and realize there was a really interesting dataset that we could plumb that tracked these hospital caregivers and sanitizing decisions. And we thought that was really exciting to pair those two and see how different or similar are they.
So what were the results that you found out from looking at those two datasets? Well, I think the results are really surprising to many who have tried to what's a popular lay belief about a magic number of days that it takes to form a habit. So there's this widely spread rumor that it takes 21 days to form a habit. You may also have heard about 90 days to form a habit. There's popular books that count these numbers. By the way, don't have sound basis and research, but what we find is there is no such magic number and that the number of days it takes to form a habit, first of all, is quite different on average in these two samples, these two settings. So it's much faster. In general, to form a habit around hand sanitizing than gym going looks like it takes an order of magnitude sort of weeks on average in that context versus when we're looking at gym attendance, it takes months typically to form a habit. But there's also a huge variation across people. So it's not like this is a tight distribution. We can say, here's a magic number, even in a context. There's really widespread. So what that points to is this is really a false belief in the idea of a magic amount of time and probably we're better off focusing on things like how complex is the behavior, how often are you repeating what's the nature of the reward you're receiving as the main drivers of the speed as opposed to a gravitational pull towards a magic number.
How important then is this data in comparison to just thinking about habit formation in general in our culture, do you think? Well I think in general when we have data, it teaches us what's true as opposed to what we'd like to believe or what we think might be true based on observing ourselves.
So it was really exciting to bring 52 million observations to this question as opposed to question errors or people's intuitions who are writing self-help books. And we're really excited that we had an opportunity to do that here.
We're joined by Katie Milkman, Professor of Operations, Information and Decisions here at the Wharton School. Let me go back a second because you have done work in the past around gyms and those locations and the importance of that component to having a greater understanding of what is going on in this case around habit forming but just in general about how important you can develop and understand kind of moves that people make in those settings, correct? Yeah, absolutely, this is a really nice context.
As I said, we think of it as like the fruit fly of habit research, being able to study the frequency at which people visit the gym, does it stick once people start going or does they fall off the wagon? It's a really nice setting and it's an important outcome from a policy perspective because actually about 9% of premature deaths are due to physical inactivity. It's an incredibly important factor in lifespan that many neglect but most are trying to habituate once they create a membership plan.
What do you and your cohorts doing the research take from this research? Well, I think one thing that it shows us is the power of machine learning to explore patterns in human behavior in new ways that we couldn't do if we were just using standard old-fashioned methods. Survey data could be applied this way too. It's really exciting to see the objective data and to see that it can give us this kind of insight.
We're fitting individualized models with this data and just learning a lot about what are the contextual factors that shape habit formation, how fast does it happen? So one, I'm really excited about machine learning.
A second thing that we take away that I haven't talked about besides this idea that there's no magic number is actually we also see that something happens with habits called reward devaluation which is that we had a point in time when lots of the people who we were studying who had been going to the gym started getting offers of programming to help them exercise more regularly.
We see that the people who are models call quite habituated who are models say like they've reached a habit. Those people are actually much less sensitive to those kinds of offers and efforts to help them change their behavior than people who are not yet in this predictable habituated mode according to those models. So that's also I think really interesting and it's a big takeaway that we've seen this in animal models before but showing that once a person forms a habit it's really hard to change their direction we can predict with machine learning when they're in that state and then we know once they've reached that state they're going to be harder to perturb off of their course.
So that's also important just for thinking about tailoring and personalizing the kind of offers we provide if you're a marketer, a health care plan, an employer. So I think that's really interesting too.
It sounds like this is also a little bit of a pivot moment as well from what machine learning can really give you as you move forward and you just kind of laid out of all the different potential impacts that are out there from having machine learning kind of going through a lot of this data.
I think that's right. It's really exciting and you know when we think about what's the biggest contribution of this paper I think you know for most readers they'll be excited to learn there's not a magic number and that this personalization of you know sending offers to people differentially based on whether a model says they're habituated or not that adds value. Those are big practical takeaways but a really big and exciting takeaway for the scientific community and frankly for practitioners as well is the power of machine learning applied in this way to try to model habit and to tell us interesting things we might not have been able to learn otherwise about the nature of habit. So I think that's really promising.
Are there other areas that as you have now done this work that you are interested to find out to see how machine learning kind of parses other data sets in other areas as well? Oh my goodness I mean so many. There's so many opportunities you know obviously one of the big hot areas is medical decision making and I think that's so important I do a lot of research on medical decision making and the opportunity to combine human intelligence with machine intelligence the better model decisions and improve them is so exciting because so many lives can be saved.
So that's where I feel most eager but I think there's enormous creative potential here and we're just starting to scratch the surface.
所以这就是我最渴望的地方,但我认为这里有巨大的创造潜力,而我们只是刚刚开始探索表面而已。
Katie always great to have you on the show thanks very much for your time enjoy the rest of your day.
Katie,很高兴你能来参加节目,非常感谢你花时间,祝你度过愉快的一天。
Thank you thanks for having me it was a pleasure.
谢谢你邀请我,我很高兴能够参与。
You got a Katie Milkman professor of operations information and decisions at the Wharton School and author of the recently released book How to Change.