20VC: Duolingo's Luis von Ahn on How CEO's Can Scale With The Company, How VC Herd Mentality In The Valley Really Works and How Chatbots & AI Play A Role In The Future of EdTech
Welcome back to the 20 minute VC with me Harry Stebbings at H Stebbings with two bees on Snapchat and as always I'd love to see you there for all things behind the scenes from us. However, to the show today and I'm thrilled to welcome a very special individual to the hot seat.
So joining us today we have Lewis von Arn, Founder and CEO at Juelingo. The leading language learning platform with over a hundred million users and they have backing from some of the best in the investing world including the likes of USV, Kleiner Perkins, NEA, Google Capital and even Ashton Kutcher.
欢迎回到《20分钟VC》,我是Harry Stebbings,在Snapchat上有两只蜜蜂的H Stebbings。如往常一样,我很乐意与您分享幕后的一切事情。今天的节目非常精彩,我非常高兴能够邀请到一位非常特别的人坐到嘉宾席上。
今天加入我们的是Juelingo的创始人兼CEO Lewis von Arn。Juelingo是领先的语言学习平台,拥有超过1亿用户,并且得到了一些最佳投资者的支持,包括USV、Kleiner Perkins、NEA、Google Capital,甚至还有阿什顿·库彻尔。
And prior to Juelingo Lewis is known for inventing capsters, being a MacArthur fellow or otherwise known as the Genius Grant and selling two companies to Google in his 20s. As a result Lewis has been named one of the 10 most brilliant scientists by popular science magazine and one of the 20 best brains under 40 by Discover.
Quite a CV huh and the show absolutely does live up to that CV and a huge science delay list early at capital G for the intro to Lewis today without which this episode would not have been possible.
But before we move into the show today, if you're a founder or operator, your most important job is people operations, whether that be hiring execs, developing managers or retaining top talent. And that's why you need lattice. lattice is the number one performance management solution for growing companies. With lattice is easy to launch 360 performance review cycles as often as you want and you also get an incredible continuous feedback system with OKR gold tracking, real time feedback and one-on-one meetings to ensure employees get feedback between reviews.
So find out why the likes of Coinbase, Plangrid, Birchbox and Weepay trust lattices their performance management solution by heading over to lattice.com to start investing in your people. That's lattice.com, the number one performance management solution for growing companies.
And speaking of number one there, you must check out Recurly, the company powering subscription success. With Recurly's enterprise class subscription management platform providing rapid time to value without requiring massive integration effort and expense and they have the ability to not only increase revenue by 7%, but also reducing the all important churn rate. And that's why thousands of customers from Twitch to HubSpot to CBS Interactive trust are currently their subscription management platform and you can check them out now on Recurly.com that really is a must.
But enough for me so I'm now thrilled to hand over to the wonderful Lewis Von Arn founder and CEO at Jua Lingo. You have now arrived at your destination.
但对我来说已经足够了,所以我现在非常高兴地把话筒交给了出色的 Lewis Von Arn,他是 Jua Lingo 的创始人和首席执行官。你已经到达了你的目的地。
Lewis it's such a pleasure to have you on the show today. You sized a Layla Google capsule or capsule G for the intro but thank you so much for joining me stay Lewis. Yeah I'm super happy to be here.
I'd love to kick off today with how you a man as you put it who has never been great at languages came to master language learning with Jua Lingo. So what's the founding story?
Yeah this was a five five and a half years ago. I had just sold my second company to Google and I wanted to do something related to education. At the time I was a computer science professor at Carnegie Mell University and my PhD student and I both teamed up and we just wanted to do something related to education now. Education is very general so we kind of started looking at different verticals inside education, maybe teaching math or teaching. We wanted to teach something and we came up languages because it's inside the US or maybe the UK it's not as big of a deal to learn languages but everywhere in the world. I myself am from Guatemala. I have everywhere else in the world learning a language is a huge deal. Particularly learning English so we decided that we wanted to do something related to learning languages.
It's a huge audience 1.2 billion people in the world learning a foreign language about 80 billion dollars a year 8080 billion dollars a year are spent on language learning and at the time of founding of founding Dueling we one of the things that was always crazy for us is most of the people that are learning a foreign language about two thirds of them satisfy three properties first they're learning English second the reason they're learning English is in order to get a job and third they are of low socioeconomic conditions so most people trying to learn a foreign language are basically trying to learn English in order to get out of poverty but most of the ways they were to learn a language particularly with software we're very expensive in the US there's this thing called Mercedes Stone which was between 500 and a thousand dollars and there are similar programs everywhere in the world so it seemed ironic to us that it required about a thousand dollars to get out of poverty by learning English so we decided to make Dueling Go which was going to be a free way to learn language that was that was what we launched.
Now I want to ask a very very broad and matter question just to start with then why is it that ed techs are always deemed such a hard space if you're at a dinner party with a load of VCs and you say ed tech a lot of them will go it's a hard space why do you think it's got the perception of such kind of hardship around it oh we have spent years discussing this within you know inside the company I think there's a number of reasons
I think one is first you have to decide are you gonna do an ed tech thing where you actually teach something or you're gonna do an ed tech thing where you're just kind of this supporting a supporting tool and by supporting tools I mean very successful but supporting tools that are just like blackboard as a supporting tool where it's just kind of classroom management system or remind is another supporting tool where it's it's a system it's not actually for teaching anything it's just a way to for teachers to communicate with students in some way so first you have to decide you're gonna teach something or you're gonna do some sort of supporting tool if you're gonna do a supporting tool you know one of the things is you're always gonna be on the side and you're never going to be the main course I mean the main course is actually the teaching if you're gonna decide to teach something there is a big problem which is I don't believe there's an easy way to do a really simple app where in some way kind of you crowdsource the teaching from one side to the other like for example think of instagram instagram is an amazing app but it is not a massively difficult app to build you build this app and you get basically people publishing pictures for others to consume so you're not actually creating any real content yourself if you're building an app like instagram whereas if you're gonna teach something I strongly feel like you have to really solve the content creation side and it's not as simple as just making a little app that can just hook up people who know versus people who want to learn and they'll learn I don't think it's as simple as that I think that's one big difficulty
I think another big difficulty is that education is regulated and and it's tough a lot of the money that is in education is two governments and that's pretty tough because it's pretty decentralized even you know even inside the United States education is usually at the at the district level at the school district level where where things are spent so it's not like you can have a contract with the whole US school system or anything like that and different district levels teach differently different districts teach differently different countries teach differently it's very hard to make a single tool that will scale to everybody and then with the fact that it's regulated and also in many countries think about usually the wealthier countries education is free and pretty good so if you make something and you want to compete with the school system you know it's kind of hard you have to do something that is there's 10 times better than the school system and you know the school system for example in Switzerland it's pretty good doing something that's 10 times better than that is hard so I think all of those things combined make it so that at tech is hard yeah no I completely agree
But I do want to start say with two elements so that potentially radically changing the world of ad tech and how we consume educational content so let's start with with one being AI what role do you think that AI and machine learning play in really teaching languages I think it's huge and we're betting a lot of the company on that at duolingo the way we see it so with duolingo you know we're trying to teach you a language that's what we're trying to do what I would like to do a linga to be so I would like to a linga to be as effective as a one-on-one. human tutor this is something that I think can can be transformational
I mean there's a lot of studies in educational psychology that show you know the most famous one it's something called the blooms to sigma study it shows the following compares a student in a standard classroom let's say with 30 other students or 20 other students a standard classroom student it compares their academic achievement with a student that is not in the classroom but has a one-on-one human tutor turns out that those who have a one-on-one human tutor perform better than 98 percent of the people in a classroom which is a huge deal that's to sigma it means to standard deviations above the median in terms of performance so we know that one-on-one human tutors do better than classroom this is known this has been known for a while and so the best thing we could do for education is to have everybody you know to give everybody a one-on-one human tutor the problem of course is that's really hard you know that requires one teacher per student then we kind of don't have that so for a really scalable model of self-subs you could have yes this is not great but I think artificial intelligence could do something
so our goal is for duolingo to be as good as a one-on-one human tutor so really that would be significantly better than a classroom significantly better than anything else and that's what we want to do we're we're spending a lot of our effort creating artificial intelligence that can teach you as well as a human teacher now is that going to happen super soon i'm not going to happen this year but I think that's where we want to go and so we're spending a lot of our effort on that and this is why we launched two months ago we launched a chatbot that you can try to practice your conversation with and it's been very successful I love the chatbot personally
but the big question then for me surrounding the chatbot element is the transition to bots and kind of that conversational interface that it is does that represent a major point of disruption or more do you think it's just an evolution in the interface paradigm within edtech and how we consume content it depends I think for language learning in particular I think it is a paradigm shift in the case of language learning the thing is the conversation chatbots were a fad a few months ago I don't think it's all that useful to have something like teaching math where you have a chatbot because the conversation's not the real element you know you're somehow trying to teach math whereas in languages you're trying to teach the conversation so I think you know that's the main course here and I think that's why you know chatbots and language learning are really a natural for that to happen I don't think it's the chatbots became kind of popular for even you know Domino's pizza had a chatbot to order pizza I don't think you need a chatbot to order pizza but in the case of language learning you're practicing conversation so I think it's a huge deal for that
I'm also intrigued by another element though that's largely driven a lot of edtech companies in the way they teach his gamification how do you view the integration of education in games for us it's been huge and it's probably been the thing that has made us stand out in the case of language learning from the beginning when we launched a lingo we realized one thing when you're trying to learn something the hardest part is keeping yourself motivated if you're trying to learn something by yourself this is very different than going to school see what going to school basically society is motivating you to go to school your parents are kind of forcing you to do it there's a teacher there your friends are there to go there you stop going you become kind of an outcast to society there's a whole social structure in motivating you to go to school if you're just learning something from an app there's nothing really motivating you and it's very easy for people to kind of give up this is why you see a lot of education companies when they launch something the user retention numbers are very very bad
When you compare user retention numbers i mean you see a lot of these you know for example a lot of the the MOOC companies they're the massively online course companies like Coursera and Udacity etc the retention numbers for their courses are abysmal i mean the number of people that sign up something like 1.5% or 2% of the people actually bother to complete the whole thing because it's super easy to give up and hey on the other side there's Facebook's right there i can just check my Instagram or Snapchat or go play a you know Candy Crush so it's really easy to give up so for us we realize this early on so we spent a lot of effort trying to make duolingo as addictive as possible and this is what we spend most of our effort on historically we spent most of our effort on making it as addictive as possible so today one of the things that i'm happiest about is with duolingo our user retention numbers are pretty similar to kind of you know we compare ourselves to games so if you look at for example of the people who sign up on duolingo about 55% come back the next day that's the number that is comparable to pretty good games and if you look at usually education companies the numbers that you get there are you know 10% come back the next day or 15% come back the next day and most of that we've done through gamification.
Can I suppose the seven day return? Ah for us on returning on D7 so on the seventh day probably you know it's north of 30% that's correct yeah so we do compare ourselves i mean this is the thing we compare ourselves to a game and you know a lot of people ask us who are competitors are etc and usually that what we consider competitors are our games we look at a lot of companies like Supercell who i admire a lot they're making they're making these amazing games where they're D365 retention like one year later you know they're they're looking at things like 20% on the the 365 day people are there this is amazing and i think i think you know their idea for us is to make education as addictive as one of these games so we do spend effort but we have a team whose job it is to make duolingo addictive and we look at things that we look at how casino games work and we look at you know we're using randomness to make things addictive and that's our goal is to make it as addictive as a as a game no i read an article from your in VP of growth i think it was you said but just putting the little red icon in the top hand corner at increased return the next day by 6.5% which is pretty astonishing yeah and and you know something else that we're really embracing a lot in the company this is an interesting thing we survey our users regularly and we have found that to our surprise at first we thought when we survey our users we asked them you know why are you learning learning on duolingo and i what i thought it was you know half the people were going to tell us something like i've always wanted to learn spanish or or my my grandma doesn't speak my language and that's why i need to learn Swedish or the people who are learning english so i need to get a job with that i yikes or travel was another one this is what i expected we found that a pretty large fraction of our users it's it's not quite 50% but if you look at wealthy countries it is close to 50% large fraction of our users but their answer was was none of these it was basically i just don't want to completely waste my time what they say is you know normally i would i'd be playing candy crush so i consider duolingo kind of a game it's not quite as fun as candy crush but at least i don't feel bad because i'm not spending my time on a complete you know waste of time that a lot of people are using this where it's just like so we're we're really embracing this where it's just kind of guilt free entertainment where you know you're you're entertained at the end of the day you're kind of entertaining you're you're probably procrastinating on what you actually need to do which is probably your you know your homework or whatever but you don't feel totally bad because hey at the end you learned part of a language or something as opposed to if you spent the last three hours playing candy crush sure so that's something that we're really embracing that makes that makes sense.
I do want to slightly move away from the edtech landscape itself though and move more towards you and particularly you as a as a leader and as a CEO. We recently had Sean Rad at Tinder on the show and he said the best CEO's scale with their companies. Now Duolingo's clearly scaling incredible recent round of funding 200 million users. I'd love to hear how you've seen yourself scale so to speak and develop with the changes to the firm. Yeah, it's been it's been a pretty big change.
I had started companies before but the largest company outside before had sold to Google when it hadn't you know, I don't know under 15 people so I had never really managed a company that had this many people and it's been a growing opportunity for me. The first thing I had to do was stop micromanaging that that's the first thing I had to do and then I had to really learn that my job is not actually doing the things that need to get done but really motivating people to do the things that need to get done. So I spend most of my time nowadays motivating and communicating just basically making sure that everybody's pointing in the same direction. That's what I spend most of my time on and that's been a pretty big shift.
Can you tell me about it, and this is a new question, but what I'd love to hear about maybe a specific situation where a CEO you really struggled to come to gross with it with the scaling of the firm and how did you overcome that for me personally? A few things I've had to learn how to be much better at. One was firing people. I had huge trouble firing people. You know, this is funny story inside Duolingo. The first person I fired inside Duolingo, it's not like we fire a lot of people, by the way, it's very rare, but you have to do it sometimes. The first person I fired inside Duolingo, I had to fire them four times because they didn't actually understand that they were being fired. I think that's your fault, Lewis. I think you should, you know, I understand that was that was my fault and there's this, it's a funny story. I mean, I did it and then they came the next day and I was like, I thought I had fired them so I, you know, I've gotten, I've gotten a lot better doing this.
It's not like again, it's not like we do it often, but I've gotten a lot better. Do you agree with higher force fire fast? No, I do not agree with that. We're actually doing quite the opposite. We're very picky at hiring. I mean, we have raised quite a bit of money. We have raised about a hundred and eight million dollars. So we only have about a hundred employees now. We would be able to have way more employees than we do now, but we're very careful with hiring. So because for us we just think that hiring mistakes are just a huge time sink, so our interview process is really tough. So we hire slow, but we also once we hire somebody we kind of give people a chance here. So we're the opposite of higher fast fire fast. What were the other elements that you learned you said there are a couple.
I think another thing that I've had to learn a lot is how much what I say really matters. When we were a smaller company, we were all friends and, but I really was at the same plane almost everybody else even though I had the title of CEO. I kind of if we were all roughly the same plane as each other, these days I realized that I, and I find it, I mean, I realized that sometimes I have some comments off the cuff that I just say like uh, which probably just to this, and then then I look a couple weeks later, and they're actually doing the thing that I, that I, you know, I just, I kind of pull it out of nowhere and so now I have to be really careful when whatever I say a lot of times I have to say hey, I'm just gonna say this, if this does not mean that you guys need to start doing it or anything, it's just an idea and it's probably a stupid idea, but here it is because I, you know, took me a while to realize that absolutely a lot of times people are of your words.
Yes, and because I just consider myself just another normal employee where whenever there's a there's a brainstorm or anything, I just, I'm just throwing ideas just like everybody else and sometimes I don't even think that my ideas are any better than the other ones that are being thrown in there, but I see that sometimes they just get executed, and I myself thought they were a bad idea, but it's just what I said. I love it well very modest of you, but I do want to finish today and before we dive into the quick fire round or make an exciting series e-round at 25 million from drive, so talk to me about this round of funding how was it and how did it differ from the prior rounds? Yeah, it was a pretty different round and it's the first time where a few things happened.
We did not want to raise a lot of money so in a you know weird situation we actually were negotiating down on how much money we needed to raise as opposed to up. So why was it so why wasn't it a 700 valuation? I was kind of surprised.
At the 25 raise yeah we negotiated that down it's because we didn't think we needed more money i mean the truth of the matter is we're not quite yet breaking even but we're very close we're going to break even very soon and this round of funding was mainly it's a bit of insurance in case we take a little it takes a little longer to break even and it also allows us to hire a little faster that that's all it was.
I don't know if this happens to other companies but in our case there's this cyclical thing that i don't know why this happens but every few months i don't know how many months but every and let's say every four or five months we get contacted by so we spend about four or five months we don't i personally don't hear from any venture firm they just don't hear anything from them and then in a span of about two weeks i hear from like 12 of them and they're all like hey i'd like to invest you know really you know we as a firm are really excited by your progress etc etc and it's very strange.
I don't know if they're all on the same calendar or if they talk to each other or what the deal is i can give you a hint they all have kind of data sourcing tools and so when you have inflections in in growth charts in retention rates in employee count they all get notified at the same time that's probably what's happening but it's a very funny thing and so what happened is we had one of these couple of week periods where we got contacted by a bunch of firms then it was it was near one of our board meetings and i went into the board meeting and i said look i do we just got contacted by a bunch of firms many of which are are kind of very well known firms and so fancy firms you know what should we do and then we looked at our you know we looked at our finances and we thought eh big gourd is one of the people in our board he's from planter perkins and and he said he said something you know something like i wouldn't mind the next to 25 million bucks in the bank account.
So we engaged with some of the companies that had talked to us and we decided well we didn't particularly need the money but it wouldn't be it wouldn't be bad to put the money in the bank account and we talked to a few of them and we really love the drive capital guys they're they're not a Silicon Valley firm which was rare i mean most of the other firms we were talking to were Silicon Valley firms kind of well known Silicon Valley firms and a growth equity for private equity firms we really like them you know they're investment thesis there's two things first of all they invest in category leaders and that you know they consider dueling with a category leader in language learning and the second thing we really like this for them this was the only company for which Pittsburgh we're located in Pittsburgh we're not in Silicon Valley for them that was not a downside.
Drive capitalist is started by a couple of people who used to be at Sequoia who decided that they were gonna invest in you know the Midwest so it's a couple of Sequoia folks who came to start a firm in Ohio and their investment thesis is category leaders that are located in the Midwest and so so it was a perfect fit yeah it was and they said they could really help us with hiring here in the Midwest etc and it was a breath of fresh air whenever we talk to people it made mainly from Silicon Valley there you know the first thing is a lot of them don't even know we're not in Silicon Valley a lot of the investors that we talk is they're like okay so you know can we meet this afternoon and you know you're you're talking to them and you're like uh we would take me eight hours to get there cannot meet this afternoon so sorry the time is for offering yeah exactly we're we're not there so you know for most kind of Silicon Valley investors you know it's a downside that we're in Pittsburgh and I understand that I mean it makes sense from there and but for the drive folks it was not and you know we met their team and they seemed really smart you know a plus team and so we we decided to take money from them love it what a good answer.
But I want to move into the final quick fire and so it's five questions five minutes how does that sound sounds good so your favorite book and why you know my first knee-jerk reaction for that is it's a book that I read as a teenager which was called girl Acer Bach which was by Douglas Hofstadter it basically explains a lot of the basics of computing that were developed in the 20th century I really liked that but that was a long time ago.
I mean off the late I really liked high output management by Andy Grove who was the CEO of Intel you know that has helped me in terms of becoming a better CEO I did not find it as enjoyable as the girl Acer Bach but. I did learn a lot from it taught me about the very precise day you work out routine
I've been warned on this one so tell me what is it yes I work out every day I mean a lot of people think I'm kind of crazy about it so I work out for precisely 16 minutes and I basically you know I started with 10 and I kept on increasing until about 16 and then at that point I you know I work out for 16 but the actual thing takes about 25 minutes because what happens is for 16 minutes I just either run or do an elliptical as freaking hard as I can and so it takes me another 10 minutes to catch my breath after so the whole thing takes about 25 minutes but you know that's basically I just do it for I just don't have much more time to spend on that and so I go nuts doing that people who watch me do I think that I'm about to have a heart attack hopefully hopefully that doesn't happen anytime soon but that's my that's what I do I love it
what about the favorite blog on newsletter are there any must reads when they come in you know I really like Fred Wilson's blog it's the one that I've been reading through the years and I mean many of them kind of come and go I like that one that that's been one that I read through the years I really universe squares one of our investors and I really love those guys most of their opinions are things that I agree with
what would you most like to change in the world of VC in startups diversity I would like startups and VCs to be more diverse and it would help everybody that that were the case we as tech companies struggle with diversity just like everybody else in particular I find that the VC world is not very diverse I mean many many firms that you see have no female partners be great if we could change that not an easy and of course you know it's hard to blame anybody it's not an easy thing to change it's kind of societal and cultural changes are they just take a long time
and then let's finish today on the next five years for you and for Jurelingo what for your own store well we want to be a publicly traded company I don't know when that'll happen kind of very early to tell we're gearing up towards that I think our revenues are going to justify it in maybe I'm hoping that in 2019 our revenues would justify a publicly traded company that's what we're hoping to do I think that's what will happen well I look very forward seeing you ring the bell but it's been such a pleasure to have you on the show as I said I've heard so many great things from Layla and Jean so thank you so much for joining me today thank you for having me
such a fantastic episode with Lewis there and if you'd like to buy Lewis's workout video then please do send me your snaps I would love to see them on at age stepings with two bees I am of course joking I don't think there is quite a workout video yet but if you do try it do send me the photos at age stepings with two bees on snapchat it'd be fantastic to see those and again a huge thanks to Jean and Layla at capital G for the intro to Lewis today without which today's episode would not have been possible
but before you leave you today if you're a founder or operator you're most important job is people operations whether that be hiring execs developing managers or retaining top talent and that's why you need lattice lattice is the number one performance management solution for growing companies with lattice is easy to launch 360 performance review cycles as often as you want and you also get an incredible continuous feedback system with okay or goal tracking real-time feedback and one-on-one meetings to ensure employees get feedback between reviews so find out why the lights of coin-based plan grid birch box and we pay trust lattice is their performance management solution by heading over to lattice.com to start investing in your people that's lattice.com the number one performance management solution for growing companies
And speaking number one there, you must check out Ricurly. The company is powering subscription success with Ricurly's enterprise class subscription management platform. The platform provides rapid time to value without requiring massive integration effort and expense. They have the ability to not only increase revenue by 7%, but also reducing the all-important churn rate. That's why thousands of customers from Twitch to Hub Spot to CBS Interactive trust Ricurly as their subscription management platform. You can check them out now on Ricurly.com - that really is a must.