Have you ever thought: “I want to learn to speak _____”?
That same energising thought got 300 million people to try out Duolingo, a freemium tool to learn any of 36 (and rising) languages. These include little-spoken tongues like Hawaiian and Scottish Gaelic and even fictional languages like Klingon (Star Trek) and High Valyrian (Game of Thrones).
Duolingo is surely doing something well to achieve these numbers. However, it took them years to slowly start to get it right. From this Duolingo review, I will show you the way to create a design that is engaging from the first release.
Duolingo Review
Duolingo has an appealing, playful design and a smooth Onboarding experience. Choose the language you want to learn, set a daily goal and immediately start completing guided exercises.
The exercises are short, only 10 questions long at first, and shouldn’t take more than 2-3 minutes to complete. Several embedded game mechanics add motivational boosts to make sure that new users reach their first win-states quickly:
A progress bar shows how close you are to completing the exercise. Each correct answer is rewarded with an encouraging sound effect. In between questions, Duo, the mascot owl, will comment on how great you are doing.
Reaching the win-state rewards Gems and EXP. And every completed exercise adds to the expansion of the Skill Tree that tracks the learning progress of the user.
‘Play’ some more and you will start to earn Achievement Badges and climb the Leaderboards.
The before mentioned elements are what comes to mind for most people when they think of Gamification examples. These game mechanics have one thing in common; they all leverage Core Drive 2: Development and Accomplishment.
Octalysis Analysis
The Octalysis framework is a powerful tool to analyse any experience in terms of how well it motivates the target audience to do the Desired Actions. The key to Octalysis is that it breaks down human motivation into eight Core Drives.
Core Drive 2 (CD2) is an extrinsic motivator. It is effective for drawing in new users and to create Effort Justification, making the user feel good about the time they spent in the experience.
However, it takes a lot more to create effective designs with long-lasting motivation. Getting users to come back day after day requires a balanced design that provides motivation from all eight Core Drives.
Streak Design
To motivate its users to return daily, the Duolingo Gamification team implemented a basic streak design. When you reach your daily EXP goal, a fire lights up and shows for how many consecutive days you have kept the fire burning. Miss one day and the streak is reset to zero. If time is running out, the app will send notifications to urge you to save the streak.
To do this Duolingo review, I kept up a 24-day streak. That accomplishment felt pretty good (CD2)! But the longer the streak, the more CD8: Loss and Avoidance comes into play. It becomes a Sunk Cost Effect; you really don’t want to miss a day after having invested so much in it already.
CD8: Loss and Avoidance is a powerful, urgent motivator. And it does work to drive daily activity from Duolingo users. There are currently even over 700 Duolingo users with an impressive streak longer than 2000 days! But there is a flip-side.
The daily stress of having to make sure not to lose your streak becomes more and more draining. For most people, it will start to feel like a burden and they will burn out eventually. After having missed a day, and breaking the streak, many users just quit completely.
The many jokes and memes that can be found online indicate the intensity of these emotions.
Over-Justification Effect
So what happened here? Almost all users try out Duolingo because they have a good amount of intrinsic motivation to start with, eager to learn a new language, where did that go?
What happened is the Over-Justification Effect. The extrinsic stimuli at first support what a person intrinsically wants to do, but in the long run they replace the intrinsic motivation. When the external stimuli then disappear, there is no motivation left.
What this Duolingo review shows, can also be seen in schools; where the focus on getting good grades can undermine a child’s innate passion for learning. As well as in business; when managers hand out a bonus to motivate their employees and find that, to keep up the motivation, they need to keep handing out higher and higher bonuses.
To prevent this from happening it is important to transition to more intrinsic Core Drives after Onboarding, like CD3: Empowerment of Creativity.
Duolingo Gamification Evolution
One thing Duolingo does well is learning. By gathering user data, Duolingo doesn’t only learn how people best learn a language, but also what does and doesn’t seem to work to keep their users motivated.
And they are not afraid to try out different approaches to test, in real life, how that affects user performance and motivation. The User Interface, for example, gets tweaks every few weeks.
When Duolingo reviewed the data, they also recognised there was a problem with the streak design being too Black Hat, so they tried different features to reduce the strain.
(Black Hat core drives are located at the bottom of the Octalysis chart. Black Hat core drives make us feel obsessed, anxious and addicted. If you are always doing something because you don’t know what will happen next, you are constantly in fear of losing something, or because you’re struggling to attain things you can’t have, the experience will often leave a bad taste in your mouth- even if you are consistently motivated to take these actions.)
A few years ago you could spend a few dollars to restore a broken streak. Giving users this option to save the streak can help a little, but having to spend real money also further increases the perceived weight of the Sunk Cost effect.
More recently this option was replaced with one free ‘Streak Repair’ per month for premium members, as well as a ‘Streak Freeze’ item that can be bought in the in-app shop with Gems. Having a Streak Freeze equipped allows for missing one day without breaking the streak, creating some much-needed breathing space.
More good features, that leverage some of the other Motivational Core Drives, have been added through the years. Like the option to follow friends (CD5: Social Influence), a free ‘Double EXP Potion’ that will sometimes, at random, appear in the shop (CD 7: Unpredictability) and the option to customise the experience by buying different outfits for Duo (CD4: Ownership).
A Better Approach than Trial and Error
Writing this Duolingo review reminded me of a workshop I once attended, held by somebody with a PhD in Gamification. And how disappointed I felt afterwards.
He strongly emphasised the need for rapid prototyping. Because, in his words: “After you come up with an idea, you need to test it to see if it works or not. And you just keep on trying and trying until you find something that sticks”.
Likewise, it took Duolingo years of trial and error to reach this point of being a decent human-focused experience. At the cost of losing demotivated users along the way. And there is still plenty of room for improvement. In the words of Gilani, Duolingo product manager: “AB testing and iterative changes will continue to roll out to further enhance the experience”.
Luckily there is a faster way. By applying the Octalysis Framework it is possible to accurately predict what will and what won’t work for your target audience. Unlocking the potential to create a balanced design that is highly impactful for each phase of the User Journey.
- Duolingo review – how to apply Gamification smarter - 15th February 2020
Great article, Dirk. When I read Actionable Gamification, it really changed my approach to designing for motivation my my learning programmes. The framework is so simple to apply and works so well with other complementary theories for, e.g. player types, that it is my go-to for engagement in all my design work now. You are so lucky to be part of it
Incredibly thorough analysis, Dirk. I’m the owner of a 380-day streak on Duolingo, and I was reading the section on the over-justification effect and thinking, ah, but they learned a bit and adjusted. And in the very next section, you showed you were already there. And then beyond.
I just finished the Octalysis book and was really impressed. This is a helpful case study of its application and has reminded me of the power of using it. Thanks.
Very fascinating. I did use Duolingo once. I felt i scoring well but not really learning the lannguage. Gave it up. After reading this piece and know they have made changes I might try it again. Would be interesting o hear your thoughts on the language app called Memrise. I found i was learning better over there.
I have been using Duolingo for four years. I started using it because I wanted to keep my French and Spanish current. Duolingo is very good for that purpose. Having to use the languages every day keeps you from forgetting. I think the gamification is pretty silly, but, it must work for many people. I like the concept of the streak because the higher your streak number, the less likely you are not to practice. Of course, the fact that Duolingo is free is very appealing. Now, I am getting a lot of pressure to start Duolingo Plus which you have to pay for.
First time to this site, so excuse the noob questions. I read about gamification introducing elements of play to better engage participants in a constructive exercise to elicit an educational outcome. I’m having difficulty in seeing how this is present in Duolingo’s methodology. From what I read above, they were pursuing an iterative exercise in persuasive psychology and when they encountered problematic Black Hat conditions, they mitigated them with revenue generating relief mechanisms or drivers to spread the streak model. It’s undoubtably an effective and sophisticated methodology to optimise recruitment and retention, but not transparent nor seeking to produce an answer. It seems to be a social media business model. How does ludology apply here? Any insights?
Thanks
I think (but I may be mistaken), that your question arises out of the fact that ‘Gamification’ has always been a problematic term, with many different interpretations. So, for example, for me, what you describe above is more what I understand as ‘games-based learning’ rather than gamification (whereas many other people definitely understand ‘gamification’ as relating to the creation of games). This article also relates to a specific gamification framework – Octalysis. If you look into Octalysis, you will see that it definitely is more closely related to ‘persuasive psychology’ than games design (although Yu-Kai Chou is / has been obviously a keen game player), and many of the resulting designed experiences can definitely be seen as playful.
Thanks fir the thoughtful reply Sarah. My reading continues!