Abstract
The number of websites and mobile applications available is growing continually, as are the persuasive approaches to influence human behavior and decision making. Although designing for persuasion offers several potential benefits, recent developments expose various deceptive designs, that is, dark patterns, that utilize psychological factors to nudge people toward, from someone else’s perspective, desired directions. This paper contributes to an increased awareness of the phenomenon of dark patterns through our exploring how users perceive and experience these patterns. Hence, we chose a qualitative research approach, with focus groups and interviews, for our exploration. Our analysis shows that participants were moderately aware of these deceptive techniques, several of which were perceived as sneaky and dishonest. Respondents further expressed a resigned attitude toward such techniques and primarily blamed businesses for their occurrence. Users considered their dependency on services employing these practices, thus making it difficult to avoid fully dark patterns.
Metrics
References
- Adel, B. (2017, May 15). Persuasive UX: The role of emotions in decision making [Web log post]. Retrieved April 27, 2019, from https://medium.com/@beckiiadel/persuasive-ux-the-role-of-emotions-in-decisionmaking-4f83076dde0a
- Alsawaier, R. (2018). The effect of gamification on motivation and engagement. International Journal of Information and Learning Technology, 35(1), 56–79. https://doi.org/10.1108/IJILT-02-2017-0009
- Andersen, M. (2016, November 2). Deceptive design is illegal now, so why are you still getting swindled? Retrieved June 1, 2019, from http://eyeondesign.aiga.org/deceptive-design-is-illegal-now-so-why-are-youstill-getting-swindled/
- Asbury, K. (2014, February 12). Affinion Group faces class action after paying out claims to AGs. Retrieved February 13, 2019, from https://www.washingtonexaminer.com/affinion-group-faces-class-action-afterpaying-out-claims-to-ags
- Bardzell, J., & Bardzell, S. (2013). What is “critical” about critical design? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13; pp. 3297–3306). New York, NY, USA: ACM Press. https://doi.org/10.1145/2470654.2466451
- Bardzell, S., Bardzell, J., Forlizzi, J., Zimmerman, J., & Antanitis, J. (2012). Critical design and critical theory: The challenge of designing for provocation. In Proceedings of the Designing Interactive Systems Conference
- (DIS ’12; pp. 288–297). New York, NY, USA: ACM Press. https://doi.org/10.1145/2317956.2318001 Barnes, S. (2006). A privacy paradox: Social networking in the United States. First Monday, 11(9). https://doi.org/10.5210/fm.v11i9.1394
- Bechara, A. (2004). The role of emotion in decision-making: Evidence from neurological patients with orbitofrontal damage. Brain and Cognition, 55(1), 30–40. https://doi.org/10.1016/j.bandc.2003.04.001
- Berdichevsky, D., & Neuenschwander, E. (1999). Toward an ethics of persuasive technology. Communications of the ACM, 42(5), 51–58. https://doi.org/10.1145/301353.301410
- Bernedo, M., Ferraro, P. J., & Price, M. (2014). The persistent impacts of norm-based messaging and their implications for water conservation. Journal of Consumer Policy, 37(3), 437–452. https://doi.org/10.1007/s10603-014-9266-0
- Bösch, C., Erb, B., Kargl, F., Kopp, H., & Pfattheicher, S. (2016). Tales from the dark side: Privacy dark strategies and privacy dark patterns. In Proceedings on Privacy Enhancing Technologies, 2016(4), 237–254. https://doi.org/10.1515/popets-2016-0038
- Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
- Brignull, H. (2011, November 1). Dark patterns: Deception vs. honesty in UI design. Retrieved March 15, 2019, from https://alistapart.com/article/dark-patterns-deception-vs.-honesty-in-ui-design/
- Brignull, H. (2013, August 29). Dark patterns: Inside the interfaces designed to trick you. Retrieved March 19, 2019, from https://www.theverge.com/2013/8/29/4640308/dark-patterns-inside-the-interfaces-designed-totrick-you
- Brignull, H. (2016, December 23). Dark patterns: User interfaces designed to trick people (louder version) [Video file]. Retrieved February 21, 2019, from https://www.youtube.com/watch?v=zaubGV2OG5U
- Brignull, H. (2018). Dark patterns. Retrieved February 21, 2019, from https://www.darkpatterns.org
- Brownlee, J. (2016, August 22). Why dark patterns won’t go away. Retrieved February 21, 2019, from https://www.fastcompany.com/3060553/why-dark-patterns-wont-go-away
- Campbell-Arvai, V., Arvai, J., & Kalof, L. (2014). Motivating sustainable food choices: The role of nudges, value orientation, and information provision. Environment and Behavior, 46(4), 453–475. https://doi.org/10.1177%2F0013916512469099
- Chivukula, S. S., Brier, J., & Gray, C. M. (2018). Dark intentions or persuasion? In Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems (DIS ’18; pp. 87–91). New York, NY, USA: ACM Press. https://doi.org/10.1145/3197391.3205417
- Chivukula, S. S., Watkins, C., McKay, L., & Gray, C. M. (2019). “Nothing comes before profit”: Asshole design in the wild. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19; pp. 1–6). New York, NY, USA: ACM Press. https://doi.org/10.1145/3290607.3312863
- Cialdini, R. B. (1984). Influence: The psychology of persuasion. New York, NY, USA: William Morrow and Company.
- Csikszentmihalyi, M. (1975). Beyond boredom and anxiety. San Francisco, CA, USA: Jossey-Bass Publishers.
- Davis, J. (2009). Design methods for ethical persuasive computing. In Proceedings of the 4th International Conference on Persuasive Technology (Persuasive ’09; pp. 1–8). New York, NY, USA: ACM Press.
- https://doi.org/10.1145/1541948.1541957
- Dow Schüll, N. (2014). Addiction by design: Machine gambling in Las Vegas. Princeton, NJ, USA: Princeton University Press.
- Draper, N. A. (2017). From privacy pragmatist to privacy resigned: Challenging narratives of rational choice in digital privacy debates. Policy & Internet, 9(2), 232–251. https://doi.org/10.1002/poi3.142
- Draper, N. A., & Turow, J. (2019). The corporate cultivation of digital resignation. New Media & Society, 21(8), 1824–1839. https://doi.org/10.1177%2F1461444819833331
- Dunne, A., & Raby, F. (2001). Design noir: The secret life of electronic objects. Basel, Switzerland: Birkhäuser.
- Estevão, P. (2017, February 17). The dark side of UX design — Part 1: How brands might be manipulating your choices. Retrieved February 21, 2020, from https://medium.com/interactive-mind/the-dark-side-of-ux-designpart-1-ec94b305fca6
- Fansher, M., Chivukula, S. S., & Gray, C. M. (2018). #darkpatterns. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’19; pp. 1–6). New York, NY, USA: ACM Press. https://doi.org/10.1145/3170427.3188553
- Farvolden, P., Denisoff, E., Selby, P., Bagby, R. M., & Rudy, L. (2005). Usage and longitudinal effectiveness of a Web-based self-help cognitive behavioral therapy program for panic disorder. Journal of Medical Internet Research, 7(1), E7. https://doi.org/10.2196/jmir.7.1.e7
- Fischhoff, B. (2002). Heuristics and biases in application. In T. Gilovich (Ed.), Heuristics and biases: The psychology of intuitive judgment (pp. 730–748). Cambridge, UK: Cambridge University Press. https://psycnet.apa.org/doi/10.1017/CBO9780511808098.043
- Flanagan, M., & Nissenbaum, H. F. (2014). Values at play in digital games. Cambridge, MA, USA: The MIT Press.
- Fogg, B. J. (2003). Persuasive technology: Using computers to change what we think and do. Burlington, MA, USA: Morgan Kaufmann Publishers.
- Fogg, B. J. (2009). A behavior model for persuasive design. In Proceedings of the 4th International Conference on Persuasive Technology (Persuasive ’09; Paper 40). New York, NY, USA: ACM Press. https://doi.org/10.1145/1541948.1541999
- Friedman, B., Kahn, P. H., Jr., & Borning, A. (2002). Value sensitive design: Theory and methods. (Report No. 02-12-01). Retrieved February 21, 2020, from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.11.8020&rep=rep1&type=pdf
- Frobrukerrådet. (2018). Deceived by design: How tech companies use dark patterns to discourage us from exercising our rights to privacy. Retrieved February 21, 2020, from https://fil.forbrukerradet.no/wp-content/uploads/2018/06/201806-27-deceived-by-design-final.pdf
- Garrett, J. J. (2011). The elements of user experience: User-centered design for the web and beyond (2nd ed.). Berkeley, CA, USA: New Riders Publishing.
- Gill, P., Stewart, K., Treasure, E., & Chadwick, B. (2008). Methods of data collection in qualitative research: Interviews and focus groups. British Dental Journal, 204(6), 291–295. https://doi.org/10.1038/bdj.2008.192
- Gray, C., & Chivukula, S. S. (2019). Ethical mediation in UX practice. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19; Paper 178). New York, NY, USA: ACM Press. https://doi.org/10.1145/3290605.3300408
- Gray, C. M., Kou, Y., Battles, B., Hoggatt, J., & Toombs, A. L. (2018). The dark (patterns) side of UX design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18; pp. 1–14). New York, NY, USA: ACM Press. https://doi.org/10.1145/3173574.3174108
- Gray, C. M., Stolterman, E., & Siegel, M. A. (2014). Reprioritizing the relationship between HCI research and practice. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS ’14; pp. 725–734). New York, NY, USA: ACM Press. https://doi.org/10.1145/2598510.2598595
- Greenberg, S., Boring, S., Vermeulen, J., & Dostal, J. (2014). Dark patterns in proxemic interactions: A critical perspective. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS ’14; pp. 523– 532). New York, NY, USA: ACM Press. https://doi.org/10.1145/2598510.2598541
- Hammarberg, K., Kirkman, M., & de Lacey, S. (2016). Qualitative research methods: When to use them and how to judge them. Human Reproduction, 31(3), 498–501. https://doi.org/10.1093/humrep/dev334
- Hern, A. (2018, May 21). What is GDPR and how will it affect you? Retrieved February 21, 2020, from https://www.theguardian.com/technology/2018/may/21/what-is-gdpr-and-how-will-it-affect-you
- Hoofnagle, C. J., & Urban, J. M. (2014). Alan Westin’s privacy homo economicus. Wake Forest Law Review, 261, 261–317. Retrieved February 21, 2020, from https://www.ftc.gov/system/files/documents/public_comments/2015/09/00003-97143.pdf
- Jain, P. (2018, November 2). Learnings from persuasive and emotional design studio. Retrieved February 21, 2020, from https://medium.com/@MASTERPRANJAL/learnings-paradox-in-design-c325f0ea28ab
- Jaiswal, A. (2018, April 16). Dark patterns in UX: How designers should be responsible for their actions. Retrieved February 21, 2020, from https://uxdesign.cc/dark-patterns-in-ux-design-7009a83b233c
- Jendryschik, M. (2013, December 14). Durch die brille des nutzers I: Usability engineering: Arbeiten mit nutzungsanforderungen [Through the eyes of the user I: Usability engineering: Working with usage requirements]. Retrieved February 21, 2020, from http://webkrauts.de/artikel/2013/durch-die-brille-des-nutzers-1 Johnson, E. J., & Goldstein, D. (2003). Do defaults save lives? Science, 302(5649), 1338–1339.
- https://doi.org/10.1126/science.1091721
- Kahneman, D. (2012). Thinking, fast and slow. London, UK: Penguin Books.
- Kahneman, D., & Frederick, S. (2002). Representativeness revisited: Attribute substitution in intuitive judgment. In T. Gilovich (Ed.), Heuristics and biases: The psychology of intuitive judgment (pp. 49–81). Cambridge, UK: Cambridge University Press. https://psycnet.apa.org/doi/10.1017/CBO9780511808098.004
- Kaufman, G., & Flanagan, M. (2015). A psychologically “embedded” approach to designing games for prosocial causes. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 9(3), Article 5. https://doi.org/10.5817/CP2015-3-5.
- Keith, J. (2017, November 18). Hooked and booked. Retrieved February 21, 2020, from https://adactio.com/journal/13109
- Kitzinger, J., & Barbour, R. (1999). Developing focus group research: Politics, theory and practice. Thousand Oaks, CA, USA: Sage Publications.
- Kokolakis, S. (2017). Privacy attitudes and privacy behaviour: A review of current research on the privacy paradox phenomenon. Computers & Security, 64, 122–134. https://doi.org/10.1016/j.cose.2015.07.002 Komninos, A. (2019). Norman’s three levels of design. Retrieved February 21, 2020, from https://www.interaction-design.org/literature/article/norman-s-three-levels-of-design
- Krueger, R. A., & Casey, M. A. (2000). Focus groups: A practical guide for applied research (3rd ed.). Thousand Oaks, CA, USA: Sage Publications.
- Kumar, J. M., & Herger, M. (2014). Gamification at work: Designing engaging business software. Aarhus, Denmark: The Interaction Design Foundation.
- Lanier, J. (2018). Ten arguments for deleting your social media accounts right now. London, UK: The Bodley Head.
- Lewis, C. (2013). Motivational design patterns (Doctoral dissertation, University of California Santa Cruz, CA, USA). Retrieved February 21, 2020, from https://escholarship.org/uc/item/30j4200s
- Lockton, D. (2012). Persuasive technology and digital design for behaviour change. SSRN Electronic Journal. https://dx.doi.org/10.2139/ssrn.2125957
- Lockton, D. (2013). Design with intent: A design pattern toolkit for environmental & social behaviour change (Doctoral dissertation, Brunel University London, UK). Retrieved February 21, 2020, from http://bura.brunel.ac.uk/handle/2438/7546
- Malaga, R. A. (2010). Search engine optimization—Black and white hat approaches. Advances in Computers: Improving the Web, 78, 1–39. https://doi.org/10.1016/S0065-2458(10)78001-3
- Mathur, A., Acar, G., Friedman, M. J., Lucherini, E., Mayer, J., Chetty, M., & Narayanan, A. (2019). Dark patterns at scale: Findings from a crawl of 11K shopping websites. In Proceedings of the ACM on Human-Computer Interaction, 3 (CSCW). Article 81. https://doi.org/10.1145/3359183
- Mehta, R., & Zhu, R. J. (2009). Blue or red? Exploring the effect of color on cognitive task performances. Science, 323(5918), 1226–1229. https://doi.org/10.1126/science.1169144
- Midden, C. J. H., McCalley, L. T., Ham, J. R. C., & Zaalberg, R. (2008, May). Using persuasive technology to encourage sustainable behavior. Paper presented at the 6th International Conference on Pervasive Computing, Workshop on Pervasive Persuasive Technology and Environmental Sustainability, Sydney, Australia.
- Mirnig, A. G., & Tscheligi, M. (2017). (Don’t) join the dark side: An initial analysis and classification of regular, anti-, and dark patterns. In H. Manaert, Y. Iwahori, A. Mirnig, A. Ortis, C. Perez, & J. Daykin (Eds.), Proceedings of the Ninth International Conferences on Pervasive Patterns and Applications (PATTERNS 2017; pp. 65–71). Wilmington, DE, USA: IARIA XPS Press.
- Mulvenna, M., Boger, J., & Bond, R. (2017). Ethical by design. In Proceedings of the European Conference on Cognitive Ergonomics 2017 (ECCE 2017; 51–54). New York, NY, USA: ACM Press. https://doi.org/10.1145/3121283.3121300
- Musso, A. (2017, January 26). Hooked: Designing the trigger and action for engaging internal comms [Web log post]. Retrieved October 29, 2019, from https://blog.bananatag.com/internal-comms/hooked-designing-thetrigger-and-action-for-engaging-internal-comms
- Niedderer, K. (2007). Designing mindful interaction: The category of performative object. Design Issues, 23(1), 3–17. https://doi.org/10.1162/desi.2007.23.1.3
- Nielsen, J. (1994, April 24). 10 heuristics for user interface design. Retrieved February 21, 2020, from https://www.nngroup.com/articles/ten-usability-heuristics/
- Nielsen, J. (1997, January 1). The use and misuse of focus groups. Retrieved February 21, 2020, from https://www.nngroup.com/articles/focus-groups/
- Nodder, C. (2013). Evil by design: Interaction design to lead us into temptation. New York, NY, USA: John Wiley & Sons.
- Norman, D. A. (1988). The psychology of everyday things. New York, NY, USA: Basic Books. Norman, D. A. (1999). Affordance, conventions, and design. Interactions, 6(3), 38–43. https://doi.org/10.1145/301153.301168
- Norman, D. A. (2005). Emotional design: Why we love (or hate) everyday things. New York, NY, USA: Basic Books.
- Norris, N. (1997). Error, bias and validity in qualitative research. Educational Action Research, 5(1), 172–176. https://doi.org/10.1080/09650799700200020
- Orji, R., & Moffatt, K. (2018). Persuasive technology for health and wellness: State-of-the-art and emerging trends. Health Informatics Journal, 24(1), 66–91. https://doi.org/10.1177%2F1460458216650979
- Peer, E., Egelman, S., Harbach, M., Malkin, N., Mathur, A., & Frik, A. (2019, January 29). Nudge me right: Personalizing online nudges to people’s decision-making styles. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3324907
- Pink, D. H. (2011). Drive: The surprising truth about what motivates us. New York, NY, USA: Riverhead Books.
- Polit, D. F., & Beck, C. T. (2010). Generalization in quantitative and qualitative research: Myths and strategies. International Journal of Nursing Studies, 47(11), 1451–1458. https://doi.org/10.1016/j.ijnurstu.2010.06.004
- Rabiee, F. (2004). Focus-group interview and data analysis. In The Proceedings of the Nutrition Society, 63(4), 655–660. https://doi.org/10.1079/PNS2004399
- Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037//0003-066x.55.1.68
- Sengers, P., Boehner, K., David, S., & Kaye, J. J. (2005). Reflective design. In O. W. Bertelsen, N. O. Bouvin, P. G. Krogh, & M. Kyng (Eds.), Proceedings of the 4th Decennial Conference on Critical Computing: Between Sense and Sensibility (pp. 49–58). New York, NY, USA: ACM Press. https://doi.org/10.1145/1094562.1094569
- Shafir, E., Simonson, I., & Tversky, A. (1993). Reason-based choice. Cognition, 49(1), 11–36. https://doi.org/10.1016/0010-0277(93)90034-S
- Shilton, K. (2013). Values levers: Building ethics into design. Science, Technology, & Human Values, 38(3), 374– 397. https://doi.org/10.1177%2F0162243912436985
- Singer, N. (2016, May 14). When websites won’t take no for an answer. Retrieved February 21, 2020, from https://www.nytimes.com/2016/05/15/technology/personaltech/when-websites-wont-take-no-for-ananswer.html?_r=0
- Sommerer, C., Jain, L. C., & Mignonneau, L. (2008). The art and science of interface and interaction design. Berlin, Germany: Springer.
- van Rymenant, M. (2008, August 1). 95 percent of brain activity is beyond our conscious awareness [Web log post]. Retrieved April 26, 2019, from http://www.simplifyinginterfaces.com/2008/08/01/95-percent-ofbrain-activity-is-beyond-our-conscious-awareness/
- Västfjäll, D., Slovic, P., Burns, W. J., Erlandsson, A., Koppel, L., Asutay, E., & Tinghög, G. (2016). The arithmetic of emotion: Integration of incidental and integral affect in judgments and decisions. Frontiers in Psychology, 7(325). https://doi.org/10.3389/fpsyg.2016.00325
- Vetenskapsrådet. (2017). Good research practice. Stockholm, Sweden: Swedish Research Council. Retrieved February 21, 2020, from https://www.vr.se/download/18.5639980c162791bbfe697882/1555334908942/Good-ResearchPractice_VR_2017.pdf
- Weinschenk, S. M. (2013). How to get people to do stuff: Master the art and science of persuasion and motivation. San Francisco, CA, USA: New Riders.
- Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Los Angeles, CA, USA: SAGE Publications.
- Zachrisson, J., Storrø, G., & Boks, C. (2012). Using a guide to select design strategies for behaviour change: Theory vs. practice. In M. Matsumoto, Y. Umeda, K. Masui, & S. Fukushige (Eds.), Design for innovative value towards a sustainable society (pp. 362–367). Dordrecht, the Netherlands: Springer. https://doi.org/10.1007/978-94-007-3010-6_70
- Zagal, J. P., Björk, S., & Lewis, C. (2013). Dark patterns in the design of games. In G. N. Yannakakis, E. Aarseth, K. Jorgensen, & J. C. Lester (Eds.), Proceedings of the 8th International Conference on the Foundations of Digital Games (pp. 39–46). Chania, Crete, Greece: Society for the Advancement of the Science of Digital Games. Retrieved February 21, 2020, from http://www.fdg2013.org/program/papers/paper06_zagal_etal.pdf