How do we build relatable machine learning models that regular people can understand? This is a presentation about how design principles apply to the development of machine learning systems. Too often in data science, machine learning software is not built with regular people who will interact with it in mind.
I argue that in order to make machine learning software relatable, we need to use design thinking to intentionally build in mechanisms for users to form their own mental models of how the machine learning software works. Failing to include theses helps cultivate the common sense that machine learning is a black box for users.
I gave three different versions of this talk at Quant UX Con on June 8th, 2022, the Royal Institute of Anthropology’s annual conference on June 10th, 2022, and Google’s AI + Design Tooling Research Symposium on August 5th, 2022.
I hope you find it interesting and feel free to share any thoughts you might have.
Thank you for the conference and talk organizers for making this happen, and I appreciate all the insightful conversations I had about the role of design thinking in building relatable machine learning.
This is a follow-up on my previous article about the difference between anthropology and ethnography. In this article, I discuss recent trends within anthropology to either revitalize ethnography and/or rethink its status as the primary research methodology within the discipline.
We anthropologists should consider expanding beyond the ethnographic toolkit. That could involve redefining what it means to conduct ethnography in such a way that includes other types of practices outside of the traditional ethnographic toolkit and/or rethinking the role of ethnography as our primary methodology.
For context, ethnography has been the primary tool within the discipline for the last several decades. I would define ethnography as a methodological approach that seeks to holistically understand and express the lived experiences of those in a particular sociocultural context(s) (see this article and this paper). Ethnography conventionally entails a specific set of qualitative methodologies that help to understand and analyze these lived experiences, including participant observation, interviews, qualitative coding, and so on. Anthropologists and other ethnographers have built this set of practices because they are excellent at capturing people’s lived experiences, and I agree that they are powerful for that.
I do not, however, believe that these are the only potential ways to do that. For me, ethnography is an orientation, an approach that seeks to make sense of the social world by focusing on the lived experiences of others, not necessarily some collection of qualitative methods. Seeing ethnography as an orientation, for example, would enable ethnographers to use data science and machine learning tools within ethnographies (see this and this).
My perspective here exemplifies the first way some anthropologists have sought to expand beyond the traditional ethnographic toolkit: by redefining ethnography. For us, viewing ethnography as a specific set of qualitative research techniques pigeonholes what ethnography can be. Although these techniques are powerful and useful, their exclusive deployment within anthropology stifles what ethnography can become.
Other anthropologists will seek to expand beyond this toolkit by advocating for non-ethnographic anthropological research. For them, anthropologists should cultivate other research practices in addition to or sometimes instead of ethnography. I am passionate about applying this specifically to data science and machine learning, and Morten Axel Pedersen is a counterpart to me who in this specific area. He thinks anthropologists should move beyond ethnographic research, which could include incorporating data science and machine learning research (see his talk as an example). Similar to me, he wants to see more utilization of data science and machine learning within anthropology, but he presents this as an alternative to doing ethnographic research not as a potential part of ethnographic research like I do.
The difference between the two approaches is subtle: the first advocates for reimaging ethnography and the second for reimagining anthropology and anthropological research while potentially keeping ethnography the same. On a practical level, though, they are not that different. Not only are they not mutually exclusive: one can seek to redefine ethnography and ethnography’s hold within anthropology. But they each also have their place in seeking when encouraging the expansion of the anthropological toolkit. In some situations, the promotion of redefining ethnography beyond its traditional qualitative practices is most beneficial, and other times, advocating for non-ethnographic forms of research would be.
For my second interview in the Interview Series, I interviewed Schaun Wheeler. Schaun is co-founder of Aampe, a startup that embeds an active learning system into mobile apps to turn push notifications into part of the app’s user interface. Before he co-founded Aampe, Schaun was the data science lead for the award-winning Consumer Graph intelligence product at Valassis, a U.S. ad-tech firm. And before that he founded and directed the data science team at Success Academy Charter Schools in New York City. Then before that, Schaun was one of the first people to champion the use of statistical inference to understand massive unstructured data at the United States Department of the Army. Schaun has a Ph.D. in Cultural Anthropology from the University of Connecticut.
If the audio does not play on your computer, you can download it here:
On July 8th, 2021, I presented virtually at the Congress of Anthropologists and Ethnologists of Russia in Tomsk, Siberia, organized by Association of Anthropologists and Ethnologists of Russia. My talk was titled “Integrating Anthropology and Data Science,” which I presented as part of its subcommittee for applied and business anthropology. I discussed the unique opportunities integrating data science could provide anthropologists and potential strategies for how to integrate the two disciplines.
Loading…
Reload document 
Open in new tab 
