SSP Forum: Michelle Lam on End-User Auditing and Model Sketching

The
Symbolic Systems Forum
presents

End-User Auditing and Model Sketching: Tools for Centering Human Values in Machine Learning Model Authoring and Evaluation

Michelle Lam
Computer Science Department

Monday, October 24, 2022
12:30-1:20 pm
Margaret Jacks Hall (Bldg. 460), Room 126

ABSTRACT:

As AI-based technology has rapidly expanded into high-impact, user-facing domains, we have observed myriad ways in which it can perpetuate harmful biases, embed problematic values, or entirely fail. In the face of these errors, we are starting to see that algorithmic fairness and explainability methods may not be sufficient fixes for technological tools that were designed incorrectly or incompletely from the start. To improve these systems, we need a shift in voice and power in technology design. In this talk, I'll share two lines of work in this vein. In the first project, End-User Auditing, we built a tool to empower individual, non-technical users to leverage their distinctive expertise and lead their own system-scale audits of machine learning models. In the second project, Model Sketching, we sought to address the problem of technical design fixation in ML by taking inspiration from sketching practices in design, which purposefully distill ideas into rough, minimal representations to explore high-level design directions. We developed a tool that enables users to interactively author functional, sketch-like versions of ML models, focusing their attention on higher-level, human-understandable concepts rather than lower-level, technical implementation details in the early stages of model development. Every individual has unique expertise built up from their interests and skills in combination with the communities and environments they inhabit—my research aims to allow users to share this expertise to raise unanticipated issues and suggest novel solutions as co-designers of algorithmic systems.

BIO:

Michelle Lam is a third-year PhD student in Computer Science at Stanford University, advised by Professors Michael Bernstein and James Landay. Working in the Human-Computer Interaction (HCI) Group, she is interested in understanding and building upon the lived experiences and contextual expertise of users as they interact with algorithmic, AI-powered systems in domains ranging from content moderation to online advertising. She is interested in exploring how everyday users can be empowered to actively reshape the design of sociotechnical systems. Michelle is supported by a Stanford Interdisciplinary Graduate Fellowship and was a Stanford HAI Graduate Fellow, Stanford Technology and Racial Equity Graduate Fellow, Brown Institute for Media Innovation Magic Grantee, and Siebel Scholar. She holds an MS and BS in Computer Science from Stanford University.