Running on Cargo
UA-28929209-1
NEWS
PUBLICATIONS + PRESENTATIONS
RESEARCH EXPERIENCE
Elizabeth Anne Watkins, PhD
Elizabeth is a Research Scientist in the Social Science of AI at Intel Labs.

She can be reached at Elizabeth.Watkins[at]Intel.com

She analyzes intelligent systems at the intersection of HCI methods and FATE topics. This means that she researches AI, work, and governance using a sociotechnical lens, analyzing how people use, navigate around, and are harmed by intelligent systems in the real world. Her training is in human-computer interaction, STS, usable security, and organizational sociology. She's also an affiliate with the AI on the Ground group at the Data & Society Research Institute. Before Intel she held a a Postdoctoral Fellowship at the Center for Information Technology Policy and the Human-Computer Interaction group at Princeton. She's worked, consulted, and collaborated with research centers across academia and industry including the Princeton Visual AI Lab, Parity.AI, Perceptive Automata, Harvard Business School, MIT, and Google. Her research has been featured in WIRED, MIT Technology Review, and Harvard Business Review, and she's provided input on artificial intelligence policy to the Mayor's office of New York City, the White House Office for Science and Technology Policy, Canadian Parliament, and to the UN.

Recent Work

April 2024: Paper accepted to FAccT! Details coming soon.

March 2024: Humbled to join the New York City Office of Technology and Innovation AI Advisory Network.

June 2023: I was honored to join the folks at the MIT Sloan Management Review podcast, "Me Myself and AI" to talk about my research at Intel, working with multimodal AI systems in manufacturing and building new approaches to data annotation:

April 2023: Two papers accepted to FAccT!

"Humans, AI, and Context: Understanding End-Users’ Trust in a Real-World Computer Vision Application" co-authored with Sunnie Kim (Sunnie was again the wonderful lead author on this work!), Olga Russakovsky, Ruth Fong, and Andrés Monroy-Hernandez.

"Taking Algorithms to Courts: A Relational Approach to Algorithmic Accountability" co-authored with my beloved Data & Society family: Ranjit Singh, Manny Moss, Emnet Taffese, and Jake Metcalf.

March 2023: "Help Me Help the AI’’: Understanding How Explainability Can Support Human-AI Interaction" has been awarded an Honorable Mention award at CHI!

February 2023: "Face Work: A Human-Centered Investigation into Facial Verification in Gig Work" has been accepted to CSCW 2023!

January 2023: "Help Me Help the AI’’: Understanding How Explainability Can Support Human-AI Interaction" has been accepted to CHI 2023! Co-authored with Sunnie Kim (Sunnie was the wonderful lead author on this work!), Olga Russakovsky, Ruth Fong, and Andrés Monroy-Hernandez!

May 2022: Come join our CHI 2022 workshop on Human-Centered Explainable AI! Totally virtual to accommodate a wide and diverse audience. More info here!

April 2022: Lots of news!

Provided testimony on facial recognition before an Information, Privacy and Ethics committee of the Canadian parliament: video here.

Spoke on a panel at the Brookings Institute on Operationalizing Responsible AI: video here.

Paper co-authored with my CITP colleague Amy Winecoff accepted to the 2022 Conference on AI, Ethics, and Society! "Artificial Concepts of Artificial Intelligence: Institutional Compliance and Resistance in AI Startups." Preprint here.

September 2021: gave a talk at Princeton CITP on my work on facial verification, more info here.

June 2021: New report out now! Co-authored as part of the AI on the Ground team at the Data & Society Research Institute, alongside a dream team of Manny Moss, Jake Metcalf, Ranjit Singh, and Madeleine C. Elish:



Thrilled to share that the report I co-authored with Madeleine C. Elish (Senior Scientist at Google) has been released by the Data & Society Research Institute:


Covered in MIT Technology Review:


Thoughts and reviews:



About

Dr. Watkins was trained as an organizational ethnographer at Columbia University, and conducts interviews, digital ethnography, and surveys to study how people interpret, use, and talk about algorithms in their jobs. Her broad interest is in how organizational structures shape how people create and share knowledge about algorithmic systems. Her dissertation examined how gig workers negotiate facial recognition, and she has presented her research at conferences including Algorithmic Fairness, Accountability, and Transparency (FAccT), ACM Computer-Human Interaction (CHI), ACM Computer Supported Cooperative Work (CSCW), security conference USENIX, and the annual meetings of the International Communications Association (ICA), the International Sociological Association (ISA), and the Society for the Social Studies of Science (4S). She recently received the Best Paper Award at the workshop on Transparency and Explanation in Smart Systems (TExSS), for her work, "The Tension Between Information Justice and Security: Perceptions of Facial Recognition Targeting,"

In addition to her work as a Postdoctoral Fellow at Princeton, she works as a researcher at the Data & Society Research Institute in the AI on the Ground research track, where she uses empirical methods to study emergent issues around artificial intelligence. Her research illuminates how the introduction of AI into sociotechnical systems produces novel kinds of human labor and unforeseen risks. She’s also a Research Associate at the Tow Center for Digital Journalism at Columbia, a member of the Center on Organizational Innovation at Columbia, a member of the Future of Work and Organizations interest group at NYU Stern, and a member of the Work in the Age of Intelligent Machines Research Coordination Network. She holds a BA from the University of California at Irvine and a Master of Science from the MIT School of Architecture + Planning. Before starting her doctorate she worked for several years as a researcher at Harvard Business School. Her case studies published by Harvard Business School Publishing have been taught at HBS, the Yale School of Management, and the MIT Sloan School of Management.

She also works as a knowledge broker, publishing and lecturing on academically informed but accessible work for general audiences, practitioners, and decision-makers. Recent projects include a handbook, Guide to Advertising Technology (Tow Center for Digital Journalism 2018), and a book chapter co-authored with Chris Anderson in Managing Media Innovation (Routledge 2019). She's lectured on her cybersecurity research for the interest group Disaster Resilience International. Her work has been featured in MIT Technology Review, WIRED, the Markup, and Harvard Business Review and cited in Innovation Equity: Assessing and Managing the Monetary Value of New Products (University of Chicago Press 2016), and Social Media: Enduring Principles (Oxford University Press 2016). Her articles and white papers have been included on "Must Read" lists by the Harvard Nieman Lab, the Pew Center for Research, POLITICO, the European Media Centre, and the American Press Institute.

She also writes for the NYC art collective American Cyborg about animals, machines, and metaphors. She lives with her husband Joe and their cats Pie and Frank in New York.

News

Hello visitors! Here is where I can share some bits of news:

[March 3] Three papers soon to be published! In New Media and Society, the Conference on Algorithmic Fairness, Accountability, and Transparency (FAccT), and the Workshop on Transparency and Explanation in Smart Systems (TExSS).

[December 1] Excited to announce I'll be working with an absolutely stellar team to put together a workshop at CHI 2021, "This Seems to Work: Designing Systems with the Algorithmic Imaginations of Those Who Labor." More details coming ASAP!

[November 30] New project! Invited to join the AI IRL session at Mozfest! Working with a data scientist from the World Bank to put together a template for communities to produce their own case studies of AI implementation. Aiming to equip communities in the Global South and non-Western contexts with the tools to produce their own data to be used in development and governance.

[November 15] Gratified to be invited to join the Expert Consultant Roundtable 3C on Artificial Intelligence at the UN.

[October 22] In September I presented work at UC Berkeley's Center for Long-Term Cybersecurity Symposium, Data Rights, Privacy, and Security in AI. This week they published a Medium post describing the workshop, here.

[August 7] I'll be at CSCW 2020! Part of the doctoral consortium and presenting a poster on my dissertation research. Late October.

[August 5] The AOM symposium is up! "Artificially Intelligent Futures: Technology, the Changing Nature of Work, and Organizing” with Kevin Lee, and Sarah Pels, and discussant Beth Bechky! Viewable here.

[May 20] Myself and my team at Data & Society, AI on the Ground, have a new preprint up on SSRN, "Governing with Algorithmic Impact Assessments: Six Observations." Full paper here.

[April 8] I'll be at the Academy of Management annual meeting this year (in whatever form it takes), co-organizer of the symposium, “Artificially Intelligent Futures: Technology, the Changing Nature of Work, and Organizing” with Kate Kellogg, Kevin Lee, and Sarah Pels, and discussant Beth Bechky

[March 2] Thrilled to share I'll be visiting UC Berkeley this September to participate in the Center for Long-Term Cybersecurity workshop “Data rights, shared value, and re-defining ‘privacy’ and ‘security’ with AI/ML and emerging technologies”

[February 28] Psyched to be part of the upcoming Human Centered Approaches to Fair and Responsible AI workshop at CHI 2020!* (Due to COVID-19 will be a virtual workshop.)

[November 30] I'll be part of the Doctoral Consortium at the ACM Fairness, Accountability, and Transparency conference in Barcelona in 2020

[November 19] I'll be presenting my dissertation work alongside two fellow scholars-in-training (both stellar thinkers and sweet folks!) Kevin Lee and Sarah Lebovitz, today at NYU Stern.

[October 18] I co-authored another piece for the Data & Society blog, Points. Our post is called, "Resilient AI Systems: Safety and Security in the Future of AI."

[September 4] In New Orleans for the annual meeting pf 4S, the Society for the Social Studies of Science! Giving two presentations:

""You Could Get Shot Pulling Over to Take Picture Where I Work": Facial Recognition in Gig Work."

(with Madeleine C. Elish) "What’s in a Number?: Integrating Machine Learning into a Clinical Context."

[August 31] Delighted to be leading a workshop, "Beyond FAT: Questions for Facial Recognition Beyond Fairness, Accountability, and Transparency" at the Citizen Lab Summer Institute at the University of Toronto!

[August 14] Today I'm presenting my research to the "Work in the Age of Intelligent Machines Coordination Network" at their conference, "At the Boundary: Exploring Human-AI Futures in Context"

[June 27] Happy to share that a paper I wrote with two amazing thinkers from Data & Society will be part of the USENIX 2019 workshop, Free and Open Communication on the Internet. You can check it out here.

[May 30] Psyched to be stepping in for Data & Society Research Director Sareeta Amrute, giving a talk at the Global Business Anthropology Summit in NYC.

[May 15] Data & Society publishes a blog called Points. Here, scholars distill their research into easy-to-read short essays. They have published a piece I co-authored with Madeleine C. Elish, "When Humans Attack: Re-thinking safety, security, and AI."

[May 1] A book chapter I co-authored with C.W. Anderson has been published! The chapter, "Managing journalistic innovation and source security in the age of the weaponized internet" is in the book Media Management and Digital Transformation, published by Routledge.

[January 30] Thrilled to share I'm joining Data & Society's AI on the Ground Initiative with an incredible team of researchers. Details here.

[December 10] Praise for Guide to Advertising!











[December 5] Thrilled that the Columbia Journalism Review and Tow Center for Digital Journalism have published my report, "Guide to Advertising Technology," a pragmatic guide to the nuts and bolts of ad tech. Read it here.

[November 26] Today I'm presenting my dissertation proposal, "Information Security Practices in the Future of Work" at the Columbia Science, Knowledge, and Technology workshop. Details here.

[November 4] This Tuesday I'll be presenting a paper I co-authored with my amazing collaborators, Susan McGregor and Kelly Caine, at the Conference on Computer-Supported Cooperative Work and Social Computing. Conference details at http://cscw.acm.org/2018/, paper details at https://confer.csail.mit.edu/cscw2018/paper#!9091

[October 17] I'll be speaking at the New School's Journalism and Design department, on the panel Broken By Design: The Perils And Possibilities Of Digital Advertising. More info here

[September 21] Thrilled to share that I'll be working with folks at the Data & Society Institute, a non-profit research institute focused on the cultural dimensions of data-driven technology. supporting their Intelligence & Autonomy Initiative. The aim of the project to reframe debates about the rise of AI and reposition the value of human intelligence in the design, deployment, and evaluation of AI-driven systems.

[July 26] My work with David Stark, on how the platform economy challenges organizational theory, has been published in the Italian journal Sociologica. Very humbling to be on the same table of contents as Paul DiMaggio, Andy Abbott, and Lucy Suchman, among myriad others.

[April 5] Psyched to be working with Data & Society on an upcoming workshop. Details forthcoming!

[Jan 18] I'm on a panel, "Journalistic Security and Networked Press Freedom: Historical, Regional, and Organizational Perspectives," that has been selected for the 68th Annual ICA conference to be held in Prague, Czech Republic, 24-28 May 2018.

[Jan 17] My work at Enigma 2018 with collaborator Kendra Albert was covered in Gizmodo, The Register, Parallax, on the Canadian Broadcasting Corporation, and in an episode of the podcast, Internet Law and Policy Foundry.

[December 1] I'm a co-organizer on a workshop, "Sensemaking in a Senseless World" that's been accepted to CHI 2018, in Montréal, Canada, 21-26 April 2018.

[November 11] My work with David Stark, "The Möbius Organizational Form. Make, Buy, Cooperate ... or Co-Opt? " has been accepted as an oral presentation to the session "Disappearing Organization? Reshaping the Sociology of Organizations (Part 2)" at the ISA World Congress of Sociology to be held in Toronto, 15-21 July 2018.

[October 1] I'm a co-author on a paper, "Would You Slack That? The Impact of Security and Privacy on Cooperative Newsroom Work" that's been accepted to CSCW 2018, in Jersey City New York, 3-7 November 2018.

[August 30] I'm a co-author on a talk that's been accepted to Enigma 2018: Security and Privacy Ideas that Matter. My co-author Kendra Albert will be presenting our work, "Precarious Security: Understanding Cultural Changes of the Gig Economy."

[June 22] Awesome! I'll be presenting a paper on which I was lead author, “Creative and Set in Their Ways: Challenges of Security Sensemaking in Newsrooms” at the 7th USENIX Workshop on Free and Open Communications on the Internet, colocated with USENIX '17.

[May 11] Hooray! Happy to share a paper I coauthored, "When the Weakest Link is Strong: Secure Collaboration in the Case of the Panama Papers" has been accepted to the 26th USENIX Security Symposium (USENIX Security '17), to take place in Vancouver in August.

[April 14] Happy to share I've had a proposal accepted to the annual meeting of the Society for the Social Studies of Science! Will be presenting my work there in August.

[April 5] New workshop! Together with a team of brilliant international scholars, I'll be organizing a workshop called Crowds at Risk: Exploitation, Creative Destruction, and the Unintended Effects of Crowdsourcing, for the European Conference on Computer Supported Cooperative Work.

[February 1] Excited that I'll continue my work with Dr. David Stark this summer, and have received a research grant from the Columbia Institute for Social and Economic Research and Policy.

[October 27] Absolutely delighted to share that I've been invited to join Columbia's Center on Organizational Innovation, and will be sharing ideas with some of the most brilliant organizational scholars in the world.

[October 15] Happy to share I'll be presenting my work at the 2016 International Conference on Collaboration Technologies and Systems, first in an invited talk for a session on Security and Privacy in Collaboration Technologies and Systems, and second in a panel on Social Networks and Information Security.

[August 24] New gig! Fall 2016 I'll be a Teaching Assistant for David Stark's class Organizing Innovation at Columbia.

[July 22] Received a travel award at the Privacy Enhancing Technologies Symposium in Darmstadt, Germany, to pitch a proposal for upcoming work on human factors in networked security within newsrooms.

[June 28] Over the past two years I provided editorial and design support for a book by Dr. Eugene Soltes at Harvard Business School. Why They Do It: Inside the Mind of the White-Collar Criminal will be published this October by Public Affairs, and is available for pre-order on Amazon.

[February 1] I'll be presenting two papers this spring:

One co-written with David Stark on the executive function and crowd labor at Reddit, at a workshop at the Association for Computing Machinery 2016 Computer-Human Interaction Conference.

The second co-written with Susan McGregor, former director of data visualization at the Wall Street Journal, on the mental models of information security held by journalists, to be presented at the 2016 International Symposium on Online Journalism.

[January 1] Happy to share two bits of news:

First, I've joined the Tow Center for Digital Journalism's NSF-funded study of communication security tools for journalists.

Second, I've been accepted to the Brown Institute for Media Innovation's Base Camp, meaning I'll be visiting Stanford very soon to collaborate with engineers on innovative projects in media.

[October 1] A case study I co-authored was recently published by Harvard Business Publishing.



[September 1] A case study I co-authored was recently featured in Harvard Business Review.



[July 1] A multimedia case study I co-authored was recently published by Harvard Business Publishing.

PUBLICATIONS + PRESENTATIONS
Peer-reviewed published proceedings

Elizabeth Anne Watkins. "Face Work: A Human-Centered Investigation into Facial Verification in Gig Work." CSCW 2023.

Sunnie Kim, Elizabeth Anne Watkins, Olga Russakovsky, Ruth Fong, and Andrés Monroy-Hernandez. "Humans, AI, and Context: Understanding End-Users’ Trust in a Real-World Computer Vision Application." FAccT 2023.

Ranjit Singh, Manny Moss, Emnet Taffese, Elizabeth Anne Watkins, Jake Metcalf. "Taking Algorithms to Courts: A Relational Approach to Algorithmic Accountability." FAccT 2023.

Sunnie Kim, Elizabeth Anne Watkins, Olga Russakovsky, Ruth Fong, and Andrés Monroy-Hernandez. "Help Me Help the AI’’: Understanding How Explainability Can Support Human-AI Interaction." CHI 2023.
🥇 HONORABLE MENTION AWARD

Amy Winecoff and Elizabeth Anne Watkins. “Artificial Concepts of Artificial Intelligence: Institutional Compliance and Resistance in AI Startups.” AIES 2022.

Elizabeth Anne Watkins. "The Tension Between Information Justice and Security: Perceptions of Facial Recognition Targeting." Joint Proceedings of the ACM IUI 2021 Workshops.
🥇 BEST PAPER AWARD
PDF

Elizabeth Anne Watkins, Emanuel Moss, Jacob Metcalf, Ranjit Singh, and Madeleine Clare Elish. "Governing Algorithmic Systems with Impact Assessments: Six Observations." AIES 2021.
PDF (Paper)
PDF (Poster)
Presentation (Slideslive Video)

Jacob Metcalf, Emanuel Moss, Elizabeth Anne Watkins, Ranjit Singh, and Madeleine Clare Elish. "Algorithmic Impact Assessments and Accountability: The Co-construction of Impacts." FAccT 2021.
PDF

Elizabeth Anne Watkins. "Took a Pic and Got Declined, Vexed and Perplexed: Facial Recognition in Algorithmic Management." CSCW 2020 Companion.
PDF

Gabrielle Lim, Elizabeth Anne Watkins, and Matt Goerzen. "Entanglements and Exploits: Sociotechnical Security as an Analytic Framework." USENIX Workshop on Free and Open Communications on the Internet (FOCI) 2019
PDF

Susan E. McGregor, Elizabeth Anne Watkins, and Kelly Caine. "Would You Slack That?: The Impact of Security and Privacy on Cooperative Newsroom Work." CSCW 2018
PDF

Elizabeth Anne Watkins, Mahdi Nasrullah Al-Ameen, Franzi Roesner, Kelly Caine, and Susan E. McGregor. “Creative and Set in Their Ways: Challenges of Security Sensemaking in Newsrooms” USENIX Workshop on Free and Open Communications on the Internet (FOCI) 2017
PDF

Susan E. McGregor, Elizabeth Anne Watkins, Mahdi Nasrullah Al-Ameen, Kelly Caine, and Franzi Roesner. “When the Weakest Link is Strong: Secure Collaboration in the Case of the Panama Papers" 26th USENIX Security Symposium 2017
PDF

Elizabeth Anne Watkins, Franzi Roesner, Susan E. McGregor, Byron Lowens, Kelly Caine, Mahdi Nasrullah Al-Ameen. "Sensemaking and Storytelling: Network Security Strategies for Collaborative Groups." 2016 IEEE International Conference on Collaboration Technologies and Systems 2016
PDF

Susan E. McGregor and Elizabeth Anne Watkins. “Security by Obscurity: Journalists’ Mental Models of Information Security." International Symposium for Online Journalism 2016
PDF

Workshops Organized

“Human-centered Explainable AI (HCXAI): Beyond Opening the Black-Box of AI.” Upol Ehsan, Philipp Wintersberger, Q. Vera Liao, Elizabeth Anne Watkins, Martina Mara, Marc Streit, Carina Manger, Andreas Riener, Hal Daumé, and Mark O. Riedl. CHI, 2022
PDF

Lindsey Cameron, Angele Christin, Michael Ann DeVito, Tiwanna Dillahunt, Madeleine Elish, Mary Gray, Noopur Raval, Rida Qadri, Melissa Valentine, and Elizabeth Anne Watkins. "This Seems to Work: Designing Technological Systems with The Algorithmic Imaginations of Those Who Labor." CHI 2021.
PDF

Daniel M. Russell, Gregorio Convertino, Aniket Kittur, Peter Pirolli, Elizabeth Anne Watkins. "Sensemaking in a Senseless World: 2018 Workshop Abstract." CHI 2018
PDF

Peer-reviewed Journal Articles and Accepted Manuscripts

Elizabeth Anne Watkins. “Have You Learned Your Lesson?” Ride-hailing Workers, Scams, and Communities of Practice." new media and society. publication date tbd.

Kevin Woojin Lee and Elizabeth Anne Watkins. From Performativity to Performances: Reconsidering Platforms’ Production of the Future of Work, Organizing, and Society. Sociologica, 14(3), 205-215. 2021.
PDF

Elizabeth Anne Watkins and David Stark. “The Mobius Organization: Make, Buy, Cooperate ... or Co­-Opt?” Sociologica, 12(1), 65-80. 2018.
PDF

Conference presentations (non-proceedings)

Emanuel Moss, Ranjit Singh, Elizabeth Anne Watkins, and Jacob Metcalf. The Society Machine: Methods, Ethics, Policy, and the Mutual Shaping of AI and Society. Rabb Symposium on Embedding AI in Society. 2021.

Elizabeth Anne Watkins. "The “Crooked Set Up”: Algorithmic Fairness and the Organizational Citizen." Human Centered Approaches to Fair and Responsible AI workshop. CHI 2020

Elizabeth Anne Watkins. ACM Conference on Fairness, Accountability, and Transparency
(ACM FAccT) Doctoral Consortium, 2020

Kevin Lee, Sarah Pels, and Elizabeth Anne Watkins. “Artificially Intelligent Futures: Technology, the Changing Nature of Work, and Organizing.” Academy of Management (AOM) Annual Meeting 2020

Elizabeth Anne Watkins. ""You Could Get Shot Pulling Over to Take Picture Where I Work": Facial Recognition in Gig Work." Annual Meeting of the Society for the Social Studies of Science (4S), New Orleans, 2019

Madeleine C. Elish and Elizabeth Anne Watkins. "What’s in a Number?: Integrating Machine Learning into a Clinical Context." Annual Meeting of the Society for the Social Studies of Science (4S), New Orleans, 2019

Elizabeth Anne Watkins. “Beyond FAT: Questions for Facial Recognition Beyond Fairness, Accountability, and Transparency.” Citizen Lab Summer Institute. Univ. of Toronto, 2019.

Elizabeth Anne Watkins and David Stark. “The Mobius Organization: Make, Buy, Cooperate ... or Co­-Opt?” XIX ISA World Congress of Sociology 2018

Mahdi Nasrullah Al-Ameen, Elizabeth Anne Watkins, Byron Lowens, Franzi Roesner, Susan E. McGregor, and Kelly Caine. "Evaluating Online Security Training for Journalists Through the Lens of Learning Science." Computation + Journalism Symposium 2017

Elizabeth Anne Watkins. “The Double-Edged Affordance of the Time-Tax: Rethinking the Design and Generativity of Data Privacy Controls” Annual Meeting of the Society for the Social Studies of Science (4S) 2017

Invited Talks

Elizabeth Anne Watkins. “Such a Dangerous New Feature": Assessing the Harms of Computer Vision as Account Verification in Gig Work.” Information Society Project at Yale Law School and the Yale/Wikimedia Initiative on Intermediaries AI Governance Symposium, 2021

Elizabeth Anne Watkins. Cornell Tech Reading Group, 2021.

Elizabeth Anne Watkins. “In the Pre-Evening Light it Sees So Little”: A Human-Centered, Qualitative Investigation into Computer Vision as Account Verification in Gig Work.” Princeton CITP, 2021

Elizabeth Anne Watkins. "Putting a Face to the Name: Facial Recognition as Algorithmic Management." Work in the Age of Intelligent Machines Convergence Conference 2019: At the Boundary: Exploring Human-AI Futures in Context. New York, 2019

Elizabeth Anne Watkins. “It’s Like Being in the Future” versus “It’s a Joke”: Implementation of Facial Recognition in the Workplace.” AI in Organizations: Three dissertation projects. NYU Stern Future of Work Group. New York, 2019.

Reports, Book Chapters, White Papers, and Preprints

Madeleine Clare Elish and Elizabeth Anne Watkins. Repairing Innovation: A Study of Integrating AI in Clinical Care (New York: Data & Society Research Institute, 2020)
PDF

Elizabeth Anne Watkins and Chris Anderson. "Managing Journalistic Innovation and Source Security in the Age of the Weaponized Internet." Managing Media Innovation. Routledge, 2019

Elizabeth Anne Watkins. Guide to Advertising Technology. Tow Center for Digital Journalism, 2018

Press and Blog Posts

Elizabeth Anne Watkins and Madeleine Clare Elish. “Resilient AI Systems: Safety and Security in the
Future of AI.” Data & Society blog Points, 2019

Elizabeth Hansen and Elizabeth Watkins. "News media needs to convince readers to open their wallets. Consolidation has not helped." Columbia Journalism Review, 2019

M.C. Elish and Elizabeth Anne Watkins. "When Humans Attack: Re-thinking Safety, Security, and AI." Data & Society blog Points. May 2019.

Elizabeth Anne Watkins. "Journalists are rightly suspicious of ad tech. They also depend on it." Columbia Journalism Review, 2018

Case studies

Montgomery, Cynthia A., James Weber, and Elizabeth Anne Watkins. "The On-Demand Economy." Harvard Business School Technical Note 716-405, September 2015.

Teixeira, Thales, and Elizabeth Anne Watkins. "Building an e-Commerce Brand at Wayfair." Harvard Business School Case 516-028, August 2015.

Teixeira, Thales S., and Elizabeth Anne Watkins. "The Coca-Cola Company's Case for Creative Transformation." Harvard Business School Multimedia/Video Case 815-714, June 2015.

Teixeira, Thales, and Elizabeth Anne Watkins. "Showrooming at Best Buy." Harvard Business School Case 515-019, August 2014. (Revised December 2015.)

Teixeira, Thales, and Elizabeth Anne Watkins. "Freemium Pricing at Dropbox." Harvard Business School Case 514-053, November 2013. (Revised November 2014.)
RESEARCH EXPERIENCE
Intel Labs
Intelligent Systems Research
Research Scientist in the Social Science of AI
August 2022 - present

Princeton Center for Information Technology Policy and Human-Computer Interaction Group
Postdoctoral Research Fellow, dual appointment
January 2021 - July 2022
Contributing to the future of artificial intelligence, with a focus on using empirical insights to discern principles for human-centered design and governance.

Data & Society Research Institute, AI on the Ground Initiative
Research Analyst
Sept 2018 - August 2020
Research Affiliate
August 2020 - present
Supported the AI on the Ground Initiative, which focuses on the development, use, and assessment of AI by the people who shape new AI systems and policies. Centering social science research, our goal is to develop robust analyses of AI systems that can effectively inform design, use, and governance.

Tow Center for Digital Journalism at Columbia University
Research Associate
December 2015 - August 2018
Researched and co-wrote academic papers on the communication and knowledge-management practices of journalists, with an applied goal of impacting the future of information security technology. Conducted qualitative research including structured interviews, survey design, and grounded-theory-based coding. Funded by the National Science Foundation.

Harvard Business School
Research Associate to Dr. Eugene Soltes
July 2014 - January 2019
Researched and wrote material for a book on the history of corporate fraud. Why They Do It: Inside the Mind of the White-Collar Criminal will be published this October by Public Affairs, and is available on Amazon.
Research Associate to Dr. Thales Teixeira
August 2013 - June 2015
Researched and co-wrote case studies and teaching notes. Analyzed library sources, industry reports, and viewer and consumer behavioral data from numerous market research sources.

MIT Program in Comparative Media Studies
Hyperstudio Research Fellow
2013 - present
Coordinator of a semi-weekly seminar series with a group of researchers, affiliates, and post-docs. Founder of the Hyperstudio Fellows blog, a collaborative collection of relevant links and events.

Harvard metaLAB
Research Fellow
2012 - 13
Founder of the metaCATALOGUE: an open, generative prototype of a networked, tagged, participatory online catalogue.

Berkman Klein Center for internet + Society, Internet Monitor Project
Research Assistant
July - September 2013
Contributed research in international legislation + corporate interests in Internet Governance for the publication "Reflections on a Digital World."