Ethics, stories,
and curiosity
Session 14
PMAP 8521: Program evaluation
Andrew Young School of Policy Studies
Plan for today
Plan for today
What did we just learn?
Plan for today
What did we just learn?
Ethics of data analytics
Plan for today
What did we just learn?
Ethics of data analytics
Ethics of storytelling
Plan for today
What did we just learn?
Ethics of data analytics
Ethics of storytelling
Curiosity
What did we just learn?
Main takeaways
Main takeaways
Don't be afraid of causal language!
Main takeaways
Don't be afraid of causal language!
With careful use of DAGs
and special research designs,
you can make causal claims
Ethics of data analytics
Powerful tools
Powerful tools
R is an incredibly valuable skill
Powerful tools
R is an incredibly valuable skill
Causal inference is an incredibly valuable skill
Powerful tools
R is an incredibly valuable skill
Causal inference is an incredibly valuable skill
These tools can be used to improve the world!
Powerful tools
R is an incredibly valuable skill
Causal inference is an incredibly valuable skill
These tools can be used to improve the world!
And potentially harm it
Possible pitfalls
Possible pitfalls
Manipulation
Don't coerce people
Possible pitfalls
Manipulation
Don't coerce people
Bias
There's no such thing as objective data or models
Possible pitfalls
Manipulation
Don't coerce people
Bias
There's no such thing as objective data or models
Accidental evil
Don't let stupidity transform into evil
Manipulation
It's not all dystopian!
What makes the social score
and the crisis score
ethically different?
Or are they the same thing?
Avoid manipulation
Avoid manipulation
Think about people
Avoid manipulation
Think about people
Think about autonomy
Avoid manipulation
Think about people
Think about autonomy
Don't rely 100% on data!
Bias
Avoid bias
Avoid bias
Make sure your sample is representative
Avoid bias
Make sure your sample is representative
Think about theory
Avoid bias
Make sure your sample is representative
Think about theory
Remember that NO data,
models, or algorithms are neutral
Fight the algorithms
Very feebly, but still…
Fight the algorithms
Very feebly, but still…
Incognito / private windows
Fight the algorithms
Very feebly, but still…
Incognito / private windows
adsettings.google.com
Accidental(?) evil
Ethics of storytelling
Stories as art
Stories are an art form for
translating core, essential content
to different forms
for specific audiences.
Every story is the same
Will Schoder, "Every Story is the Same", https://www.youtube.com/watch?v=LuD2Aa0zFiA
Heroes
https://commons.wikimedia.org/wiki/File:Heroesjourney.svg
5:35 from Will Schoder, "Every Story is the Same", https://www.youtube.com/watch?v=LuD2Aa0zFiA
You are not the hero
Should you tell stories though?
Should you tell stories though?
Possible pitfalls
Possible pitfalls
Manipulation
Don't lie or manipulate data
Possible pitfalls
Manipulation
Don't lie or manipulate data
Misinterpretation
Temper expectations
Possible pitfalls
Manipulation
Don't lie or manipulate data
Misinterpretation
Temper expectations
Equity
Don't dumb down
Amplify underrepresented voices
Manipulation
Manipulation
Manipulation
Don't lie
Manipulation
Don't lie
Emphasize the story,
but make full data available
Misrepresentation
10,000 hours
"the magic number
of greatness"
10,000 hours
"the magic number
of greatness"
“[A] popularized but simplistic view of our work, which suggests that anyone who has accumulated sufficient number of hours of practice in a given domain will automatically become an expert and a champion.”
“[A] popularized but simplistic view of our work, which suggests that anyone who has accumulated sufficient number of hours of practice in a given domain will automatically become an expert and a champion.”
10,000 is average • Quality matters • There are other factors
Misinterpretation
Misinterpretation
Be narrative, but not too narrative
Misinterpretation
Be narrative, but not too narrative
Temper expectations
Equity
Dumbing down vs. translation
Wired, "Neuroscientist Explains One Concept in 5 Levels of Difficulty", https://www.youtube.com/watch?v=opqIa5Jiwuw
Alvin Stone, "The arrogance of 'dumbing it down'"
Translation
“…the task of the translator consists in finding that intended effect upon the language into which he is translating which produces in it the echo of the original”
Walter Benjamin,
The Task of the Translator
Women engineers publish their papers in journals with higher impact factors than their male peers, but their work receives lower recognition (fewer citations) from the scientific community
Equity
Equity
Don't dumb down your findings
Equity
Don't dumb down your findings
You are a translator
Equity
Don't dumb down your findings
You are a translator
Treat audience with respect
Equity
Don't dumb down your findings
You are a translator
Treat audience with respect
Amplify underrepresented voices
Curiosity
How do I keep learning R?
What class should I take next?
What book should I read next?
How do I keep learning R?
What class should I take next?
What book should I read next?
How do I keep learning R?
What class should I take next?
What book should I read next?
Be curious!
Teaching yourself
Two secrets to master R
Two secrets to master R
1: Find excuses to use it
Two secrets to master R
1: Find excuses to use it
2: Share and work in public
Find excuses to use R
Playing with R
Playing with R
Little exploration projects
Playing with R
Little exploration projects
#TidyTuesday
Playing with R
Little exploration projects
#TidyTuesday
Data play time
Playing with R
Little exploration projects
#TidyTuesday
Data play time
Actual projects
Radical transparency
and public work
How we normally think of our work and goals
How we should think of our work and goals
Benefits of working in public
Benefits of working in public
Build reputation
Benefits of working in public
Build reputation
Learn more
Benefits of working in public
Build reputation
Learn more
Grow the community
Benefits of working in public
Build reputation
Learn more
Grow the community
Early feedback on ideas
Benefits of working in public
Build reputation
Learn more
Grow the community
Early feedback on ideas
Validation
How to work in public
How to work in public
Tweet, blog, and meet people
How to work in public
Tweet, blog, and meet people
Play with data in public
How to work in public
Tweet, blog, and meet people
Play with data in public
Teach concepts (for yourself too!)
Communities
Communities
#rstats
Communities
#rstats
R User Groups
Communities
#rstats
R User Groups
#rladies
Communities
#rstats
R User Groups
#rladies
Rmd websites, blogdown, bookdown
Play with data in public
Teach a concept
