Hazard: Lacks Community Involvement#

A red diamond shaped outline (like a warning sign) with figures in the middle who have a speech bubble above their heads with a big cross through it.

Description#

This applies when technology is being produced without input from the community it is supposed to serve.

Examples#

Example 1: Research into cures for Autism generally (which are not wanted by Austistic people).

Example 2: Samaritan’s Radar app highlighted people who may be struggling to cope on Twitter, and was withdrawn following wide criticism.

Example 3: Algorithmic colonisation of Africa

Safety Precautions#

  • Be proactive in reaching out to communities, including diasporic communities. If you are not sure how to contact communities then consider whether it is possible to do your work ethically in their absence.

  • Consider how issues of power, consent and trust may be present in your interaction with the relevant communities.

  • Ask the people who the works is about if they want this kind of solution, and co-create or co-produce research with them as partners.

  • Consider where the benefit for data science work lies and ensure that communities receive benefit from this work that is desirable to them.

  • Test the effectiveness of the algorithm or technology for different marginalised groups.

  • Consider where you may inadvertently be classifying or ranking one community over another when considering whose views ‘count’ towards addressing the research problem.