THREATS OF NEW AND EXISTING TECHNOLOGIES
The emergence of generative AI tools has made headlines in recent months, highlighting the
threats that they and existing technologies pose to human rights, particularly the rights of those
most marginalized in society. States have not taken sufficient steps to rein in the global trade in
spyware or the surveillance-based business model of the biggest technology companies,
known as Big Tech.
RISKS OF ARTIFICIAL INTELLIGENCE
The launch in 2023 of ChatGPT-4, a tool which can synthesize and generate text, has drawn
attention to how generative AI will transform people’s working lives, their access to government
services and their experience of internet platforms more generally. Like any new technology,
generative AI may create opportunities but, without adequate and effective regulation, may
also exacerbate risks to human rights in areas such as access to welfare, education and
employment, labour rights, privacy and online safety. Risks include the reinforcement of racial
and other inequalities, increased surveillance and the amplification of hate content online.16
Existing AI systems, among other technologies, have already amplified inequality and hurt
marginalized communities in areas such as access to state services, policing, security and
migration.17 In Serbia, the new semi-automated social welfare system, funded by the World
Bank, resulted in possibly thousands of people losing access to vital social assistance and
disproportionally affected Roma and people with disabilities. Israel’s use of facial recognition
technology in the Occupied Palestinian Territories has reinforced restrictions on freedom of
movement and helped maintain the system of apartheid. The New York Police Department
revealed in 2023 how it used the technology to subject Black Lives Matter protests in the city
to surveillance, but pressure mounted on the New York City Council to ban it. Meanwhile,
venture capital firms investing in new technologies have often failed in their responsibility to
respect human rights.18
GLOBAL SPYWARE TRADE
States have failed to rein in the global trade in spyware. Research by Amnesty International in
2023 helped uncover the use of Pegasus spyware against journalists and civil society in
Armenia, the Dominican Republic, India and Serbia. A major investigation on the Predator
Files by the European Investigative Collaborations, in partnership with Amnesty International,
uncovered how “EU-based and regulated” spyware has been freely sold to states all over the
world.19 In the aftermath of these revelations, the European Parliament adopted a resolution in
November 2023 criticizing the lack of action to curb abuses by the spyware industry. This built
on other signs that some policymakers are beginning to act, including a statement from 11
states in March 2023 that recognized the threats spyware presents to human rights.
ABUSES BY BIG TECH
The harms of Big Tech’s surveillance-based business model were laid bare again in 2023, not
only in the context of armed conflict, but also in how they undermine the rights of children and
other young people. TikTok’s content recommender system and invasive data collection
practices pose a danger to young users of the platform by amplifying depressive and suicidal
content that carry the risk of worsening existing mental health challenges.20 There has also
been an alarming surge in incitement against LGBTI people on X (formerly Twitter).21 The
proliferation of political mis- and disinformation is likely to increase, an especially grave risk
given the large number of elections taking place in 2024. Repressive political forces in many
parts of the world have weaponized social media to attack minorities and pit communities
against one another in an effort to bolster their chances of electoral success. Such efforts are
22
The State of the World’s Human Rights
Select target paragraph3
Connect to a paragraph
Connect to an entity
Disable highlights
Add to table of contents