The problem of bias in the evaluation of pop culture works created with artificial intelligence. A comparative analysis of the Eurovision Song Contest and AI Song Contest (2020-2022)

Authors

  • Oliwia Szeląg Uniwersytet im. Adama Mickiewicza w Poznaniu

DOI:

https://doi.org/10.51480/compress.2023.6-1.532

Keywords:

artificial intelligence, AI Song Contest, Eurovision Song Contest, bias, televoting, online voting

Abstract

The author of this article examines ways to minimize bias in the evaluation of songs created using artificial intelligence using the AI Song Contest as an example. She compares the voting procedures between the AI Song Contest and the Eurovision Song Contest and formulates a hypothesis that both contests have similar voting mechanisms and introduce mechanisms to reduce bias. However, the solutions used by AI Song Contest organizers seeking to reduce the impact of bias on the voting outcome are more effective. This is due to the use of more advanced technological barriers. The study was conducted using process tracing and qualitative content analysis methods and covered the first three editions of the AI Song Contest from 2020 to 2022. The research process asked the following research questions: 1) What similarities, in terms of organizing the winner selection procedure, and what differences exist between the AI Song Contest and the Eurovision Song Contest? 2) How do the organizers of the AI Song Contest seek to reduce the impact of biased behavior in the voting procedure? Based on these questions, a research process was conducted that positively verified the hypothesis. Comparative research provides insights into how to increase impartiality in the evaluation of musical works, through the use of technological solutions.

References

A Eurovision song created by Artificial Intelligence: Blue Jeans and Bloody Tears (2019), https://www.youtube.com/watch?v=4MKAf6YX_7M (30.01.2023).

About: History (2021), https://www.aisongcontest.com/history (30.01.2023).

AI Song Contest 2021 Award Ceremony (2021), https://www.youtube.com/watch?v=6AAJ07F_bH0 (20.01.2023).

AI Song Contest 2022 Award Ceremony (2022), https://www.youtube.com/watch?v=XKxDbW99zL8&t=25s (20.01.2023).

AI Song Contest livestream (2020), https://www.youtube.com/watch?v=-yIu5VLZj5g (30.01.2023).

Algorithm Generates Ultimate Eurovision Song (2019), https://www.calcalistech.com/ctech/articles/0,7340,L-3762110,00.html (30.01.2023).

Australia zwycięzcą konkursu Eurowizji dla sztucznej inteligencji (2020), https://geex.x-kom.pl/wiadomosci/australia-zwyciezca-konkursu-eurowizji-dla-sztucznej-inteligencji/ 31.01.2022.

Break Free Official Music Video – Composed with AI | Lyrics by Taryn Southern (2017), https://www.youtube.com/watch?v=XUs6CznN8pw (20.03.2023).

Burgoyne J. A., Koops H. V. (2021). We are Not Groupies⋯ We are Band Aids’: Assessment Reliability in the AI Song Contest. Transactions of the International Society for Music Information Retrieval, 4(1), 236–247.

Caramiaux B., Lotte F., Geurts J. (2019). AI in the media and creative industries, New European Media, Version 1, April 2019.

Daly S. J., Papageorgiou K. (2021). Innovating with creative machines: On creative AI, trust and human-machine collaborations, ISPIM Conference Proceedings; Manchester.

Eurovision 2020 To Be Co-Produced By AVROTROS, NPO And NOS (2019), https://eurovoix.com/2019/05/19/eurovision-2020-to-be-co-produced-by-avrotros-npo-and-nos/ (30.01.2023).

Eurovision 2022: EBU limits contest to maximum of 44 competing countries (2021), https://wiwibloggs.com/2021/09/05/eurovision-2022-ebu-limits-contest-to-maximum-of-44-competing-countries/266533/, 20.12.2022.

Eurovision Song Contest 2021 – Grand Final (2022), https://www.youtube.com/watch?v=msfdz_aksY8&t=7345s (30.01.2023).

Eurovision Song Contest 2022 – Grand Final (2022), https://www.youtube.com/watch?v=VhyLh5sGRRI (30.01.2023).

FAQs, 2022 https://www.aisongcontest.com/faqs (20.01.2023).

Fricker K., Gluhovic M. (ed.) (2013). Performing the ‘new’ Europe. Identities, feelings, and politics in the Eurovision Song Contest, Houndmills: Palgrave Macmillan.

Gatherer D. (2006), Comparison of Eurovision Song Contest simulation with actual results reveals shifting patterns of collusive voting alliances. Journal of Artificial Societies and Social Simulation, 9 (2), ISSN 1460 – 7425.

Gruia L., Bibu N., Roja A. (2020), Digital transformation generates a new business paradigm, Human-made in the age of artificial intelligence, 443-452.

Hancock, J. T., Naaman, M., Levy, K. (2020). AI-Mediated Communication: Definition, Research Agenda, and Ethical Considerations., Journal of Computer-Mediated Communication, Volume 25, Issue 1, January 2020, 89–100.

Hermann, E. (2022). Artificial intelligence and mass personalization of communication content—An ethical and literacy perspective. New media & society, 24(5), 1258-1277.

How it works (2021), https://eurovision.tv/about/how-it-works (20.01.2023)

Hu N. (2022). AI and Creativity, Harvard Data Science Review, Issue 4.1, Winter 2022. Doi: 10.1162/99608f92.2c5ec0ca

Jewell C. (2021). Uncanny Valley: Charting a new era of musical creativity. Information and Digital Outreach Division, WIPO Magazine No. 3, Oct 2021, 16-21.

Joost N. Kok, Egbert J. W. Boers, Walter A. Kosters, and Peter van der Putten (2002). Artificial Intelligence: Definition, Trends, Techniques and Cases, Knowledge for sustainable development: an insight into the Encyclopedia of life support systems, v. 1 pp. 1095-1107.

Jury 2022 (2022), https://www.aisongcontest.com/2022-jury (20.01.2023).

Kang, E. J., Kim, H., Kim, H., & Kim, J. (2022). When AI Meets the K-Pop culture: A case study of fans’ perception of AI Private Call. AI Cultures. A NeurIPS 2022 Workshop (20.01.2023).

McCarthy J., Minsky M.L., Rochester N., Shannon C.E. (2006). A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, Original from August 31, 1955, reprint in AI Magazine, vol. 27 (4).

Micchi G., Bigo L., Giraud M., Groult R., Levé F. (2021). I Keep Counting: An Experiment in Human/AI Co-creative Songwriting. Transactions of the International Society for Music Information Retrieval (TISMIR), 4 (1), 263-275.

Ochoa A., Hernández A., Sánchez J., Muñoz-Zavala A., Ponce J. (2008). Determining the ranking of a new participant in Eurovision using Cultural Algorithms and Data Mining, 18th International Conference on Electronics, Communications and Computers.

Participants 2022 (2022), https://www.aisongcontest.com/participants-2022 (20.01.2023).

Raykoff I. (2021). Another Song for Europe Music, Taste, and Values in the Eurovision Song Contest, Routledge, 52 Vanderbilt Avenue, New York.

Różanowski K. (2007). Sztuczna Inteligencja: Rozwój, szanse i zagrożenia, Zeszyty Naukowe Warszawskiej Wyższej Szkoły Informatyki, 2/2/2007 ss. 109-135.

Spierdujk L., Vellekoop M. (2008). The structure of bias in peer voting systems: lessons from the Eurovision Song Contest. Empirical Economics Volume 36, 403-425.

Tuan, I.H. (2020). Robot Theatre and AI Films. In: Pop with Gods, Shakespeare, and AI. Palgrave Macmillan, Singapore. https://doi.org/10.1007/978-981-15-7297-5_9.

Vankka J., Kumpulainen I., Praks E., Korhonrn T., Ni A., Rissanen V. (2020). Predicting Eurovision Song Contest Results Using Sentiment Analysis, Artificial Intelligence and Natural Language, Proceedings 87-108.

Veelgestelde vragen: Welke rol speelt de NPO als organisatie binnen het Nederlandse omroepbestel? (2012), https://web.archive.org/web/20130405125104/http://help.publiekeomroep.nl/faqs/welke-rol-speelt-de-npo-als-organisatie-binnen-het-nederlandse-omroepbestel (20.01.2023).

Voting changes 2023 – FAQ (2022), https://eurovision.tv/voting-changes-2023-faq, (24.12.2022).

Voting systems in Eurovision history (2017), https://eurovisionworld.com/esc/voting – systems-in-eurovision-history (20.01.2023).

What is Wallifornia ? (2023), https://walliforniamusictech.com/about/ (20.01.2023).

When AI takes on Eurovision: Can a computer write a hit song? (2020), https://arstechnica.com/gaming/2020/05/when-ai-takes-on-eurovision-can-a-computer-write-a-hit-song/ (20.01.2023).

Yair G., Maman D. (1996). The Persistent Structure of Hegemony in the Eurovision Song Contest, Acta Sociologica. Volume 39, Issue 3, 309-325.

Published

2023-08-03

How to Cite

Szeląg, O. (2023). The problem of bias in the evaluation of pop culture works created with artificial intelligence. A comparative analysis of the Eurovision Song Contest and AI Song Contest (2020-2022). Com.Press, 6(1), 100-117. https://doi.org/10.51480/compress.2023.6-1.532