{"id":6015,"date":"2025-09-26T07:34:40","date_gmt":"2025-09-26T06:34:40","guid":{"rendered":"https:\/\/toshareproject.it\/artmakerblog\/?p=6015"},"modified":"2025-09-26T07:38:08","modified_gmt":"2025-09-26T06:38:08","slug":"how-sloppy-is-your-slop","status":"publish","type":"post","link":"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/","title":{"rendered":"How sloppy is your slop?"},"content":{"rendered":"

https:\/\/arxiv.org\/pdf\/2509.19163<\/a><\/p>\n

REFERENCES<\/p>\n

Meta AI. Introducing llama 4: Advancing multimodal intelligence, 2024. URL https:\/\/ai.
\nmeta.com\/blog\/llama-4-multimodal-intelligence\/.<\/p>\n

Anthropic. Claude 3 model card addendum. Technical report, 2024. URL https:\/\/www-cdn.
\nanthropic.com\/fed9cc193a14b84131812372d8d5857f8f304c52\/Model_
\nCard_Claude_3_Addendum.pdf. Accessed: 2024-12-30.<\/p>\n

Kyrtin Atreides and David J Kelley. Cognitive biases in natural language: Automatically detecting,
\ndifferentiating, and measuring bias in text. Cognitive Systems Research, 88:101304, 2024.
\nPayal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Ma-
\njumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et al. Ms marco: A human generated
\nmachine reading comprehension dataset. arXiv preprint arXiv:1611.09268, 2016.<\/p>\n

Deborah L Bandalos. Measurement theory and applications for the social sciences. Guilford Pub-
\nlications, 2018.<\/p>\n

Anirudh Bharadwaj, Chaitanya Malaviya, Nitish Joshi, and Mark Yatskar. Flattery, fluff, and
\nfog: Diagnosing and mitigating idiosyncratic biases in preference models. arXiv preprint
\narXiv:2506.05339, 2025.<\/p>\n

Su Lin Blodgett, Solon Barocas, Hal Daum\u00b4 e III, and Hanna Wallach. Language (technology) is
\npower: A critical survey of\u201d bias\u201d in nlp. arXiv preprint arXiv:2005.14050, 2020.
\nCati Brown, Tony Snodgrass, Susan J Kemper, Ruth Herman, and Michael A Covington. Auto-
\nmatic measurement of propositional idea density from part-of-speech tagging. Behavior research
\nmethods, 40(2):540\u2013545, 2008.<\/p>\n

Tuhin Chakrabarty, Philippe Laban, Divyansh Agarwal, Smaranda Muresan, and Chien-Sheng Wu.
\nArt or artifice? large language models and the false promise of creativity. In Proceedings of the
\n2024 CHI Conference on Human Factors in Computing Systems, pp. 1\u201334, 2024.
\nTuhin Chakrabarty, Philippe Laban, and Chien-Sheng Wu. Ai-slop to ai-polish? aligning lan-
\nguage models through edit-based writing rewards and test-time computation. arXiv preprint
\narXiv:2504.07532, 2025a.<\/p>\n

Tuhin Chakrabarty, Philippe Laban, and Chien-Sheng Wu. Can ai writing be salvaged? mitigat-
\ning idiosyncrasies and improving human-ai alignment in the writing process through edits. In
\nProceedings of the 2025 CHI Conference on Human Factors in Computing Systems, pp. 1\u201333,
\n2025b.<\/p>\n

10
\nPreprint. Under Review.
\nAaron Chatterji, Thomas Cunningham, David J Deming, Zoe Hitzig, Christopher Ong, Carl Yan
\nShan, and Kevin Wadman. How people use chatgpt. Working Paper 34255, National Bureau of
\nEconomic Research, September 2025. URL http:\/\/www.nber.org\/papers\/w34255.<\/p>\n

Charles LA Clarke and Laura Dietz. Llm-based relevance assessment still can\u2019t replace human
\nrelevance assessment. arXiv preprint arXiv:2412.17156, 2024.<\/p>\n

Edgar Dale and Jeanne S. Chall. A formula for predicting readability. Educational Research Bul-
\nletin, 27(1):11\u201328, 1948.<\/p>\n

DeepSeek-AI. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning,
\n2025. URL https:\/\/arxiv.org\/abs\/2501.12948.<\/p>\n

Aaron Fanous, Jacob Goldberg, Ank A Agarwal, Joanna Lin, Anson Zhou, Roxana Daneshjou, and
\nSanmi Koyejo. Syceval: Evaluating llm sycophancy. arXiv preprint arXiv:2502.08177, 2025.<\/p>\n

Rudolf Flesch. A new readability yardstick. Journal of Applied Psychology, 32(3):221\u2013233, 1948.
\ndoi: 10.1037\/h0057532.<\/p>\n

Sian Gooding, Lucia Lopez-Rivilla, and Edward Grefenstette. Writing as a testbed for open ended
\nagents. arXiv preprint arXiv:2503.19711, 2025.<\/p>\n

Robert Gunning. The Technique of Clear Writing. McGraw-Hill, 1952.<\/p>\n

Kunal Handa, Alex Tamkin, Miles McCain, Saffron Huang, Esin Durmus, Sarah Heck, Jared
\nMueller, Jerry Hong, Stuart Ritchie, Tim Belonax, et al. Which economic tasks are performed
\nwith ai? evidence from millions of claude conversations. arXiv preprint arXiv:2503.04761, 2025.
\nAbhimanyu Hans et al. Binoculars: Scalable detection of machine-generated text. In Proceedings
\nof the Conference on Empirical Methods in Natural Language Processing, 2024.<\/p>\n

Dirk Hovy. The enemy in your own camp: How well can we detect statistically-generated fake
\nreviews\u2013an adversarial study. In Proceedings of the 54th Annual Meeting of the Association for
\nComputational Linguistics (Volume 2: Short Papers), pp. 351\u2013356. Association for Computa-
\ntional Linguistics, 2016. doi: 10.18653\/v1\/P16-2057.<\/p>\n

Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richardson, Ahmed El-Kishky, Aiden Low, Alec
\nHelyar, Aleksander Madry, Alex Beutel, Alex Carney, et al. Openai o1 system card. arXiv
\npreprint arXiv:2412.16720, 2024.<\/p>\n

Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chap-
\nlot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier,
\nL\u00b4 elio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril,
\nThomas Wang, Timoth\u00b4 ee Lacroix, and William El Sayed. Mistral 7b, 2023. URL https:
\n\/\/arxiv.org\/abs\/2310.06825.<\/p>\n

J. Peter Kincaid, Robert P. Jr. Fishburne, Richard L. Rogers, and Brad S. Chissom. Derivation of
\nnew readability formulas (automated readability index, fog count and flesch reading ease formula)
\nfor navy enlisted personnel. Technical Report RBR-8-75, Naval Technical Training Command
\nMillington TN Research Branch, 1975.<\/p>\n

Md Tahmid Rahman Laskar, Cheng Chen, Shashi Bhushan Tn, et al. Are large language models
\nreliable judges? a study on the factuality evaluation capabilities of llms. In Proceedings of the
\nThird Workshop on Natural Language Generation, Evaluation, and Metrics (GEM), pp. 310\u2013316,
\n2023.<\/p>\n

Haitao Li, Qian Dong, Junjie Chen, Huixue Su, Yujia Zhou, Qingyao Ai, Ziyi Ye, and Yiqun
\nLiu. Llms-as-judges: a comprehensive survey on llm-based evaluation methods. arXiv preprint
\narXiv:2412.05579, 2024.<\/p>\n

Chin-Yew Lin. Rouge: A package for automatic evaluation of summaries. In Text summarization
\nbranches out, pp. 74\u201381, 2004.<\/p>\n

11
\nPreprint. Under Review.
\nYang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. G-eval: Nlg
\nevaluation using gpt-4 with better human alignment. arXiv preprint arXiv:2303.16634, 2023.<\/p>\n

Arwa Mahdawi. Ai-generated slop is slowly killing the internet, and nobody is trying to stop it.
\nThe Guardian, 8 Jan 2025. Available at: https:\/\/www.theguardian.com\/global\/
\ncommentisfree\/2025\/jan\/08\/ai-generated-slop-slowly-killing-\/
\ninternet-nobody-trying-to-stop-it (Accessed: March 25, 2025).<\/p>\n

Marian Marchal, Merel Scholman, Frances Yung, and Vera Demberg. Establishing annotation qual-
\nity in multi-label annotations. In Proceedings of the 29th international conference on computa-
\ntional linguistics, pp. 3659\u20133668, 2022.<\/p>\n

Philipp Mayring. Qualitative content analysis. Forum Qualitative Sozialforschung \/ Forum:
\nQualitative Social Research, 1(2), Jun. 2000. doi: 10.17169\/fqs-1.2.1089. URL https:
\n\/\/www.qualitative-research.net\/index.php\/fqs\/article\/view\/1089.<\/p>\n

Clara Meister, Tiago Pimentel, Patrick Haller, Lena J\u00a8 ager, Ryan Cotterell, and Roger Levy. Revisit-
\ning the uniform information density hypothesis. arXiv preprint arXiv:2109.11635, 2021.<\/p>\n

Cade Metz. A.i. search engines are better at answers than finding them. The New York
\nTimes, 11 Jun 2024. Available at: https:\/\/www.nytimes.com\/2024\/06\/11\/style\/
\nai-search-slop.html (Accessed: March 25, 2025).<\/p>\n

Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning, and Chelsea Finn. De-
\ntectgpt: Zero-shot machine-generated text detection using probability curvature. In Proceedings
\nof the International Conference on Machine Learning, 2023.<\/p>\n

Bhuvanashree Murugadoss, Christian Poelitz, Ian Drosos, Vu Le, Nick McKenna, Carina Suzana
\nNegreanu, Chris Parnin, and Advait Sarkar. Evaluating the evaluator: Measuring llms\u2019 adherence
\nto task evaluation instructions, 2024. URL https:\/\/arxiv.org\/abs\/2408.08781.<\/p>\n

Ramya Namuduri, Yating Wu, Anshun Asher Zheng, Manya Wadhwa, Greg Durrett, and
\nJunyi Jessy Li. Qudsim: Quantifying discourse similarities in llm-generated text. arXiv preprint
\narXiv:2504.09373, 2025.<\/p>\n

Team OLMo, Pete Walsh, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora, Akshita Bha-
\ngia, Yuling Gu, Shengyi Huang, Matt Jordan, Nathan Lambert, Dustin Schwenk, Oyvind Tafjord,
\nTaira Anderson, David Atkinson, Faeze Brahman, Christopher Clark, Pradeep Dasigi, Nouha
\nDziri, Michal Guerquin, Hamish Ivison, Pang Wei Koh, Jiacheng Liu, Saumya Malik, William
\nMerrill, Lester James V. Miranda, Jacob Morrison, Tyler Murray, Crystal Nam, Valentina Py-
\natkin, Aman Rangapur, Michael Schmitz, Sam Skjonsberg, David Wadden, Christopher Wilhelm,
\nMichael Wilson, Luke Zettlemoyer, Ali Farhadi, Noah A. Smith, and Hannaneh Hajishirzi. 2
\nolmo 2 furious, 2025. URL https:\/\/arxiv.org\/abs\/2501.00656.<\/p>\n

OpenAI. How people are using chatgpt. https:\/\/openai.com\/index\/
\nhow-people-are-using-chatgpt\/, September 2025. Accessed: 2025-09-17.<\/p>\n

OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Floren-
\ncia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red
\nAvila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Moham-
\nmad Bavarian, Jeff Belgum, Irwan Bello, Jake Berdine, Gabriel Bernadett-Shapiro, Christopher
\nBerner, Lenny Bogdonoff, Oleg Boiko, Madelaine Boyd, Anna-Luisa Brakman, Greg Brock-
\nman, Tim Brooks, Miles Brundage, Kevin Button, Trevor Cai, Rosie Campbell, Andrew Cann,
\nBrittany Carey, Chelsea Carlson, Rory Carmichael, Brooke Chan, Che Chang, Fotis Chantzis,
\nDerek Chen, Sully Chen, Ruby Chen, Jason Chen, Mark Chen, Ben Chess, Chester Cho, Casey
\nChu, Hyung Won Chung, Dave Cummings, Jeremiah Currier, Yunxing Dai, Cory Decareaux,
\nThomas Degry, Noah Deutsch, Damien Deville, Arka Dhar, David Dohan, Steve Dowling, Sheila
\nDunning, Adrien Ecoffet, Atty Eleti, Tyna Eloundou, David Farhi, Liam Fedus, Niko Felix,
\nSim\u00b4 on Posada Fishman, Juston Forte, Isabella Fulford, Leo Gao, Elie Georges, Christian Gib-
\nson, Vik Goel, Tarun Gogineni, Gabriel Goh, Rapha Gontijo-Lopes, Jonathan Gordon, Morgan
\nGrafstein, Scott Gray, Ryan Greene, Joshua Gross, Shixiang Shane Gu, Yufei Guo, Chris Hal-
\nlacy, Jesse Han, Jeff Harris, Yuchen He, Mike Heaton, Johannes Heidecke, Chris Hesse, Alan
\n12<\/p>\n

Preprint. Under Review.<\/p>\n

Hickey, Wade Hickey, Peter Hoeschele, Brandon Houghton, Kenny Hsu, Shengli Hu, Xin Hu,
\nJoost Huizinga, Shantanu Jain, Shawn Jain, Joanne Jang, Angela Jiang, Roger Jiang, Haozhun
\nJin, Denny Jin, Shino Jomoto, Billie Jonn, Heewoo Jun, Tomer Kaftan, \u0141ukasz Kaiser, Ali Ka-
\nmali, Ingmar Kanitscheider, Nitish Shirish Keskar, Tabarak Khan, Logan Kilpatrick, Jong Wook
\nKim, Christina Kim, Yongjik Kim, Jan Hendrik Kirchner, Jamie Kiros, Matt Knight, Daniel
\nKokotajlo, \u0141ukasz Kondraciuk, Andrew Kondrich, Aris Konstantinidis, Kyle Kosic, Gretchen
\nKrueger, Vishal Kuo, Michael Lampe, Ikai Lan, Teddy Lee, Jan Leike, Jade Leung, Daniel
\nLevy, Chak Ming Li, Rachel Lim, Molly Lin, Stephanie Lin, Mateusz Litwin, Theresa Lopez,
\nRyan Lowe, Patricia Lue, Anna Makanju, Kim Malfacini, Sam Manning, Todor Markov, Yaniv
\nMarkovski, Bianca Martin, Katie Mayer, Andrew Mayne, Bob McGrew, Scott Mayer McKinney,
\nChristine McLeavey, Paul McMillan, Jake McNeil, David Medina, Aalok Mehta, Jacob Menick,
\nLuke Metz, Andrey Mishchenko, Pamela Mishkin, Vinnie Monaco, Evan Morikawa, Daniel
\nMossing, Tong Mu, Mira Murati, Oleg Murk, David M\u00b4 ely, Ashvin Nair, Reiichiro Nakano, Ra-
\njeev Nayak, Arvind Neelakantan, Richard Ngo, Hyeonwoo Noh, Long Ouyang, Cullen O\u2019Keefe,
\nJakub Pachocki, Alex Paino, Joe Palermo, Ashley Pantuliano, Giambattista Parascandolo, Joel
\nParish, Emy Parparita, Alex Passos, Mikhail Pavlov, Andrew Peng, Adam Perelman, Filipe
\nde Avila Belbute Peres, Michael Petrov, Henrique Ponde de Oliveira Pinto, Michael, Pokorny,
\nMichelle Pokrass, Vitchyr H. Pong, Tolly Powell, Alethea Power, Boris Power, Elizabeth Proehl,
\nRaul Puri, Alec Radford, Jack Rae, Aditya Ramesh, Cameron Raymond, Francis Real, Kendra
\nRimbach, Carl Ross, Bob Rotsted, Henri Roussez, Nick Ryder, Mario Saltarelli, Ted Sanders,
\nShibani Santurkar, Girish Sastry, Heather Schmidt, David Schnurr, John Schulman, Daniel Sel-
\nsam, Kyla Sheppard, Toki Sherbakov, Jessica Shieh, Sarah Shoker, Pranav Shyam, Szymon Sidor,
\nEric Sigler, Maddie Simens, Jordan Sitkin, Katarina Slama, Ian Sohl, Benjamin Sokolowsky,
\nYang Song, Natalie Staudacher, Felipe Petroski Such, Natalie Summers, Ilya Sutskever, Jie Tang,
\nNikolas Tezak, Madeleine B. Thompson, Phil Tillet, Amin Tootoonchian, Elizabeth Tseng, Pre-
\nston Tuggle, Nick Turley, Jerry Tworek, Juan Felipe Cer\u00b4 on Uribe, Andrea Vallone, Arun Vi-
\njayvergiya, Chelsea Voss, Carroll Wainwright, Justin Jay Wang, Alvin Wang, Ben Wang, Jonathan
\nWard, Jason Wei, CJ Weinmann, Akila Welihinda, Peter Welinder, Jiayi Weng, Lilian Weng,
\nMatt Wiethoff, Dave Willner, Clemens Winter, Samuel Wolrich, Hannah Wong, Lauren Work-
\nman, Sherwin Wu, Jeff Wu, Michael Wu, Kai Xiao, Tao Xu, Sarah Yoo, Kevin Yu, Qiming
\nYuan, Wojciech Zaremba, Rowan Zellers, Chong Zhang, Marvin Zhang, Shengjia Zhao, Tianhao
\nZheng, Juntang Zhuang, William Zhuk, and Barret Zoph. Gpt-4 technical report, 2024. URL
\nhttps:\/\/arxiv.org\/abs\/2303.08774.<\/p>\n

Vishakh Padmakumar and He He. Does writing with language models reduce content diversity? In
\nProceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL),
\nToronto, Canada, 2023. Association for Computational Linguistics. URL https:\/\/arxiv.
\norg\/abs\/2309.05196.<\/p>\n

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: a method for automatic
\nevaluation of machine translation. In Proceedings of the 40th annual meeting of the Association
\nfor Computational Linguistics, pp. 311\u2013318, 2002.<\/p>\n

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language
\nmodels are unsupervised multitask learners. OpenAI blog, 1(8):9, 2019.<\/p>\n

Sanjana Ramprasad and Byron C Wallace. Do automatic factuality metrics measure factuality? a
\ncritical evaluation. arXiv preprint arXiv:2411.16638, 2024.<\/p>\n

Jenna Russell, Marzena Karpinska, and Mohit Iyyer. People who frequently use chatgpt for writing
\ntasks are accurate and robust detectors of ai-generated text. arXiv preprint arXiv:2501.15654,
\n2025.<\/p>\n

Nikita Salkar, Thomas Trikalinos, Byron Wallace, and Ani Nenkova. Self-repetition in abstractive
\nneural summarizers. In Yulan He, Heng Ji, Sujian Li, Yang Liu, and Chua-Hui Chang (eds.),
\nProceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computa-
\ntional Linguistics and the 12th International Joint Conference on Natural Language Processing
\n(Volume 2: Short Papers), pp. 341\u2013350, Online only, November 2022. Association for Compu-
\ntational Linguistics. doi: 10.18653\/v1\/2022.aacl-short.42. URL https:\/\/aclanthology.
\norg\/2022.aacl-short.42\/.<\/p>\n

13
\nPreprint. Under Review.
\nA. O. Scott. A.i. is annoying now. the future may be worse. The New York Times,
\n24 Jul 2024. Available at: https:\/\/www.nytimes.com\/2024\/07\/24\/opinion\/
\nai-annoying-future.html (Accessed: March 25, 2025).<\/p>\n

Chantal Shaib, Joe Barrow, Jiuding Sun, Alexa F Siu, Byron C Wallace, and Ani Nenkova. Stan-
\ndardizing the measurement of text diversity: A tool and a comparative analysis of scores. arXiv
\npreprint arXiv:2403.00553, 2024a.<\/p>\n

Chantal Shaib, Yanai Elazar, Junyi Jessy Li, and Byron C Wallace. Detection and measurement of
\nsyntactic templates in generated text. In Yaser Al-Onaizan, Mohit Bansal, and Yun-Nung Chen
\n(eds.), Proceedings of the 2024 Conference on Empirical Methods in Natural Language Pro-
\ncessing, pp. 6416\u20136431, Miami, Florida, USA, November 2024b. Association for Computational
\nLinguistics. doi: 10.18653\/v1\/2024.emnlp-main.368. URL https:\/\/aclanthology.org\/
\n2024.emnlp-main.368\/.<\/p>\n

Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhu-
\npatiraju, L\u00b4 eonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ram\u00b4 e, Johan Fer-
\nret, Peter Liu, Pouya Tafti, Abe Friesen, Michelle Casbon, Sabela Ramos, Ravin Kumar, Char-
\nline Le Lan, Sammy Jerome, Anton Tsitsulin, Nino Vieillard, Piotr Stanczyk, Sertan Girgin,
\nNikola Momchev, Matt Hoffman, Shantanu Thakoor, Jean-Bastien Grill, Behnam Neyshabur,
\nOlivier Bachem, Alanna Walton, Aliaksei Severyn, Alicia Parrish, Aliya Ahmad, Allen Hutchi-
\nson, Alvin Abdagic, Amanda Carl, Amy Shen, Andy Brock, Andy Coenen, Anthony Laforge,
\nAntonia Paterson, Ben Bastian, Bilal Piot, Bo Wu, Brandon Royal, Charlie Chen, Chintu Kumar,
\nChris Perry, Chris Welty, Christopher A. Choquette-Choo, Danila Sinopalnikov, David Wein-
\nberger, Dimple Vijaykumar, Dominika Rogozi\u00b4 nska, Dustin Herbison, Elisa Bandy, Emma Wang,
\nEric Noland, Erica Moreira, Evan Senter, Evgenii Eltyshev, Francesco Visin, Gabriel Rasskin,
\nGary Wei, Glenn Cameron, Gus Martins, Hadi Hashemi, Hanna Klimczak-Pluci\u00b4 nska, Harleen
\nBatra, Harsh Dhand, Ivan Nardini, Jacinda Mein, Jack Zhou, James Svensson, Jeff Stanway, Jetha
\nChan, Jin Peng Zhou, Joana Carrasqueira, Joana Iljazi, Jocelyn Becker, Joe Fernandez, Joost van
\nAmersfoort, Josh Gordon, Josh Lipschultz, Josh Newlan, Ju yeong Ji, Kareem Mohamed, Kar-
\ntikeya Badola, Kat Black, Katie Millican, Keelin McDonell, Kelvin Nguyen, Kiranbir Sodhia,
\nKish Greene, Lars Lowe Sjoesund, Lauren Usui, Laurent Sifre, Lena Heuermann, Leticia Lago,
\nLilly McNealus, Livio Baldini Soares, Logan Kilpatrick, Lucas Dixon, Luciano Martins, Machel
\nReid, Manvinder Singh, Mark Iverson, Martin G\u00a8 orner, Mat Velloso, Mateo Wirth, Matt Davidow,
\nMatt Miller, Matthew Rahtz, Matthew Watson, Meg Risdal, Mehran Kazemi, Michael Moyni-
\nhan, Ming Zhang, Minsuk Kahng, Minwoo Park, Mofi Rahman, Mohit Khatwani, Natalie Dao,
\nNenshad Bardoliwalla, Nesh Devanathan, Neta Dumai, Nilay Chauhan, Oscar Wahltinez, Pankil
\nBotarda, Parker Barnes, Paul Barham, Paul Michel, Pengchong Jin, Petko Georgiev, Phil Culli-
\nton, Pradeep Kuppala, Ramona Comanescu, Ramona Merhej, Reena Jana, Reza Ardeshir Rokni,
\nRishabh Agarwal, Ryan Mullins, Samaneh Saadat, Sara Mc Carthy, Sarah Cogan, Sarah Perrin,
\nS\u00b4 ebastien M. R. Arnold, Sebastian Krause, Shengyang Dai, Shruti Garg, Shruti Sheth, Sue Ron-
\nstrom, Susan Chan, Timothy Jordan, Ting Yu, Tom Eccles, Tom Hennigan, Tomas Kocisky, Tulsee
\nDoshi, Vihan Jain, Vikas Yadav, Vilobh Meshram, Vishal Dharmadhikari, Warren Barkley, Wei
\nWei, Wenming Ye, Woohyun Han, Woosuk Kwon, Xiang Xu, Zhe Shen, Zhitao Gong, Zichuan
\nWei, Victor Cotruta, Phoebe Kirk, Anand Rao, Minh Giang, Ludovic Peran, Tris Warkentin, Eli
\nCollins, Joelle Barral, Zoubin Ghahramani, Raia Hadsell, D. Sculley, Jeanine Banks, Anca Dra-
\ngan, Slav Petrov, Oriol Vinyals, Jeff Dean, Demis Hassabis, Koray Kavukcuoglu, Clement Fara-
\nbet, Elena Buchatskaya, Sebastian Borgeaud, Noah Fiedel, Armand Joulin, Kathleen Kenealy,
\nRobert Dadashi, and Alek Andreev. Gemma 2: Improving open language models at a practical
\nsize, 2024. URL https:\/\/arxiv.org\/abs\/2408.00118.<\/p>\n

Guy Tevet and Jonathan Berant. Evaluating the evaluation of diversity in natural language genera-
\ntion. arXiv preprint arXiv:2004.02990, 2020.<\/p>\n

Kiran Tomlinson, Sonia Jaffe, Will Wang, Scott Counts, and Siddharth Suri. Working with ai:
\nMeasuring the occupational implications of generative ai. arXiv preprint arXiv:2507.07935, 2025.
\nJanyce Wiebe, Theresa Wilson, Rebecca Bruce, Matthew Bell, and Melanie Martin. Learning sub-
\njective language. Computational Linguistics, 30(3):277\u2013308, 09 2004. ISSN 0891-2017. doi:
\n10.1162\/0891201041850885. URL https:\/\/doi.org\/10.1162\/0891201041850885.<\/p>\n

14
\nPreprint. Under Review.
\nHaoyan Yang, Yixuan Wang, Xingyin Xu, Hanyuan Zhang, and Yirong Bian. Can we trust
\nllms? mitigate overconfidence bias in llms through knowledge transfer. arXiv preprint
\narXiv:2405.16856, 2024.<\/p>\n

Yusen Zhang, Sarkar Snigdha Sarathi Das, and Rui Zhang. Verbosity \u0338= veracity: Demystify ver-
\nbosity compensation behavior of large language models, 2024. URL https:\/\/arxiv.org\/
\nabs\/2411.07858.
\nLianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang,
\nZi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al. Judging llm-as-a-judge with mt-bench and
\nchatbot arena. Advances in neural information processing systems, 36:46595\u201346623, 2023<\/p>\n","protected":false},"excerpt":{"rendered":"

https:\/\/arxiv.org\/pdf\/2509.19163 REFERENCES Meta AI. Introducing llama 4: Advancing multimodal intelligence, 2024. URL https:\/\/ai. meta.com\/blog\/llama-4-multimodal-intelligence\/. Anthropic. Claude 3 model card addendum. Technical report, 2024. URL https:\/\/www-cdn. anthropic.com\/fed9cc193a14b84131812372d8d5857f8f304c52\/Model_ Card_Claude_3_Addendum.pdf. Accessed: 2024-12-30. Kyrtin Atreides and David J Kelley. Cognitive biases in natural language: Automatically detecting, differentiating, and measuring bias in text. Cognitive Systems Research, 88:101304, 2024. Payal Bajaj, […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-6015","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"yoast_head":"\nHow sloppy is your slop? | Artmaker Blog<\/title>\n<meta name=\"description\" content=\"How sloppy is your slop? | Artmaker Blog\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How sloppy is your slop? | Artmaker Blog\" \/>\n<meta property=\"og:description\" content=\"How sloppy is your slop? | Artmaker Blog\" \/>\n<meta property=\"og:url\" content=\"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/\" \/>\n<meta property=\"og:site_name\" content=\"Artmaker Blog\" \/>\n<meta property=\"article:published_time\" content=\"2025-09-26T06:34:40+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-09-26T06:38:08+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bruce Sterling\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"13 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/\",\"name\":\"Artmaker Blog\",\"description\":\"on Toshareproject.it - curated by Bruce Sterling\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/#webpage\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/\",\"name\":\"How sloppy is your slop? | Artmaker Blog\",\"isPartOf\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\"},\"datePublished\":\"2025-09-26T06:34:40+00:00\",\"dateModified\":\"2025-09-26T06:38:08+00:00\",\"author\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\"},\"description\":\"How sloppy is your slop? | Artmaker Blog\",\"breadcrumb\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/toshareproject.it\/artmakerblog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How sloppy is your slop?\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\",\"name\":\"Bruce Sterling\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#personlogo\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"caption\":\"Bruce Sterling\"},\"description\":\"Art director at Share Festival, author and journalist\",\"sameAs\":[\"http:\/\/toshareproject.it\/tomorrowart\"],\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How sloppy is your slop? | Artmaker Blog","description":"How sloppy is your slop? | Artmaker Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/","og_locale":"en_GB","og_type":"article","og_title":"How sloppy is your slop? | Artmaker Blog","og_description":"How sloppy is your slop? | Artmaker Blog","og_url":"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/","og_site_name":"Artmaker Blog","article_published_time":"2025-09-26T06:34:40+00:00","article_modified_time":"2025-09-26T06:38:08+00:00","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bruce Sterling","Estimated reading time":"13 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/toshareproject.it\/artmakerblog\/#website","url":"https:\/\/toshareproject.it\/artmakerblog\/","name":"Artmaker Blog","description":"on Toshareproject.it - curated by Bruce Sterling","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/#webpage","url":"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/","name":"How sloppy is your slop? | Artmaker Blog","isPartOf":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#website"},"datePublished":"2025-09-26T06:34:40+00:00","dateModified":"2025-09-26T06:38:08+00:00","author":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085"},"description":"How sloppy is your slop? | Artmaker Blog","breadcrumb":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/toshareproject.it\/artmakerblog\/how-sloppy-is-your-slop\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/toshareproject.it\/artmakerblog\/"},{"@type":"ListItem","position":2,"name":"How sloppy is your slop?"}]},{"@type":"Person","@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085","name":"Bruce Sterling","image":{"@type":"ImageObject","@id":"https:\/\/toshareproject.it\/artmakerblog\/#personlogo","inLanguage":"en-GB","url":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","caption":"Bruce Sterling"},"description":"Art director at Share Festival, author and journalist","sameAs":["http:\/\/toshareproject.it\/tomorrowart"],"url":"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/"}]}},"_links":{"self":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/6015","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/comments?post=6015"}],"version-history":[{"count":2,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/6015\/revisions"}],"predecessor-version":[{"id":6017,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/6015\/revisions\/6017"}],"wp:attachment":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/media?parent=6015"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/categories?post=6015"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/tags?post=6015"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}