{"id":7498,"date":"2023-08-02T10:50:25","date_gmt":"2023-08-02T15:50:25","guid":{"rendered":"https:\/\/blog.lib.uiowa.edu\/studio\/?p=7498"},"modified":"2023-08-07T15:59:43","modified_gmt":"2023-08-07T20:59:43","slug":"data-mining-for-medieval-messengers-part-2","status":"publish","type":"post","link":"https:\/\/blog.lib.uiowa.edu\/studio\/2023\/08\/02\/data-mining-for-medieval-messengers-part-2\/","title":{"rendered":"[Data] Mining For Medieval Messengers: Part 2"},"content":{"rendered":"\n<p>Coming into the Summer Fellowship, the aspect of my project that I was most worried about was the coding. While I am fairly functional, if not precisely fluent, with most technologies, delving beneath the surface level into the murky chasms of coding was a scary step to take. As I sit here reflecting upon my experience summer, my adventures with code were both the most satisfying part of the project and the most enjoyable part of the project. Much of the early portions of the summer were spent getting comfortable with the Python coding language. Working with my studio contact, Nikki White, allowed me to establish a strong basal knowledge of coding languages, which I then supplemented with various tutorials from online sources such as Linked-In Learning and The Code Academy. Whenever I got particularly stuck while writing a script, I quickly learned to do what all great coders do: I turned to Google. The website Stack Overflow, a veritable online coding community, usually had the answers I was looking for\u2014perhaps the most important thing I\u2019ve learned about coding is that no matter what you\u2019re trying to do, somebody else has tried to do the same thing at some point, failed miserably, and eventually worked out a solution (which they\u2019ve then shared online). Given that we are entering the Artificial Intelligence Epoch, I also occasionally, in moments of great weakness, turned towards Chat GPT for help. Intriguingly, Chat GPT is a formidable tutor. I was able to share scripts that I had written with the AI, and it would kindly point out what I had done wrong and explain what I needed to fix to make the script function in the way I had intended. A brave new world indeed.<\/p>\n\n\n\n<p>The major hurdle I needed to clear while working on this project was the massive amounts of data cleaning and data entry required to prepare my data for textual analysis. This process has taken up the majority of the second half of the summer. Despite the monotony of this portion, I was able to expedite some of the data collection processes by putting my newly acquired coding skills to good use. I wrote Python scripts to parse the xml files of medieval texts I\u2019d collected for the projects and extract useful metadata for the creation of the index I\u2019ve made to power my textual analysis queries. This parsing process wasn\u2019t without its own set of difficulties, however. The text files were in several different xml formats, which required several different scripts to parse them\u2014and, in some cases, there were large quantities of texts which I had to parse on my own by opening the xml files and searching for metadata such as \u201ctitle\u201d and \u201cdate,\u201d then manually inserting that metadata into my spreadsheet. This was a particularly onerous task, as a large portion of the texts had titles and introductions in German. As I write this, I am just entering the phase of the project where I am finally able to start performing textual analysis on my dataset. This is exciting, and I hope that I will be able to provide you with an update of my success in the video which accompanies this post. Thank you for reading.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Studio Fellowship Video\" width=\"750\" height=\"563\" src=\"https:\/\/www.youtube.com\/embed\/71uqC0-Bhik?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Coming into the Summer Fellowship, the aspect of my project that I was most worried about was the coding. While I am fairly functional, if not precisely fluent, with most technologies, delving beneath the surface level into the murky chasms of coding was a scary step to take. As I sit here reflecting upon my<a class=\"more-link\" href=\"https:\/\/blog.lib.uiowa.edu\/studio\/2023\/08\/02\/data-mining-for-medieval-messengers-part-2\/\">Continue reading <span class=\"screen-reader-text\">&#8220;[Data] Mining For Medieval Messengers: Part 2&#8221;<\/span><\/a><\/p>\n","protected":false},"author":338,"featured_media":7380,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32],"tags":[],"syndication":[21],"_links":{"self":[{"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/posts\/7498"}],"collection":[{"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/users\/338"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/comments?post=7498"}],"version-history":[{"count":2,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/posts\/7498\/revisions"}],"predecessor-version":[{"id":7513,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/posts\/7498\/revisions\/7513"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/media\/7380"}],"wp:attachment":[{"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/media?parent=7498"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/categories?post=7498"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/tags?post=7498"},{"taxonomy":"syndication","embeddable":true,"href":"https:\/\/blog.lib.uiowa.edu\/studio\/wp-json\/wp\/v2\/syndication?post=7498"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}