I spent the last few days alternating between reading, thinking, and muddling around with NDQ using Claude Code. About 50% of my time involves cleaning up the data so that I can do more sophisticated analysis with this text. To get a sense for what I’ve been working on, check out the post on Tuesday.
One of the oddities that I encountered with the first analysis was The Bellman clustered by itself with little overlap with any of the other contemporary magazines in the corpus (NDQ, the two NDSHS journals, DeLestry’s Western Magazine, and The Midland). Interrogating this further, I discovered that it represented a larger problem. Apparently the model I was running was only reading part of the text (the first 2000 or so words) to create the model. This was not acceptable and a good reminder to verify then trust.
To address this, we devised a plan to break the entire 20 million word corpus into around 100k, 200 word segments and to perform a BERT analysis on all of these segments. As part of these we also continued to remove stray text — such as headings— that exerted a surprising influence over the analysis. It looks like this is going to be an ongoing problem moving forward because it crops up from time to time, but continued efforts will mitigate it over time. In any event, once we implemented this new method, The Bellman was brought back into the fold and our BERT topics became a bit more clear. The UMAP scatter looks a good bit different from what the analyses that I produced on Tuesday appeared.

The Bellman is reintegrated into the model and in some ways parallels the diversity of North Dakota Quarterly across the entire scatter sharing space with both The Midland (and my impulsive inclusion of some of Hamlin Garland’s work in dark and light orange) and the NDSHS journals (in pink).
The next step was to model similarities across the magazines and here I faced a new challenge. The Bellman and NDQ had a whopping 55% overlap and The Bellman and The Midland has a 66% overlap! This seemed exceptionally large and defied what I know of the two magazines.

What we discovered is that the Bellman represents nearly half of the total corpus of 200 word segments. As a result, it is statistically more likely to have similar topics with all magazines owing largely to its numerical preponderance.To compensate for this we developed a “Chance-adjusted lift” that compensated for numerical prevalence of The Bellman (and the small number of 200-word chunks from, say, The Midland). This would temper the prevalence of The Bellman and boost similarities between Garland and The Midland which show clear topical affinities.

This is all well and good, but it assumes a kind of regional affinity as opposed to constructs it. (Ideally, I would include a non-regional magazine here to demonstrate that the connections between these publications are not simply mapping across the topics so broad that any publication might fit; this is something that a subsequent analysis would resolve). Below are the top 8 topics (including the almost random “mrs, miss, mr mrs, mr” category which speaks to The Bellman’s interest in Minneapolis society more than anything else).

It is notable that The Bellman and NDSHS publications are the most distinctive voices in terms of topics and The Midland is the least distinct. In other words, a chunk is most likely be assigned to a particular publication on the basis of topic and style. Garland is funny for his <50% level of confusion meaning his texts are less likely to be assigned to Garland than elsewhere!

Again, this still doesn’t really speak to any particular regional character (although some of the terms in the topic list do speak to this). A more focused regional analysis had to relay on certain key terms associated with these publications. These terms ranged from “frontier,” “prairie,” “pioneer” and “our region,” “our section,” to “Dakota,” “the Northwest,” and “Minnesota,” and places such as “Grand Forks” and “Minot.” This allowed us to identify explicitly regional discussions in the chunks and to characterize these discussions. One thing that I had not necessarily named was the “boosterism” that characterized DeLestry’s Western Magazine (and to a certain extent The Bellman, NDQ, and The Midland).
Most interesting is that NDQ has elements of each of these types of articles and this seems more or less stable over time and irrespective of editor and by extension genre. Later editors of NDQ included more poetry, for example, but this didn’t necessarily shift the percentages at the volume level. The parallels between the character of publications in NDQ and their topics (in the chart above) shows just how eclectic NDQ was and how its various elements had parallels with other contemporary regional magazines while mimicking none of them.

The final analysis that I worked on this week was understanding how certain kind of sentimental language present in elegiac and personal memoirs (which so frequently characterize regional narratives [i.e. the experience of the region]) suffuses other discourses from boosterism to antiquarian and even scientific and literary (which here is literary criticism) works. I developed this by looking at how the more elegiac passages talked about the region. Then I looked across the more ostensibly prosaic expressions of regional identity to determine whether this vocabulary appeared when discussing pioneers, the frontier, our section or individual places. Unremarkably, some of this language did appear in more prosaic passages: especially in the boosterish and promotional texts and more obviously (and self-referentially) in the elegiac-personal memoir texts. On the other hand, it is unsurprising that scientific and technical texts would not indulge in sentimental language other than, perhaps, in a critical and demythologizing vein. It is perhaps a bit more interesting that articles interested in imagining the nation through abstract concepts (race, “the country,” or census data) sough to demythologize the some of the conventional sentiments around the frontier, the pioneer, or the prairie. Pieces with literary and aesthetic concerns (e.g. namely reviews, but not exclusively), recognize the picturesque and romantic as characteristic of much of the sentimental literature that it reviews.

This analysis was based on 1200 pieces (there is a challenge with the text of The Bellman and DeLestry’s Western Magazine that they can’t alway be aggregated into articles). The next step, of course, is for me to go through these passages and assess and even refine these categories.
The goal of this analysis wasn’t to replace a careful reading of these magazines, but to help navigate the over 20 million words of text captured in these issues. In particular, I was interested in discerning how the region not only manifests in these issues, but also how these periodicals constructed the region. The next steps in this process is to clean up the archive of python scripts, texts, and analyses. Then, subject it all to a critical eye. And finally, return to my history of NDQ and determine how and whether this supports my analysis.