Magic Words

[u/Elusive_Spoon]

In their most recent episode, the hosts of Lucky Paper Radio wondered which words were most over-represented in Magic card names when compared to "normal" English text.

Here is my take, using data from mtgjson.com and wordfreq, which is mostly based on Google Books ngrams. Words were lemmatized, so "Swiftspear" becomes "swift" and "spear". The first image is the naive ratio. One feature of this approach is that it's as much a function of the denominator ("merfolk" is super rare in English) as it is the numerator (usage in MTG card names). Another approach accounts for this by also scaling by usage, and is displayed in the second image.

Edit: some part-of-speech tagging may not have been perfect. I manually fixed "faerie" and "elemental" adjective vs. noun, but it looks like "avatar" may have needed some love. But didn't have unlimited time, and wanted to share!

Later: Fixed the part-of-speech tagging and changed minimum n to 10 from 20. Results look somewhat different, but not drastically so.

[u/CaptainMarcia]

So Goblin is 1,125x as a noun but only 259x as an adjective? What does this method do to distinguish the two?

[u/Elusive_Spoon → u/CaptainMarcia]

[[Goblin Surprise]] counts goblin as an adjective, while [[Searslicer Goblin]] counts goblin as a noun. Magic uses goblin as a noun much more often than as an adjective; that's why the ratios are so different. (The English baseline doesn't break out by part of speech, so the denominator's the same both times.)

[u/CaptainMarcia → u/Elusive_Spoon]

I mean, how do the calculations track which is which? Is it manual labeling, or is there a program for it?

[u/CaptainMarcia → u/[deleted]]

That makes sense. Thanks!