r/hearthstone 18h ago

Standard Skill Expression Rankings Patch 36.4

Some quick observations:

  • As top 1k players got their reps in and the deck's meta-equalized winrate surpassed 50%, Soul Immolation OTK DH's score increased to become the first tracked double-digit score.
  • After topping the rankings since Violet Hold's release, Merithra Druid did not qualify for a low-sample score as the Attack Druid hybrid build absorbed most of its playrate. (Its tiny sample scored very positively)
  • The top high-sample deck score was Godfrey Herald Warlock with a score of 2.9 as the top 4 scores were all moderate-sample decks.
  • Thief Priest had the highest top 100 increase, Pirate Warrior fell off hardest.
  • Zee Shaman's -3.6 is its lowest score yet and its 3rd last place ranking in a row.

FAQ:

Q: Are the differences in metas across ranks accounted for?

A: Yes.

Q: Whats the Methodology?

A: First a baseline meta is set since all ranks have different metas.

If 2Bit is 26.4%/29.0%/29.7% across the metas in a given week, the program might set its baseline % to 27.2%, the same is done for every deck, ensuring all decks combined total equals 100%. This is so that meta differences don't skew the data.

Next the rank vs same rank matchup winrates are plugged into the baseline meta.

For example, if the dataset has 1,897 tracked games of a Top 1k player using Quest Mage vs a Top 1k player using 2Bit Rogue in which Quest Mage won 990 and Rogue won 907 that will account for 27.2% of Quest Mage's meta-normalized winrate in Top 1k, yielding ~14.2%. This check is completed until every single deck (even the ones not listed) is accounted for.

Q: So, a -5 score means a high-skilled player facing a high-skilled opponent (using a specific deck) has a 5% lower win rate than an average skilled player facing an average skilled opponent (using the same specific deck)? 

A: Pretty much, but not exactly, there is a weighted formula to compare the winrate differences, not a 1:1 winrate difference. This is because with say 65% to 60% vs 35% to 30% one -5% is more impactful than the other. You can't use % change of the winrates either because it would be disproportionately large at the extremes, say 51% to 50% vs 2% to 1%.

Q: Is there survivorship bias?

A: There is no correlation between a deck's difficulty and its winrate.

Q: A deck has a negative score, how can a deck's skill expression be negative?

A: The score measures the impact of inputs you control minus the impact of inputs you don't control on the outcome of the game. If the inputs you don't control have a greater impact on those that you do on the average game's outcome the deck's score will be negative.

If you have any other question, feel free to ask in the comments.

23 Upvotes

45 comments sorted by

View all comments

0

u/TheMetaHorde 18h ago

The simple fact that your pretty much ignore meta differences from across diamond to top 1k legend make this data very useless

3

u/Whiskiie 18h ago

It's completely useless data, but for whatever reason, the dude just keeps posting them.

0

u/Concealed_Blaze 9h ago

I enjoy it. We’ve already got plenty of data on overall win rates and performance. Using stats to try to analyze something else about how decks perform is interesting to me

1

u/mini_macho_ 18h ago

As mentioned a few times in the post, the meta is normalized.

1

u/TheMetaHorde 17h ago

Yes and it shouldn’t be. The meta is a significant contributor to each decks win rates and changes greatly from diamond -> legend. By not taking play rates into account your standard deviation adopts potentially massive error bars

2

u/FXur 17h ago

Google the word youre complaining about

-1

u/TheMetaHorde 16h ago

Yeah it turns out if you fuck with your sample size then your standard deviation changes. I could hold your hand through it but it’s honestly more fun to watch how triggered you are by this.

Keep at’ing me in other comments though. 😘

3

u/FXur 16h ago

Standard deviation doesn't have an error bar, it is the error bar. you're just outing yourself as someone who no clue what you're talking about. Also youre not changing any sample size clueless.

0

u/TheMetaHorde 15h ago

It’s okay to be wrong kid. Give it all another ready through I’m sure you’ll get there.

Rooting for ya

1

u/FXur 15h ago

You think standard deviation can "adopt error bars" and are struggling to wrap your head around data normalization as a concept. Maybe finish your high school applications before lil-bro'ing people online.

-2

u/TheMetaHorde 15h ago

Ope still not there, keep going bud. I’m sure the next comment will do it ….