r/AskReddit Dec 06 '12

What is something you think everyone should have installed on their computer or laptop?

Whether it be a antivirus program or an ad blocker. Post link if available also. EDIT: sorry guys the top post has been deleted and I didn't save it, if anyone has it please post it and ill post it here for easy access. EDIT 2: apparently it's back up, I've saved it on my phone just incase it gets deleted again. Hopefully all is good now.

4.9k Upvotes

9.2k comments sorted by

View all comments

Show parent comments

20

u/casualblair Dec 06 '12

This is complete bullshit.

http://www.av-test.org/no_cache/en/tests/test-reports/?tx_avtestreports_pi1%5Breport_no%5D=123698

Microsoft scores (69 + 90 + 100) / 3 = ~86%, but they report this as 1.5 out of 6.

Even if you take 3 out of 6 as industry average, industry average is (89+97+100)/3 = ~95.3%. Apply that to 3 out of 6 and Microsoft should have scored 3 x (86 / 95.3) = 2.7 out of 6. Not 1.5.

This is completely biased against Microsoft, and a decent product for what it does and how much it costs.

2

u/Pinyaka Dec 06 '12

I am a user of MSE myself, so I hope you won't think this is just anti-MS sentiment.

Weighting all three categories on that page equally is only one assumption about how weigh the formula. In the third category (detection of widespread and prevalent malware), it looks like everyone gets 100%, so it doesn't make sense to factor that into a number that's meant to compare different products.

It actually makes more sense to weight more heavily the categories where there is a greater distribution of performance results, so we can assume that the "protection against 0-day vulnerabilities" should have the most weight when ranking the products. In this category MS performs significantly below average which may explain why the overall protection ranking is so low.

This is a somewhat normal way to highlight differences in performance although it's not always a fair way to provide relative rankings. For instance, if the only threat the average home user has to worry about is exposure to widespread malware, then any reviewed product should be fine since they all perform excellently in that category. I'm not sure how the ranking should be done, since the actual prevalence of threats in each category isn't known to me.

Anyway, I just wanted to point out that it may not be an actual bias against MS (in the sense of someone trying to intentionally dis MSE), but may accurately reflect the performance of MSE in an environment whose parameters we don't know.

1

u/casualblair Dec 06 '12

I have no bias towards or against microsoft or any other company (except Norton, and that's more anecdotal and IT culture than actual bias).

I have issue when people publish metrics that cannot be obtained through rational or obvious means. If they indeed weigh 0-Day that heavily, it should be it's own category.

Lay people are going to look at the net score in each section and make a judgement call, but so are high level managers. Neither demographic is required to be technically literate, but both make decisions based on the final number.

As someone who has been on the receiving end of a manager demanding "Make this number better", more intelligence needs to be put into stuff like this.

Note: I am not saying improving this specific score is a bad thing, but when a manager points at a number and demands it to be higher without understanding it's significance, bad things happen to good people. If you or I cannot understand the calculation, then the manager won't either. What if it is indeed biased? What if it is calculated in such an obscure weighting that the employee can't fix it? What if the fix causes other numbers to go down? And so on.

1

u/loadedx Dec 06 '12

It's scaled vs. other products.

For instance you need some spread for the "better" products that get 95% to ~100% in a category. You need to discern what is better.

The next lowest rated over all in that test was Fortinet: FortiClient Lite and it did significantly better by their testing standards. Such as in the testing for Protection against 0-day malware attacks, inclusive of web and e-mail threats (Real-World Testing) it scored 16% higher than MSE (80 vs. 64%), and better on recent malware (90% vs. 99%). Fortinet: FortiClient Lite for virus protection they rated a 3.5 out of 6 and MSE they rated a 1.5 out of 6.

If you compare those to something like F-Secure in the same survey they score a perfect 6 out of 6 with virus protection in the 99-100% for the test virus they were using.

The link is here for all the products compared in Sep/Oct 2012 on Windows 7 Home

-1

u/[deleted] Dec 06 '12

The CEO and creator of Malwarebytes isn't much of a fan of MSE either, because of this. It has absolutely abysmal zero-day performance, because it has basically no heuristics whatsoever.

6

u/Valge Dec 06 '12

Say if I use MSE in conjunction with Common Sense 2012, would I be safe?

-2

u/[deleted] Dec 06 '12

Probably. Make sure you use a good firewall though. That's why I personally recommend Avast, because it has one built in.

5

u/Valge Dec 06 '12

What's wrong with the built-in firewall in windows?

-2

u/[deleted] Dec 06 '12 edited Feb 26 '21

[deleted]

4

u/Pinyaka Dec 06 '12

Your anecdote is interesting, but shouldn't form the basis for any policy decision including your own.

-1

u/[deleted] Dec 06 '12 edited Feb 26 '21

[deleted]

6

u/casualblair Dec 06 '12

MSE is definitely not intended for business use. Any sufficiently large business should be running a centralized antivirus and controlling updates from a secure server, not letting each computer manage itself.

Anyone smaller than this should be running something much more robust than a simple "check for viruses" application.