ADVERTISEMENT:

Introducing the "Pro Rating"

posted by HolyMaster, 1 year ago
Professionalism and behaviour in the world of eSports, and particularly in the world of Dota, has always been an extensively discussed topic. It's been questioned numerous times to what extent unpunctuality, unreliability, or bad manners from players are tolerable, and how severely tournament organizers are supposed to punish these delicts. But one consequence is obvious to everyone: these things influence the viewing experience for all fans in a mostly negative way.



joinDOTA is trying to confront this issue with a new approach, starting now. The Professionalism and Propriety Rating (short: Pro Rating) will evaluate the general behaviour, professionalism, and attitude of teams and players. It will collect all tiny and large missteps teams or players may commit, and calculate a rating between 0 and 10, which will be visible to the public. We will test it at first in Season 3 of The Defense, and carry it over to other professional tournaments later. This behaviour rating has a lot in common with a classic penalty system, but there are a few subtle differences.


What infringements does the behaviour rating include?

  • General flaming/bad manners

  • Not showing up for a match

  • Not being ready on time (this includes displaying correct names)

  • Postponing of a match

  • Usage of stand-ins

  • Excessive all-chat spamming

  • Insufficient communication with the administration

  • Very high amount of and/or excessively long duration of pauses

  • Unauthorized name changes during the game

This list will probably increase during the next few weeks. How hard each of these flaws should be punished is another question we have a rough idea about, but cannot be entirely certain about just yet. There might be some flaws we haven't thought about yet. This is why the system is only being tested in The Defense 3 for now, before we expand it to other competitions.


What are the consequences of the rating?


a. We punish a team with a prize money reduction, if its rating is below 5 at the end of the season. This reaches from 5% to a maximum of 25% (possibly more in the future), depending on how the rating actually is. Since prize money only affects the top 3 or 4 in most tournaments, this penalty is mainly meant for the very best teams who are designated to be a good example for the rest of the Dota scene.

b. The rating heavily influences the decision, whether or not we invite a team again for future competitions, be it the joinDOTA Masters, the next season of The Defense, or any other tournament joinDOTA is organizing. While the best of the best will still have good chances of being invited in spite of a low behaviour rating, this is especially relevant for the slightly weaker teams who get to participate.

c. This is not a real consequence by joinDOTA itself, but the fact that we show the ratings to the public on our website means a lot already. Current or potential sponsors are certainly interested in not seeing their line-up at the bottom of the page, and therefore might increase the pressure even more. Furthermore, the community itself can contribute to improvement by openly criticizing unprofessional teams based on our rating.

d. Other consequences might follow in the future, if the rating turns out to work well and provide adequate results. One possible addition is the power of breaking ties. Several other things are imaginable. This is also still very open to suggestions and feedback from the community.


How is the rating calculated exactly?


First of all, a team receives a rating between 0 and 10 for every individual match. The base value is 10 and then it gets negative points for every misdoing (e.g. -2 for a stand-in and -1 for being 2 minutes late results in a rating of 7, if nothing else occurs). Positive points can be given in exceptional cases.

The overall rating gets calculated out of all matches as something similar to an average. Not all matches are equally important though, a playoff match has more influence than a group match, because it is usually more important. Therefore each match has a weight (1 for group matches, 2 for normal playoffs, 3 for the grand final). The overall rating is: (Sum of all match ratings multiplied with the match's weight) / (sum of all weights). That way (unlike in a traditional pp system), nobody has an advantage or disadvantage by simply playing more matches than another participant.

Example: Team XYZ has the ratings 6 and 5 for group matches, and 9 for a playoff match.
The overall rating for these 3 matches is (6*1 + 5*1 + 2*9) / (1 + 1 + 2) = 29/4 = 7.25


What are the advantages compared to a traditional penalty system?


a. The amount of matches doesn't matter.

Common punishment systems are mostly about collecting penalty points (PPs). Once you've reached a certain amount of them you get some punishment, e.g. disqualification. Teams who play more matches are therefore more likely to reach that amount, since they have more possibilities to collect PPs. Since we use something average-like to calculate the rating, the amount of matches don't influence a team's chances to receive a high or low rating.

b. We don't reward a team for the misbehaviour of their current opponents.

When a team messes up in a specific match, it is pretty common to punish them in a way that gives their opponent a significant advantage - sometimes not only over the guilty team, but over other, innocent teams as well. This is especially important in a group stage: if someone receives a default win, because the enemy didn't show up, it gives them a possibly undeserved advantage over everyone else in the group, and might even cost an uninvolved participant the qualification for the playoffs. Even tiny punishments like the loss of bonus time, or the right for the opponent to choose side and picking order, can result in an equally unfair situation (even though it's less likely). Therefore we have been trying to find consequences that punish a misbehaving team in a way that does not affect one specific match, but instead their general future in the scene.

c. It can be expanded to a bunch of tournaments.

While we start out with only The Defense 3, the rating can easily be carried over to other invitational tournaments (e.g. the joinDOTA Masters), maybe even from organizers other than just us here at joinDOTA. That is the first time that we have a system with the potential to establish a fair and transparent rating for known teams - independent from how many tournaments they actually participate in. This is a chance for organizers to work together (although the requirements to be included have to be very high, and might not be met by most tournaments hosts) and create a more professional scene.


In conclusion...


This idea is an experiment. It won't change things completely after a few days, but we are convinced that it might do so in the long run. The joinDOTA staff is aiming to improve things and we will try to be as objective as humanly possible while judging the teams and players. Making sure we make good decisions is the task of you, the community. Therefore a lot of feedback is kindly requested throughout the whole season.

- joinDOTA Staff


 
1
...

#1
DaniboyDAS wrote at 19.11.2012, 18:32 CET:
nice
#2
Lactose wrote at 19.11.2012, 18:33 CET:
Poor PGG
#3
bukKkk wrote at 19.11.2012, 18:34 CET:
Help im trapped in a comment factory
#4
Makid wrote at 19.11.2012, 18:36 CET:
Wow this is really cool, will be very interesting to see how it looks after a month or two.

... and yeah poor PGG.
#5
Miyagi-sama wrote at 19.11.2012, 18:38 CET:
Well this is the most amazing thing I'll see this week.
Really nice.

Btw, there should be something like, if the players and their teams respect all the rule and everyting goes perfect, they should get a bonus for that, imo.
That would kinda "force" the players to act correctly and care more about those things.
#6
BornDrunk wrote at 19.11.2012, 18:40 CET:
Lactose wrote:
Poor PGG


lold
#7
krsrwn wrote at 19.11.2012, 18:42 CET:
Lactose wrote:
Poor PGG


All I wanted to say.
#8
Kreuzritter wrote at 19.11.2012, 18:43 CET:
a very good idea!
#9
Coulomb89 wrote at 19.11.2012, 18:44 CET:
even though i like the idea very much... im not sure about the punishment for using stand-ins. you cant really punish a team for using a different player ONCE or maybe TWICE... come on, people have a real life and cant commit 24/7 to competitive dota, especially for not-so-important-matches like group-stage
#10
el_alcazar wrote at 19.11.2012, 18:45 CET:
"While the best of the best will still have good chances of being invited in spite of a low behaviour rating"

dunno if I like this sentence
#11
HolyMaster wrote at 19.11.2012, 18:46 CET:
Coulomb89 wrote:
even though i like the idea very much... im not sure about the punishment for using stand-ins. you cant really punish a team for using a different player ONCE or maybe TWICE... come on, people have a real life and cant commit 24/7 to competitive dota, especially for not-so-important-matches like group-stage


Using one stand-in is the same as being 5 minutes late. It's no big deal, but it is also not perfect. You shouldn't see that as a punishment, it's still a good rating. If you end up with 8/10, you are absolutely fine. Nevertheless this is one of the details we might adjust a little, if we get a bad feeling about it.
#12
krsrwn wrote at 19.11.2012, 18:47 CET:
Coulomb89 wrote:
even though i like the idea very much... im not sure about the punishment for using stand-ins. you cant really punish a team for using a different player ONCE or maybe TWICE... come on, people have a real life and cant commit 24/7 to competitive dota, especially for not-so-important-matches like group-stage


Did you even read the article? There won't be any immediate consequences just because you use a stand-in once in a while. Also group stage matches doesn't count as much as the others. But then again I think you didn't even read the whole thing.
#13
achiko wrote at 19.11.2012, 18:48 CET:
Miyagi-sama wrote:
Well this is the most amazing thing I'll see this week.
Really nice.

Btw, there should be something like, if the players and their teams respect all the rule and everyting goes perfect, they should get a bonus for that, imo.
That would kinda "force" the players to act correctly and care more about those things.


Don't think so. Pro teams should behave the "right" way in any situation and not because they get a bonus off of it.
#14
RunNoobsRun wrote at 19.11.2012, 18:48 CET:
And we go back to the first class
#15
Nzgrim wrote at 19.11.2012, 18:49 CET:
I can see it already - Cancer cure invented by <insert bad mannered player/team> to improve a low dota2 rating.
#16
altsich wrote at 19.11.2012, 18:49 CET:
Really guys, why would you feel bad about icefrog from this post?
It's great news for DotA?
#17
Pixxey wrote at 19.11.2012, 18:49 CET:
While I get that having stand-ins might be a bit disappointing for the fans and that it gets annoying if the stand-ins are used too often, it's kinda sad if a team gets a point reduction just because one of the members is sick and can't play or if there's something SERIOUS going on in their personal life and stuff (pointing out the 'serious'). Though it might not damage their Pro Rating that much if the usage of stand-ins is their only mistake, it's still kinda, idk, meh.
I strongly agree with the whole idea, but feel sorry for any team whose member might end up being seriously sick. Your offlaner is on the deathbed? Well, -2 points for you.
I realize 2 points might not be disastrous, but I felt like pointing it out.

Looks like no more vacation for XBOCT.
#18
Firemave wrote at 19.11.2012, 18:50 CET:
Not sure if this will work or not, I salute JD for trying to fix the bad professionalism in DotA scene nonetheless.
#19
dukes wrote at 19.11.2012, 18:50 CET:
Will this include pauses at the start of games for seemingly no reason? What about for things out of the hands of players such as disconnects? I don't like disconnects but sometimes they're unavoidable and connections in some parts of the world are more temperamental than in others.
#20
InDie_Go wrote at 19.11.2012, 18:50 CET:
i totally agree about not punishing a team cause of standin usage...
these teams invest so much time already and to bring all 5 ppl in isnt as easy as it may look..

some years ago teams used to let the standins play with the accs of the missing members..
imo its nice to see in public who is the standin and who not..

we might see teams using fakeaccs again just to dodge those - points..

u might punish if a team if they use like 10 different standins during 5 matches or so.. just in extreme cases..

otherwise i do like the idea
#21
HolyMaster wrote at 19.11.2012, 18:52 CET:
Pixxey wrote:
While I get that having stand-ins might be a bit disappointing for the fans and that it gets annoying if the stand-ins are used too often, it's kinda sad if a team gets a point reduction just because one of the members is sick and can't play or if there's something SERIOUS going on in their personal life and stuff (pointing out the 'serious'). Though it might not damage their Pro Rating that much if the usage of stand-ins is their only mistake, it's still kinda, idk, meh.
I strongly agree with the whole idea, but feel sorry for any team whose member might end up being seriously sick. Your offlaner is on the deathbed? Well, -2 points for you.
I realize 2 points might not be disastrous, but I felt like pointing it out.

Looks like no more vacation for XBOCT.


The goal is that teams have more than five players. Stable substitutes instead of stand-ins from other teams.
#22
Invasor wrote at 19.11.2012, 18:52 CET:
Lactose wrote:
Poor PGG


was gonna write the EXACT same thing xD haha that news is the PGG killer... well maybe he's finally be able to chase after his dreams and create a vodka label... :D

edit: " the community itself can contribute to improvement by openly criticizing unprofessional teams based on our rating." - permission to flame or what? that sentence sounds a bit "unprofessional" in my opinion.. u dont have to denounce teams further do you?
#23
Staudeyy wrote at 19.11.2012, 18:54 CET:
where will this list be published on hte site? tournaments?
#24
TheBigBadBird wrote at 19.11.2012, 18:55 CET:
DAMN, curing cancer is only +1? I would expect at least 2 for that . . .
#25
Miyagi-sama wrote at 19.11.2012, 18:56 CET:
achiko wrote:
Miyagi-sama wrote:
Well this is the most amazing thing I'll see this week.
Really nice.

Btw, there should be something like, if the players and their teams respect all the rule and everyting goes perfect, they should get a bonus for that, imo.
That would kinda "force" the players to act correctly and care more about those things.


Don't think so. Pro teams should behave the "right" way in any situation and not because they get a bonus off of it.


I think I didn't clear my ideas ^^ sorry

I mean... Imagine a team that does everything Right on TD3. Then if this gets implemented in another tournaments like joinDOTA Masters, if this team does something wrong now, they'll have something like a discount.
Like: On TD3, Team XYZ had a 10.00 rating. So they will have One -1 Rating point to be forgiven.
On joinDota Masters, Team XYZ had 9.00. Played with stand ins on 2 group stage matches, as they well behaved on TD3, the Team XYZ will have that -1 point nullfied. Which means they are did 10.00 rate on joinDota Masters.

This is my opinion thou... sorry for my bad english ^^
 
1
...
 

You are not logged in! To become part of the awesome, create your GameSports account here.