Pages: 1 [2]   Go Down
  Print  
Author Topic: GIRLS 93 RCL-SL CAP SCORES  (Read 2344 times)
0 Members and 1 Guest are viewing this topic.
swimfish
WPS Poster
*

Karma: +10/-0
Posts: 93



View Profile
« Reply #30 on: June 21, 2010, 12:31:37 AM »

swimfish,

you are drowning my friend-

Since I can't seem to get this horse to drink the water I swim in. Okay I wouldn't do it either. I propose a real live test of our relative systems.

In my corner I'll take Crossfire-Coker who frankly has a somewhat amazingly high CAP score despite being relegated to the losers (silver bracket) in the Challenge Cup.

In your corner I'll give you the following eight "statistically stronger" teams who advanced to the winners (gold bracket) of the Challenge Cup but were "unfairly" given inferior CAP scores by the state:
Evergreen F93 White, FC Alliance White, CW Strickers, Sun City Strikers, Whatcom Rangers Blue, Sparta F93, Snohomish United Red, and FC Shoreline Tide.

Since I'm not affiliated with either the state or any of these teams there is no "ego" involved.

Here is the bet- If any of these teams beats Crossfire Coker by more than a goal in the next year or if more than one beats Coker by any amount, I'll will eat crow and tell the whole WPS world that you were right and I'm just an idiot. If this does not happen then I'll continue to swim quietly in the water that you are now drinking.

Peace out  drinks drinks         
Logged
tripleplay
WPS-SpamKing Special Agent
****

Karma: +256/-473
Posts: 1921


View Profile
« Reply #31 on: June 21, 2010, 12:48:31 AM »


Okay lets have a little experiment. I don't know the exact formula that FIFA uses to rank teams and therefore I'll "refuse to disclose" them. I do know that they are based on the relative strengths of the teams and take into account away vs home games with a bonus given to wins away. Now lets run a little elimination tournament using the state random draw with no seeding. Only the top two teams advance. My teams:

Group D: Brazil (1611), Germany (1082), Argentina (1076), and the Netherlands (1231) - Results of first round standings have all games finish as expected except Germany beats the Netherlands 1-0 and advances to the elimination round on points  - The eliminated teams are the Netherlands and Argentina.   

Group E: Sweden (761), Honduras (734) and Scotland (699) - Results are also as expected, except Scotland ties Honduras and moves forward on goal differential. Eliminated team Honduras.

Under your theory that advancement in a cup is statistically related to relative team strengths, both Scotland and Sweden are stronger teams than the Netherlands and Argentina because they advanced to the elimination rounds.

Under my theory that FIFA rankings (like CAP scores) are based on relative team strengths and that randomly drawn elimination tournaments are poor predictors of relative team strengths, I believe that the Netherlands and Argentina are still stronger teams than either Sweden or Scotland. Care to take bets on the Netherlands v Scotland game. I'll even spot you a goal and we can play in Glasgow.  drinks drinks         


The point that you are making is not germane to the criticisms being made of the CAP system. Yes - it is theoretically possible to misdesign a tournament such that strong teams do not have a chance to prove themselves on the field.  But the point is that the CAP ratings fail, obviously in some cases, over a large number of games like the regular seasons. We would have to be given the details in order to determine why.

Last I looked, the FIFA algorithm is not secret. In fact, FIFA has changed its ranking algorithm from time to time for various reasons. For example, the current FIFA rankings actually do tend to overrate world cup tournament because it was not good for consumer acceptance to have the world cup winner be 3rd in the rankings. But, overall, the FIFA rankings are calculated in a way where all the data and all of the calculations are public. There are more sophisticated systems (for example the ESPN Soccer Power index) and there are also simpler straightforward rankings (Elo rankings). Unlike CAP, in each case, the algorithms are public and they all give basically sensible results that differ only in the details.

Since the details of CAP are hidden from view, we are left to speculate why they are in error. Perhaps they overcount away games without any statistical basis. Perhaps the feature of allowing teams to gain points in so-called "close" losses is a fatal flaw that undermines numerical soundness (it is not common in other ratings). Perhaps they don't include enough games, perhaps the algorithms have been distorted for political purposes etc.

This is not that complicated. It would be very easy to use a numerically sound rating system. Why didn't WYS do so?
Logged
GotRhythm
WPS Premier Poster
***

Karma: +196/-252
Posts: 550



View Profile
« Reply #32 on: June 21, 2010, 01:44:03 AM »

swimfish,

you are drowning my friend-

Since I can't seem to get this horse to drink the water I swim in. Okay I wouldn't do it either. I propose a real live test of our relative systems.

In my corner I'll take Crossfire-Coker who frankly has a somewhat amazingly high CAP score despite being relegated to the losers (silver bracket) in the Challenge Cup.

In your corner I'll give you the following eight "statistically stronger" teams who advanced to the winners (gold bracket) of the Challenge Cup but were "unfairly" given inferior CAP scores by the state:
Evergreen F93 White, FC Alliance White, CW Strickers, Sun City Strikers, Whatcom Rangers Blue, Sparta F93, Snohomish United Red, and FC Shoreline Tide.

Since I'm not affiliated with either the state or any of these teams there is no "ego" involved.

Here is the bet- If any of these teams beats Crossfire Coker by more than a goal in the next year or if more than one beats Coker by any amount, I'll will eat crow and tell the whole WPS world that you were right and I'm just an idiot. If this does not happen then I'll continue to swim quietly in the water that you are now drinking.

Peace out  drinks drinks         

What you are leaving out are the 2 teams that are likely being screwed out of P1...Legacy Lightning, and Synergy! How about head to head with them? Clearly Lightning and Synergy are stronger than Tornado's and Xfire Coker. CAP scores are a descent guide, but not flawless. Come on Todd Lincoln, let's get it right!
Logged
NKSoccerFan
WPS Premier Poster
***

Karma: +1113/-57
Posts: 523



View Profile
« Reply #33 on: June 21, 2010, 02:07:06 AM »

If WSYSA wants anyone to take the CAP seriously, they have to start by releasing the formula.
Secrets = distrust.
Until it the formula is public, it is CrAP.   
Logged

The above is the author's personal opinion and is not the opinion or policy of the North Kitsap Soccer Club.
swimfish
WPS Poster
*

Karma: +10/-0
Posts: 93



View Profile
« Reply #34 on: June 21, 2010, 02:16:58 AM »

What you are leaving out are the 2 teams that are likely being screwed out of P1...Legacy Lightning, and Synergy! How about head to head with them? Clearly Lightning and Synergy are stronger than Tornado's and Xfire Coker. CAP scores are a descent guide, but not flawless. Come on Todd Lincoln, let's get it right!
[/quote]

Synergy played Tornados last year and they lost 2-0. I would currently put both these teams at about the same level.

Tornados have not played Lighting but having seen Coker and Lighting at various times I would put those teams at the same level slightly ahead of Synergy and Tornados but not by a long shot. Both teams have incredibly fast forwards who should be playing for top level teams. Lightning is a little better organized on defense but a game between Coker and Lighting would be incredibly fun to watch. It would not be a blowout by any means.    
Logged
goldengoal
WPS-SpamKing Special Agent
****

Karma: +252/-243
Posts: 1148


View Profile
« Reply #35 on: June 21, 2010, 09:07:37 AM »

What you are leaving out are the 2 teams that are likely being screwed out of P1...Legacy Lightning, and Synergy! How about head to head with them? Clearly Lightning and Synergy are stronger than Tornado's and Xfire Coker. CAP scores are a descent guide, but not flawless. Come on Todd Lincoln, let's get it right!

Synergy played Tornados last year and they lost 2-0. I would currently put both these teams at about the same level.

Tornados have not played Lighting but having seen Coker and Lighting at various times I would put those teams at the same level slightly ahead of Synergy and Tornados but not by a long shot. Both teams have incredibly fast forwards who should be playing for top level teams. Lightning is a little better organized on defense but a game between Coker and Lighting would be incredibly fun to watch. It would not be a blowout by any means.    
[/quote]

Coker was going to move up based on the end of season CAP scores along with SSFC- Coker is not a bad team and neither are the Tornadoes. Having said that, the tornadoes ended either in between or at the bottom of their division, while Coker won the division. then in the Challenge Cup Silver Coker beat out the tornados- How these P2 teams who played for the finals of the Silver Division of the Challenge Cup end up higher than PDL-1st, PDL-2nd, P1 teams & P2 teams who were either stronger than them based on historical data is beyond me. Now you have a CAP score for teams that did not enter the state cup getting a score that is different than the score they ended with during league play. I guess we just change the formula a little bit and wallah we get the new scores.

1st- It is dumb for the state to all of a sudden create a Silver Division of the State Cup and then count those games as part of the CAP score. You did not advance, you are out, better luck next year

2nd- To recalculate the end of season results and then at the end of the state cup recalculate them again tells me that the state is still not 100% sure of their system and because of this it will be critisized

3rd- why is it not open for people to see how the games where calculated? You can post online how the formula is supposed to work, but show us the data behind the formula

4th- The 2 teams you speak of played more games than every other team in the state cups because they did not advance in the Gold of the Challenge Cup- What are we teaching our players- Johnny and Susie- I know we did not advance past the 1st round of the cup, but that is okay we can still win a trophy by playing in the losers bracket- Hey it is all fun and games at club tournaments because they dont penalize the teams for playing in a higher division or for losing out in the higher division elimination round

I am done with this conversation as it seems more like you are trying to justify what the state did is right because it benefits your team or teams. Of course, if it were the other way around you would at least be challenging the state decision. It is people like you that screw up youth soccer here in WA. "as long as my team or my kid is getting the better end of the stick then its okay "

Logged
Gremlin
WPS Poster
*

Karma: +8/-6
Posts: 33


View Profile
« Reply #36 on: June 21, 2010, 07:41:18 PM »

Alright people listen up !!!!! As I have read all the comments left on this site about this subject.Yes certain teams received better cap score when they should not have, but when you have system that can be,lets say controlled with only a few set of eyes thats is what you are going to get.

But here is the big picture what in gods name are we doing to the youth soccer players in this state.When you have a system such as the cap. we are creating the lack of deveopment of youth soccer in the future. What do i mean? Lets say you are playing a team with a cap score of 7.25 and your team has a cap score of 6.75 you are playing at there home field it is tied at half time what does the coach do at half time,tell his kids hey the score is good enough we are tied and our cap score will go up so lets go for the tie we will play more players back and not go for the win but we will tie so we will win.
Or lets say the team with the cap score 7.25 is ahead by 2 goals with 20 minutes to go and lets say the cap system says that team should win by two goals, does the coach sub kids that needs play time,but does not put them in because they cant afford to win by only one or whatever the case is.

My point is that if this system if allowed to continue it will have a huge impact on coaches on how they play the game. This of course will destroy the development of youth soccer in this state especially at the younger ages.We have problems enough at regionals this will not help but will take our state even further back in development.
Logged
swimfish
WPS Poster
*

Karma: +10/-0
Posts: 93



View Profile
« Reply #37 on: June 21, 2010, 10:25:37 PM »


Alright people listen up !!!!! As I have read all the comments left on this site about this subject.Yes certain teams received better cap score when they should not have, but when you have system that can be,lets say controlled with only a few set of eyes thats is what you are going to get.


To Gremlin and Tripleplay,  drinks drinks Tripleplay  I agree with your well written critique CAPs system. I would add that an additional flaw in the system is that it treats all away games the same whether they are 5 miles from home or 200 miles from home. I suspect but can't factually make the case that the CAP system benefits teams in the greater Seattle area because they get credit for away games that occur in the local area. I wonder if you handicapped the teams on that basis it would result in a better result. I would take the critique of the state tournament a little further and say that the WYS has misdesigned the Challenge Cup "such that strong teams do not have a chance to prove themselves on the field". So we have a choice: 1. the Challenge Cup is a complete crap shoot with a team's luck in the draw having a significant sometimes overriding impact on who makes it to the final rounds, or 2. the CAP system that is based on field performance but lacks adequate data-points, includes perverse incentives and for some obscure reason is not published, or 3. a politically influenced league system with teams and games being randomly assigned right up to the day play starts. A league is only a good predictor of relative strength only if each team plays each other team twice once at home and once away. Randomly picking who plays whom, how many times and where just undermines the validity of the league results.  

I think we need to to go back to the drawing board.

Gremlin: you make a good point but lets be clear - coaches make cynical decisions based on the current system. For example, in a tournament several years ago with a different team we need one point in our final round robin game about half way through the goal was scored. Before the restart the coach cleared the bench, put all the defenders in forward positions, and put the goalie at forward. He/she told the players to have fun, work on a new aspect of the game and take it easy. We still won the game 2-0 but it was not because we tried too. Later that day we played the same team in the final. It was a tough hard fought game but we won late in the game when the other team ran out of steam. Did our coach violate the rules or did they decide lose the battle in order to win the war?

You know, maybe one of the reasons the CAP score system is being keep so secret is so coaches can't game the system. Just saying!!

Goldengoal: Project negative, moralistic and fact free judgements on people you don't know much. Frankly, your post says far more about your character than it does mine. I am only saying that based on small data point I have (GU-16 P2 league results and published State Cup results) the CAP results track with how the state described them. The moral judgements about which system is fair, I leave in your hands as you seem so well equipped to make them.

To Johnny and Susie: I would get out a coin and a piece of graph paper. I would draw a line in the middle and tell Johnny and Susie that they should flip the coin. If its heads: move the line up one square and to the left one square, if its tails down one square and to the left one square. I would ask them to repeat the coin flip 20 to 50 times and watch what happens to the line. When they were done I would explain to Johnny and Susie that the line did not continue moving only up or only down was because its is a fallacy to assume that more coin flips would result in more of the same result. This is true because each coin flip can only have two outcomes. I would then explain to Johnny and Susie that basing moral and ethical judgements on fallacies is unchristian and that the CAP system acts in much the same way in that it is a fallacy (falsehood) to assume that simply playing more games will result in a team's CAP score going either up or down. I would also explain to Johnny and Susie that unlike the coin flip experiment CAP scores are earned on the field by teams that are playing against each other. Therefore, the only way to make your score move up is to play well against stronger teams.

Based on that example, I would tell Johnny and Susie that the CAP system is deeply flawed but its not a crap game and its results are not skewed by the roll of a dice.

Next, I would explain that the Challenge Cup draw was based completely on the roll of a dice and therefore advancement from some groups had as much to do with luck as with the quality of the teams. I would tell Johnny and Susie that the WYS may have created the silver division games because it understood that basing tournament advancement on a crap shoot was unfair to the stronger teams that lost the crap shoot and gave a false sense of accomplishment to the weaker teams that happened to win the crap shoot.

Goldengoal you are right our conversation on this topic is over. I've read your posts on other topics and its clear that no amount of facts will dissuade you from your god given right to make moral judgements about people you have never met. Its simply not in your DNA to do otherwise. God bless.
Logged
metz123
WPS Premier Poster
***

Karma: +207/-48
Posts: 540



View Profile
« Reply #38 on: June 22, 2010, 09:27:41 AM »

Alright people listen up !!!!! As I have read all the comments left on this site about this subject.Yes certain teams received better cap score when they should not have, but when you have system that can be,lets say controlled with only a few set of eyes thats is what you are going to get.

But here is the big picture what in gods name are we doing to the youth soccer players in this state.When you have a system such as the cap. we are creating the lack of deveopment of youth soccer in the future. What do i mean? Lets say you are playing a team with a cap score of 7.25 and your team has a cap score of 6.75 you are playing at there home field it is tied at half time what does the coach do at half time,tell his kids hey the score is good enough we are tied and our cap score will go up so lets go for the tie we will play more players back and not go for the win but we will tie so we will win.
Or lets say the team with the cap score 7.25 is ahead by 2 goals with 20 minutes to go and lets say the cap system says that team should win by two goals, does the coach sub kids that needs play time,but does not put them in because they cant afford to win by only one or whatever the case is.

My point is that if this system if allowed to continue it will have a huge impact on coaches on how they play the game. This of course will destroy the development of youth soccer in this state especially at the younger ages.We have problems enough at regionals this will not help but will take our state even further back in development.

Not a single coach I know (and I know quite a few), gives any thought to anything around the CAP numbers as input into tactical decision making during the game. No one I know plays for a tie during the regular season, no one I know uses different tactics on the road vs home based on CAP numbers. Theoretically it's possible, practically, it's not being done. Most of the coaches are working on improving their players and their teams, not discussing CAP numbers. In fact I don't know a single coach that thinks of the CAP as anything but a black box number assigned by the State that shifts like a summer breeze.

It's quite humorous to even think that home field advantage exists for anything short of 2 hours travel time for a game starting before 10am.
Logged
Gremlin
WPS Poster
*

Karma: +8/-6
Posts: 33


View Profile
« Reply #39 on: June 22, 2010, 10:13:00 AM »

Yes, no one has in the pass. But now it will be the question on next year tryouts,it will be the new guage it will become the new talk of the town,it will be what the kids ask, it will be what the parents ask prior to tryouts I dont know if the the PDL or RCL will be affected in making where teams play but for sure where the state teams play.So im sure coaches will start thinking about it, on how it affects there team and if that does happens it will start affecting player development.

I do have a guestion though. Is this done anywhere else for YOUTH soccer?
Logged
tripleplay
WPS-SpamKing Special Agent
****

Karma: +256/-473
Posts: 1921


View Profile
« Reply #40 on: June 22, 2010, 01:05:18 PM »

Yes, no one has in the pass. But now it will be the question on next year tryouts,it will be the new guage it will become the new talk of the town,it will be what the kids ask, it will be what the parents ask prior to tryouts I dont know if the the PDL or RCL will be affected in making where teams play but for sure where the state teams play.So im sure coaches will start thinking about it, on how it affects there team and if that does happens it will start affecting player development.

I do have a guestion though. Is this done anywhere else for YOUTH soccer?

There are ratings in many youth sports, including soccer. Nothing approaching the fears you express is ever seen.

If anything, a good rating system (not CAP) benefits development because it gives coaches objective feedback as to where teams are. Human nature is is to overestimate the quality of your team. Coaches see the mistakes that their teams makes as aberrations when they're not. They remember the bad calls that result in losses but they forget the bad calls that result in wins. They characterize losses as "not counting" because they are doing the right thing and "developing" players, but don't realize that they are also getting wins that shouldn't count by the same logic, because their opponents are developing their players, etc.

Logged
swimfish
WPS Poster
*

Karma: +10/-0
Posts: 93



View Profile
« Reply #41 on: June 23, 2010, 01:16:54 AM »


There are ratings in many youth sports, including soccer. Nothing approaching the fears you express is ever seen.

If anything, a good rating system (not CAP) benefits development because it gives coaches objective feedback as to where teams are. Human nature is is to overestimate the quality of your team. Coaches see the mistakes that their teams makes as aberrations when they're not. They remember the bad calls that result in losses but they forget the bad calls that result in wins. They characterize losses as "not counting" because they are doing the right thing and "developing" players, but don't realize that they are also getting wins that shouldn't count by the same logic, because their opponents are developing their players, etc.

[/quote]

3Play: And I thought I got shit on this site. They really don't like you over at the RCL thread. So at your invitation I spent some quality time with the ELO Wiki. Interesting stuff!! I will say that the ELO formula acts (in fact) in a way that is similar to what WYS claims are the factors and expected behavior of the CAP system (taking out the ELOs tournament quality factor). I wonder if we could get the state to just publish in one spreadsheet/place all the game results they used to derive the CAP system. Since we need to go back a couple years to get 30 games in the mix it would take some time and the old scores (league and tournament results) have just gone away. I know around my workplace we could use the data to generate an ELO ranking and just publish it. ELO ranking may have problems but its certainly a politically neutral (small p) system. Shit if Nate Silver uses it for baseball I'm all in. Then at least we would have a neutral datapoint to make a valid judgement about our current flawed systems. Care to take any odds on this happening :Smiley.

For those of you on the thread who don't fear math (with real formulas) and the science behind them here is the link - http://en.wikipedia.org/wiki/World_Football_Elo_Ratings     
Logged
Pages: 1 [2]   Go Up
  Print  
 
Jump to: