Darwinbots Forum

Code center => Suggestions => Topic started by: Numsgil on April 09, 2010, 05:04:50 PM

Title: Elo rating + league + bots
Post by: Numsgil on April 09, 2010, 05:04:50 PM
Not sure if this is stupid or not, but I wanted to record this idea before I forget.

Instead of the current system (or in addition to) for handling bots, we could implement an elo rating system (http://en.wikipedia.org/wiki/Elo_rating_system) or one of the related rating systems.  The primary advantage being that we can assign a numeric score (eg: 1837) to a bot.
Title: Elo rating + league + bots
Post by: Ammeh on April 09, 2010, 05:50:56 PM
sounds like a good idea. The only problem I see is that it gives advantage to combat bots. Most of my bots just try and survive while reproducing, very rarely attacking. That would give them a low score, but they often massively out do combat bots (usually by hogging all the food, but w/e )
Title: Elo rating + league + bots
Post by: Shasta on April 09, 2010, 07:02:31 PM
I would be for adding something like Elo. It gives the ability to see just how much of a difference there is between what would be ranked first versus second and so on.

Quote from: Sammeh
The only problem I see is that it gives advantage to combat bots.
I think Numsgil was talking about for the leagues.
Title: Elo rating + league + bots
Post by: Numsgil on April 09, 2010, 07:23:02 PM
Quote from: Shasta
I would be for adding something like Elo. It gives the ability to see just how much of a difference there is between what would be ranked first versus second and so on.

Yeah, that's the thinking.  It would also mean I could compare different versions of Darwinbots.  If I add a new feature, and all existing bots change dramatically in rating, I can take that in to consideration.

Quote
Quote from: Sammeh
The only problem I see is that it gives advantage to combat bots.
I think Numsgil was talking about for the leagues.

Yes, it would be for league matches.  So a species gets a win for winning one round.

It also means we could probably run fewer league matches to get a good ranking.  I'd probably not replace the current league system, but it would be a good system to have in addition to normal leagues.  Certainly when you're working on a bot and you want to see how much stronger your bot is with a certain feature.
Title: Elo rating + league + bots
Post by: ikke on April 10, 2010, 01:10:48 AM
ou could make a last man standing tournament using an expanded version of the elo system:
http://sradack.blogspot.com/2008/06/elo-ra...le-players.html (http://sradack.blogspot.com/2008/06/elo-rating-system-multiple-players.html)
Title: Elo rating + league + bots
Post by: peterb on April 10, 2010, 08:39:34 PM
will the bots play chess then ?

 
Title: Elo rating + league + bots
Post by: bacillus on April 11, 2010, 03:40:10 AM
That's the long-term plan. Until then, they have to play Gladiators...
Title: Elo rating + league + bots
Post by: ikke on April 11, 2010, 04:31:29 AM
I was planning to set up a sim with zerobots and wait intil the bots invent chess
Title: Elo rating + league + bots
Post by: Numsgil on April 11, 2010, 04:09:59 PM
I tried that once.  But instead of normal chess they invented Shogi (http://en.wikipedia.org/wiki/Shogi).  So the experiment was a complete failure.

 
Title: Elo rating + league + bots
Post by: ikke on April 12, 2010, 02:43:07 AM
Quote from: Numsgil
I tried that once.  But instead of normal chess they invented Shogi (http://en.wikipedia.org/wiki/Shogi).  So the experiment was a complete failure.

 
I know, I know, it's hard to see your children fail..