Author Topic: Elo rating + league + bots  (Read 4320 times)

Offline Numsgil

  • Administrator
  • Bot God
  • *****
  • Posts: 7742
    • View Profile
Elo rating + league + bots
« on: April 09, 2010, 05:04:50 PM »
Not sure if this is stupid or not, but I wanted to record this idea before I forget.

Instead of the current system (or in addition to) for handling bots, we could implement an elo rating system or one of the related rating systems.  The primary advantage being that we can assign a numeric score (eg: 1837) to a bot.

Offline Ammeh

  • Queen of the Internets
  • Bot Destroyer
  • ***
  • Posts: 169
    • View Profile
Elo rating + league + bots
« Reply #1 on: April 09, 2010, 05:50:56 PM »
sounds like a good idea. The only problem I see is that it gives advantage to combat bots. Most of my bots just try and survive while reproducing, very rarely attacking. That would give them a low score, but they often massively out do combat bots (usually by hogging all the food, but w/e )

Offline Shasta

  • Administrator
  • Bot Destroyer
  • *****
  • Posts: 231
    • View Profile
Elo rating + league + bots
« Reply #2 on: April 09, 2010, 07:02:31 PM »
I would be for adding something like Elo. It gives the ability to see just how much of a difference there is between what would be ranked first versus second and so on.

Quote from: Sammeh
The only problem I see is that it gives advantage to combat bots.
I think Numsgil was talking about for the leagues.

Offline Numsgil

  • Administrator
  • Bot God
  • *****
  • Posts: 7742
    • View Profile
Elo rating + league + bots
« Reply #3 on: April 09, 2010, 07:23:02 PM »
Quote from: Shasta
I would be for adding something like Elo. It gives the ability to see just how much of a difference there is between what would be ranked first versus second and so on.

Yeah, that's the thinking.  It would also mean I could compare different versions of Darwinbots.  If I add a new feature, and all existing bots change dramatically in rating, I can take that in to consideration.

Quote
Quote from: Sammeh
The only problem I see is that it gives advantage to combat bots.
I think Numsgil was talking about for the leagues.

Yes, it would be for league matches.  So a species gets a win for winning one round.

It also means we could probably run fewer league matches to get a good ranking.  I'd probably not replace the current league system, but it would be a good system to have in addition to normal leagues.  Certainly when you're working on a bot and you want to see how much stronger your bot is with a certain feature.

Offline ikke

  • Bot Destroyer
  • ***
  • Posts: 300
    • View Profile
Elo rating + league + bots
« Reply #4 on: April 10, 2010, 01:10:48 AM »
ou could make a last man standing tournament using an expanded version of the elo system:
http://sradack.blogspot.com/2008/06/elo-ra...le-players.html

Offline peterb

  • Bot Destroyer
  • ***
  • Posts: 148
    • View Profile
Elo rating + league + bots
« Reply #5 on: April 10, 2010, 08:39:34 PM »
will the bots play chess then ?

 

Offline bacillus

  • Bot Overlord
  • ****
  • Posts: 907
    • View Profile
Elo rating + league + bots
« Reply #6 on: April 11, 2010, 03:40:10 AM »
That's the long-term plan. Until then, they have to play Gladiators...
"They laughed at Columbus, they laughed at Fulton, they laughed at the Wright brothers. But they also laughed at Bozo the Clown."
- Carl Sagan

Offline ikke

  • Bot Destroyer
  • ***
  • Posts: 300
    • View Profile
Elo rating + league + bots
« Reply #7 on: April 11, 2010, 04:31:29 AM »
I was planning to set up a sim with zerobots and wait intil the bots invent chess

Offline Numsgil

  • Administrator
  • Bot God
  • *****
  • Posts: 7742
    • View Profile
Elo rating + league + bots
« Reply #8 on: April 11, 2010, 04:09:59 PM »
I tried that once.  But instead of normal chess they invented Shogi.  So the experiment was a complete failure.

 

Offline ikke

  • Bot Destroyer
  • ***
  • Posts: 300
    • View Profile
Elo rating + league + bots
« Reply #9 on: April 12, 2010, 02:43:07 AM »
Quote from: Numsgil
I tried that once.  But instead of normal chess they invented Shogi.  So the experiment was a complete failure.

 
I know, I know, it's hard to see your children fail..