# BestPSpace

Robo Home | Changes | Preferences | AllPages

Difference (from prior major revision) (minor diff, author diff)

 Seems like a good system. The real trick to making it learn faster is to choose families that show some real relationships. You could have many different options for families built into the code, but only store and collect the ones that show a significant correlation (thankfully, there are established ways to evaluate this). I would be willing to bet that the biggest source of problems with this method is the fact that 90% of top bots use some form of wave surfing, so only the GuessFactorTargeting family will show any correlation. --speal

BestPSpace is the method of Targeting used by LauLectrik 1.2. There may be other bots that use it under other names.

The system tries to overcome the problems PatternMatching, GuessFactorTargeting, and VirtualBullets have:

• Pattern matchers have trouble predicting movement when the enemy behaviour has no clear pattern, or when future behaviour is not related to previous observations. It seems to happen with many top bots, and that's why the VB method seems to work better against them.

• VB bots calculate the best relative bearing to fire at, based on previously collected data. For simple movements, this works fine. However, lately some top bots have appeared that create a movement that has a flat bearing probability function. The bearing probability function for these bots looks like:

``` +probability for a given distance.
+
+
+*********
+*********
+*********
========== bearing
```

BestPSpace tries to overcome it by mapping the right bearing to hit to multiple variables. It creates N probability spaces, each classified by a group of variables. For example:

``` + SPACE 1: probability for a given distance.
+
+
+*********
+*********
+*********
========== bearing
```

``` + SPACE 2: probability for a given accumulated time moving in a certain direction.
+
+      *
+    ***
+   *****
+*********
========== bearing
```

Note that you will have families of probability functions (defined by the variables used to classify the bearings) and many instances for each probability function. For example, one family might be defined by distance - accumulated time; the instance would be distance=500-accumulated time=20.

LauLectrik uses 20 of these families, and generates around 1300 instances (this means 1300 probability functions). The number of instances depends on the enemy. Some variables it uses are: distance, target direction, target velocity, target acceleration, accumulated time moving in the same direction, relative movement direction, etc.

When you are going to fire, you select the instance for each family that best matches the current enemy state, and select the family with the highest probability (note that higher probability means that there is less variance in that space - the movement is more predictable).

The advantage of this system is that you can try to create a movement that makes a probability function flat, but it will be very difficult to make ALL functions flat, so LauLectrik should always be able to find a good criterion to use for aiming.

Sumarizing how it works:

1. Calculate the right gun bearing to hit (I use the algorithm described in the Wave page)
2. Calculate the current bot state for each bot family, select the right instances, and update the probability functions with the right gun bearing.
3. When you aim, use the current bot state to select the right instance for each family, and select the instance that shows the highest probability.
4. Fire!!!

The gun has some problems that need additional work:

1. It learns quite slowly, because of the large number of buckets.
2. The number of families must be limited. The higher the number of families, the higher the probability of chosing the worng function, just because of variance in the observations. A system to deal with applicability of the functions should be implemented.
3. It uses lots of data, so when you add persistence it consumes the 200K allocated VERY fast. This makes it important to limit the number of families, which reduces the gun performance.

-- Albert

My prediction: This is the firing that the future killer bot will use. --tobe

Seems like it might have problems with learning speed, especially if the eternal rumble continues to use 10 round battles. --David Alves

So was this basically segmentation of GF targeting, or is there more to it? -- Jokester

When I read it I understood it as GF segmentation, but with segments treated separately. Maybe I was wrong ;) --lRem

Seems like a good system. The real trick to making it learn faster is to choose families that show some real relationships. You could have many different options for families built into the code, but only store and collect the ones that show a significant correlation (thankfully, there are established ways to evaluate this). I would be willing to bet that the biggest source of problems with this method is the fact that 90% of top bots use some form of wave surfing, so only the GuessFactorTargeting family will show any correlation. --speal

Robo Home | Changes | Preferences | AllPages