Upcoming changes to the configuration of FM-Arena tactic testing league.

by Zippo, Dec 2, 2021

Hi everyone,

We've collected a huge amount of data since the release of FM22 and it helped us to significantly improve our tactic testing league.

We analyzed the tactical settings of AI managers and determined which of them are most successful.

Here's an example how the tactical settings of AI managers look like ( it's just an example and there's nothing special in it ) :







We analyzed the formations across different leagues and determined the most successful of the them ( it's just an example and there's nothing special in it ):




We analyzed the roles and duties that the AI managers use and determined the most successful combinations ( it's just an example and there's nothing special in it ):





The attributes testing greatly helped us to understand how the attributes work in FM22 - https://fm-arena.com/table/13-fm22-attributes-ratings/



I can say that all that changes make a significant difference.

We haven't decided yet whether to start re-testing all the tactics for the current M.E. or wait for a new patch/M.E.

Tell us what you think we should do?

Cheers.

7

0

I would say re-test all the top tactics and see if results change significantly. If so, retest everything, else just test as usual

0

Hi @Zippo ,

Would this process be a lot of work?

Is there an expected release date for a new patch?

I think it would be interesting to retest now the tactics rated at 5+ in the first few tests.

Cheers!

1

I am not a fan of doing a heap of work for nothing. If you were going to retest, maybe only the top 10 or 20 tactics to see how it impacted. I am sure we will be more interested when the first update comes out. I haven't been able to find out when they usually do it. Have you got info on the likely timeframe?

Thanks, this is a very interesting development

1

Zippo said: Hi everyone,

We've collected a huge amount of data since the release of FM22 and it helped us to significantly improve our tactic testing league.

We analyzed the tactical settings of AI managers and determined which of them are most successful.

Here's an example how the tactical settings of AI managers look like ( it's just an example and there's nothing special in it ) :







We analyzed the formations across different leagues and determined the most successful of the them ( it's just an example and there's nothing special in it ):




We analyzed the roles and duties that the AI managers use and determined the most successful combinations ( it's just an example and there's nothing special in it ):





The attributes testing greatly helped us to understand how the attributes work in FM22 - https://fm-arena.com/table/13-fm22-attributes-ratings/



I can say that all that changes make a significant difference.

We haven't decided yet whether to start re-testing all the tactics for the current M.E. or wait for a new patch/M.E.

Tell us what you think we should do?

Cheers.


First of all, thank you for all your hard work.

About your question, I don't think there is any need to test all tactics again. If you really want to test to not stay idle until next patch, I would advise to start testing the first tactic in table, then and all others with at least 93% of points per match (inside the margin of error of 7%).

Other than that, I would like to see tests in a similar league where all teams have CA lower than 100, to see how the tactics react in an environment where players have lower quality. I'm not talking about having one team with high CA and another with low CA, but having another league just like the one used here, with all teams having reduced CA.

3

ZaZ said: Other than that, I would like to see tests in a similar league where all teams have CA lower than 100
We do a lot of internal testing to make sure our testing league is reliable.

We've got a tactic testing league where all the players have their Mental and Technical attributes around 11 - 13 so it's a very low level for the attributes.



We test all the tactics that come on top in that league too to make sure there's no significant different between that league and the main league and I can say we haven't been noticing any significant difference.

Also, we test all high rated tactics in the major real leagues in the game with the real players and the real teams to see whether there's any difference comparing to our main tactic testing league.

For example, here's our "fake" EPL ( we adjusted it to 76 matches ).

2

Zippo said: We do a lot of internal testing to make sure our testing league is reliable.

We've got a tactic testing league where all the players have their Mental and Technical attributes around 11 - 13 so it's a very low level for the attributes.



We test all the tactics that come on top in that league too to make sure there's no significant different between that league and the main league and I can say we haven't been noticing any significant difference.

Also, we test all high rated tactics in the major real leagues in the game with the real players and the real teams to see whether there's any difference comparing to our main tactic testing league.

For example, here's our "fake" EPL ( we adjusted it to 76 matches ).



That's loads of work!!!! WOW

0

Zippo said: We do a lot of internal testing to make sure our testing league is reliable.

We've got a tactic testing league where all the players have their Mental and Technical attributes around 11 - 13 so it's a very low level for the attributes.



We test all the tactics that come on top in that league too to make sure there's no significant different between that league and the main league and I can say we haven't been noticing any significant difference.

Also, we test all high rated tactics in the major real leagues in the game with the real players and the real teams to see whether there's any difference comparing to our main tactic testing league.

For example, here's our "fake" EPL ( we adjusted it to 76 matches ).



I meant more a league where mental and technical are around 8-10, but if you tested there and say there isn't much statistical difference, then I believe you. I didn't know those kind of tests were done under the hood. Good work!

2

ZaZ said: I meant more a league where mental and technical are around 8-10
that low attributes level can only be met in the lower leagues but when we test tactics in the lower leagues then usually, even a very average tactic in combination with an average team wins the league, the resistance level is quite weak in the lower leagues ( poor AI managers and poor players ) so we don't see the point in testing such low level of attributes

3

Zippo said: Hi everyone,

We've collected a huge amount of data since the release of FM22 and it helped us to significantly improve our tactic testing league.

We analyzed the tactical settings of AI managers and determined which of them are most successful.

Here's an example how the tactical settings of AI managers look like ( it's just an example and there's nothing special in it ) :







We analyzed the formations across different leagues and determined the most successful of the them ( it's just an example and there's nothing special in it ):




We analyzed the roles and duties that the AI managers use and determined the most successful combinations ( it's just an example and there's nothing special in it ):





The attributes testing greatly helped us to understand how the attributes work in FM22 - https://fm-arena.com/table/13-fm22-attributes-ratings/



I can say that all that changes make a significant difference.

We haven't decided yet whether to start re-testing all the tactics for the current M.E. or wait for a new patch/M.E.

Tell us what you think we should do?

Cheers.


I think just re-test the 5.0+ or 5.5+ tactics, as I think the difference won't turn many lower tactics good.

0

cptdoggo said: I think just re-test the 5.0+ or 5.5+ tactics, as I think the difference won't turn many lower tactics good.

I agree

0

I'm looking forward to it. :thup:

0

i want to see test team CA125 and AI team CA145+
i wanna know if real underdog+good tactic VS strong team in EUROPE

0

Hi @Zippo ,

Will there be a retest of tactics still in this patch?

0

Amazing work lads !

As other said would only test tactics of 5.5 or higher at first to show the difference , the patch can take a while before it’s out, but not enough to bother with all the tests possible , if it’s bad now it will be bad in the new test most likely

1

Great work as always @Zippo and the other admins. I agree with cptdoggo, I would test all those that achieved a score of 5.0 or more. You already do enough in all fairness, so only testing them top tactics would prove beneficial in my opinion

1

You could maybe take like the top tactic from the AI in one of those tests and see what it scores out.

0

MisterCMS said: Is there an expected release date for a new patch?

For FM 21 it was:
- 21.1.3 - 3rd December
- 21.2.2 - 8th January
- 21.3.0 - 23rd February
- 21.4.0 - 17th March

I would suggest to wait for the first patch.

2

The new database's results - https://fm-arena.com/table/14-patch-22-1-1/

1

Zippo said: The new database's results - https://fm-arena.com/table/14-patch-22-1-1/

Hi zippo
what is the difference between 2 table ?

1

I'd retest the dino rush v2. The one that was 2nd(i think?) In the fewest goals conceded sort in the 1st table

2

irapbot said: Hi zippo
what is the difference between 2 table ?


same question

0

irapbot said: Hi zippo
what is the difference between 2 table ?


ta2199 said: same question

Read the opening post. I think that is all we will get.

0

ta2199 said: same question

The results on the new database - https://fm-arena.com/table/14-patch-22-1-1/

The results on the old database - https://fm-arena.com/table/12-patch-22-1-1/

Check the opening post to find out the difference between the databases.

1

In new testing, how could liverpool do so much worse. Is it because ME is so bad or it is showing that everything in the game related to luck?

0

serhat22 said: In new testing, how could liverpool do so much worse. Is it because ME is so bad or it is showing that everything in the game related to luck?

All the teams, AI managers and players in the testing league have been edited, there are no real players and AI managers in the testing league.

You can download a game save and see it for yourself - https://fm-arena.com/tactic/1869-oski-4-2-3-1/

1

I'm sorry if this is a dumb question, but I'm not sure I understand... Does this new way of testing tactics give a more accurate rating than before, or is it just a different way of evaluating the tactic, without necessarily being more accurate?

0

Alexis said: I'm sorry if this is a dumb question, but I'm not sure I understand... Does this new way of testing tactics give a more accurate rating than before, or is it just a different way of evaluating the tactic, without necessarily being more accurate?

Read the first post!

0

Gracolas said: Read the first post!

Oh, because you think I haven't already? thanks for deliberately not trying to help me! :thup:

2
Create an account or log in to leave a comment