help3011

It's UWAweek 51

help3011

This forum is provided to promote discussion amongst students enrolled in CITS3011 Intelligent Agents.

Please consider offering answers and suggestions to help other students! And if you fix a problem by following a suggestion here, it would be great if other interested students could see a short "Great, fixed it!" followup message.

How do I ask a good question?

Displaying selected article

Showing 1 of 83 articles.
Currently 10 other people reading this forum.

UWA week 40 (2nd semester, week 10) ↓

Agent testing (both)

4:15pm Wed 2nd Oct, Andrew G.

ANONYMOUS wrote:

> I was wondering how the testing would be done with our agents. Currently, I am testing my agent against a pool of agents consisting of: my agent, the satisfactory, basic and the random agent in the agent pool. I ask this because I've noticed that my win rate changes depending on which agents I play against (which makes sense why), but I was wondering if we could know a little more about which agents our agent verses. > > For example, excluding the RandomAgent from the pool changes the winrate %s.

I am not intending to provide any fixed rules about what combinations will be tested. Note that assessing your own agent's performance is explicitly part of this project. Given that your agent is not receiving any different treatment to the other agents, the SatisfactoryAgent and yours are in the same situation regardless of what pool of other agents is in play. Yes, this may affect your win rate, but if it causes your win rate to be worse than the SatisfactoryAgent, then surely this means you are not outperforming the benchmark? I encourage you to explore different testing methodologies and scenarios and use these to justify the effectiveness of your agent in your report. If nothing else, if a benchmark agent and your agent are dropped into identical scenarios, for your agent to outperform the benchmark would mean for it to be more likely to win, and so over many samples for it to have a higher win rate, yes? Hope that helps. Cheers, Gozz

help3011 articles all ANNOUNCEMENTS recent articles login to post a new article tagged articles (63 / 83) general (2) lectures (6) labs (3) mid-sem test (2) project (46) final exam (4) help3011 topics from today and yesterday from the past week from the past two weeks ALL topics, most recent first	login chapter0 unitinfo research projects csforum csse-feedback csbreakdown cssubmit csmarks 2nd semester help fora Algebra Advanced Algorithms Cloud Computing High Performance Computing Intelligent Agents Professional Computing Relational Database Management Systems Systems Programming