Please consider offering answers and suggestions to help other students!
And if you fix a problem by following a suggestion here,
it would be great if other interested students could see a short
"Great, fixed it!" followup message.
ANONYMOUS wrote
I have been desperately trying to get your marks done and released before the exam, but I have had to take some urgent leave part of yesterday and today, and have only just been able to find someone else to take over the remaining mar...
"Merit" is a deliberately general term that refers to anything good or positive about the technique in question. Basically you should be talking about and comparing what makes different techniques good and why you would want to use them.
Gozz
Hi,
Can someone explain what the "Discuss merits of multiple techniques" mean. Does it mean talking about the key points of what makes that techniques good or does it mean how well it does due to its simplicity or complexity. Just need a bit of clari...
Just be honest. You investigated that idea, but were not able to get it working. So you are unable to evaluate it, but you suspect it would perform better if you had been able to implement it. That's fine.
Your report should be evidence of your proble...
If we tried making an implementation for our agent with an algorithm we know is superior but we fail to do so and go back to a more naive but working algorithm, how will we explain this in our report.
My question is how will I convince that my strateg...
ANONYMOUS wrote
The requirement is deliberately non-specific.
The objective of your agent is clear To win the game as much as possible.
To do a good job of investigating this problem and developing an agent to solve it, you can't just take a guess, im...
Hello,
The game rules states voting occurs publically so I'm assuming I can get access to who voted for and against certain missions?
The vote outcome() function which has "votes" as a parameter states that "votes" is a dict that maps player indexes to...
When you say we are meant to assess the performance of our agent, do you mean we have to create tests ourselves as well, or are we also meant to create several different agents and compare it to ours, and provide graphs, stats etc in the report? IS t...
Remember that the testing code provided is just a simple tournament boiling it down to a single empirically-measured number.
In this case, what it seems really happened is that the SatisfactoryAgent lucked out and got an anomalously high proportion of...
Hello,
I am wondering if it's possible for our agent to determine which players voted yes no on a mission because I feel this could be valuable info. I know it is determined here in the run method of the Game class votes for
Is there a way we can use ...
Hello, my agent was getting rank 1 consistently, but sometimes it got the second rank; when I investigated the cause, I found this on the leaderboard.
LEADERBOARD AFTER 1000 GAMES
Resistance Wins 268, Spy Wins 732, Resistance Win Rate 0.2680
1 Sati...
ANONYMOUS wrote
The measured win rate converges to the expected win rate as more samples are taken. The expected win rate is the intrinsic true value to which it converges. We will take a reasonable statistical sample. If your agent learns more an it...
I believe this issue happens regardless of that assumption. The expected winrate converges to its true value as more runs are done, so in the initial 250 game sample it is difficult to properly distinguish whether your agent would outperform other ag...
ANONYMOUS wrote
As has been addressed before, your agent should not assume it remains between games. To be considered to consistently outperform another agent, then your agent, when dropped into an identical random situation as the other agent, shoul...
I saw on LMS that it said the project has now been extended to 17th October. I want to confirm if this is true, as in this help page it doesn t seem to mention that anywhere here. Thanks.
I have implemented a learning agent and my agent only wins if more than 250 games are done; if it's less than that, the satisfactory agent wins.
If I run 10000 games in the tournament, my agents will lose the first 250 but win the rest of the 9750 ga...
Yes. All games in simulation will adhere to the rules of the game as specified, including that it says "5-10 players".
Team sizes and required betrayals have not even been specified for outside this range.
ANONYMOUS wrote
We do intend to run more samples when assessing your submissions, but 1000 games is still a lot, so if your agent is not consistently winning with 1000 games, it is probably a close enough thing that it's not "consistent".
So submittin...
ANONYMOUS wrote
No, you should not assume that your agent will survive between games. The testing code provided is not exactly the same as how your code will be assessed, and game outcome is provided so your agents as you are developing them can kn...
Hi,
I was wondering what is meant by "consistently outperforms" when marking?
For example, my current (not final) agent beats the satisfactory agent consistently every time over the long term when I run tournaments of size 10,000 or 100,000, but in th...
I've noticed that the agent seems to persist throughout the tournament, since it is only created once at the start. This means that it could remember things between games in the tournament.
When the projects are marked, are they tested using the same ...
We have been alerted to an error in the testing code provided as part of the project.
This error has been corrected and the deadline has been extended by 7 days to 2024-10-17.
Please see the Project page on LMS for details.
ANONYMOUS wrote
Short answer This implementation detail is irrelevant to your task, and you should just ignore it.
Long answer
I did not write this code, but based on what it is doing this is how it is picking the agents to use in each game. A game c...
in the run tournament.py code we have
generate agent objects for use in games
number of duplicates math.ceil(10 len(agent classes))
for agent cls in agent classes
for i in range(number of duplicates)
agent pool.append(create agent(age...
ANONYMOUS wrote
Absolutely.
Some students seem to have hyper-focused on the warning in the project and misinterpreted it. It says
WARNING The reference agents BasicAgent and SatisfactoryAgent have been provided to enable you to assess your code, but ...
Hey, if we wanted to try to make some kind of learning agent are we allowed to use the run game run tournament code. I intuitively want to think we can, but just wanted to make sure.
Hi,
For future reference. Please make a new thread for a new topic such as this, rather than extending an old one.
Your agent will play games as both spy and loyalist. Your agent's win rate is what is being assessed. It would not make any sense for an ...
Hi, I would like to clarify about your rubric stating "Consistently outperforms hidden reference agent", and I have assessed the code of "random agent.py", where there is a "def is spy(self)", do you expect "spies to outperforms the resistance, highe...
ANONYMOUS wrote
You are good to start now. As the project description says you are expected to research the problem and develop a solution. This is a third-level unit with relatively open-ended assessment. You likely will be able to reasonably usin...
ANONYMOUS wrote
The testing code only supports Unix systems, not Windows. If you do not yet already have a working Unix setup, I would recommend that you use Windows Subsystem for Linux (WSL) for its simplicity of setup on Windows.
This is because in ...
Just wanted to ask, in reference to project
how many more lectures until we have enough knowledge to sufficiently compare the techniques that can be used? or
are we supposed to research techniques? or
are we good to start now?
I feel we've literal...
Hi, I tried running the run game file, which gives me these errors. I think it may be a problem in the test files.
found agent JassiAgent class 'agents.Jassi agent.JassiAgent'
found agent BasicAgent class 'agents.basic agent.BasicAgent'
found age...
I encourage you to begin by playing some games or watching recordings of people playing to make sure you are comfortable with the rules and mechanics. A quick search of youtube surfaced this (https youtu.be g QRczGzXqw)
Understood thanks. I was not attempting to reverse engineer a solution from the provided code, rather just trying to get a gauge on how to approach a problem of this nature. It's a little daunting and I'm not sure where to begin.
But I'll avoid readin...
ANONYMOUS wrote
Hi,
Per the tutorial and the warning in the project spec, there is no reason for you to read or understand BasicAgent and SatisfactoryAgent, and I (softly) discourage you from doing so.
Specifically, you are implicitly and explicitly fo...
Hi all,
I'm trying to understand the code for the satisfactory agent and I'm confused by the is spy() method. According to the rules of the game, only spies can know who other spies are.
However, in the provided code, we are allowed to pass in p...