Yes you can use external libraries. You can even use stable baselines for one of the agents if you could explain the working and give a thorough comparison of performance with your own implemented agent. In this case, your own implementation may not be as good as the algorithms in stable baselines. However, the point is to help you learn. Nevertheless, your own implementation should give reasonable performance.