Well it can mean that ... however metaphorically the adversary or accuser is our conscience.
From Abba Isaiah of Scetis:
Dear friends, let us stand with godly fear, keeping and maintaining the practice of the virtues, not presenting any obstacles to our conscience, but watching ourselves with godly fear, until it, too, is freed with us, in order that we are united with it, and so that it may become our guardian, showing us everything that we must cut off. If we do not obey our conscience, than it will resign from us and abandon us to fall into the hands of our enemy who will no longer take pity on us. Just as our Lord has taught us, “Come to terms quickly with your accuser while you are on the way [to court] with him, or your accuser may hand you over to the judge, and the judge to the guard, and you will be thrown into prison. Truly I tell you, you will never get out until you have paid the last penny.” they describe the conscience as an accuser inasmuch as it opposes us whenever we want to fulfill our fleshly desires, and, if we do not listen to it, our conscience hands us over to the enemy.
This is why Hosea mourned Ephrem saying, “Ephrem is an oppressor, he tramples on justiceGÃƒÆ’Ã¢â‚¬Â¡Ãƒâ€šÃ‚Âª calling on Egypt, turning by force to Assyria.” Now Egypt is the heart, seeking to fulfill its own fleshly desires. As for going by force to Assyria, this means that whether we want to, or not, we serve the enemy i.e. the habitual submission to sin. Let us, then, dear friends, watch out, so as not to fall into the hands of our fleshly desires, nor to be captured and let by force into Assyria, nor to hear the following bitter works: “The king of Assyria (i.e. the devil) came to the land of Israel (our heart or mind) and carried away Ephrem and Israel to Assyria. He placed them in Halah on the Habor, the river of Gozan, and they are there to this day. Then the King of Assyria sent people from his own nation and made them live in the land of Israel (the demonic or passionate desires/thoughts), and each of them made an idol and worshiped it, and, behold, they too are there to this day.” All this occurred to Ephrem: “he was oppressed by his enemy and crushed in judgment.”
So, brothers, you now know what happens to those who follow their evil desires and trample down their own conscience. Let us not envy them, friends, but let us envy all the saints who did not obey sin until death, preferring to obey, rather, their holy conscience and inherit the heavenly kingdom. Each of them perfected in purity in their own generation, and their names cannot be extinguished for all future generation.