I'd prefer quality over quantity: don't let the perfect be the enemy of the good. If you keep going to a church where you don't want to be, you may leave the Orthodox Church altogether. For the most part, going to church is supposed to be a joyous experience. (Of course, since humans are involved, things are sometimes rocky, but you shoulder your way through, and the issues usually resolve themselves and return to normal.)
But if the situation is such that everyone in your family no longer wants to attend, and you dislike your priest and can't resolve it with him--heavens, if you're missing regular confession and communion--then you should go to some place where you're more comfortable. I'm sure others will disagree with me, but I don't think that getting to the point where you equate going to church with a negative experience is healthy for your spirituality. Unfortunately, some combinations of personalities just don't get along, and that's a fact of life.
Is there another Orthodox Church outside your usual jurisdiction that you might consider? The personalities of churches within the same jurisdiction are often quite different. If you have that option, I'd consider that first; you want to go to church as much as possible.