There are a lot of people at my church that wear black t-shirts or black long sleeve t-shirts and black pants - either jeans or dockers to allow themselves to not have to concentrate on clothes. It seems to work very well for them. I don't know if that fits what you are needing in your worship, but maybe it's a suggestion that might help.
I hate thinking about clothes. . . absolutely hate it. If I could go to church in a sack, I'd do it in a heartbeat. Not because I'm lazy, but because it really is disconcerting what the latest 'fad' is, how people are judged by what they wear, etc. Life is more than clothes - people are totally worth more than clothes.
I hope His mercy and wisdom shows you the way you should go - as this seems to be very important to you. And if His will is that you wear a robe - that you would have the courage and fortitude to do so. It's His will that's important.