I personally am not scandalized by this (like David, my family also has an icon in our bathroom), but again, I can understand how it might scandalize others.
We remove it when we have a visitor who might be scandalized by it. However make a point of making sure it is plain sight there if we have unchurched neighbors visiting. Yes, the Bible is a book separate from all others, yet it also intimidates many for reasons I do not pretend to understand. SOme of our neighbors are also intimidated by the fact we are Orthodox -- they see the Icons, crucifx and prayer ropeshear the word "Orthodox" and for some reason think we might be worse than crazed evangelicals. These things should not intimidate. We have many versions of the Bible in our Home...many different editions. Indeed I am more scandlaized by some of the language I see used in some of the more "modern" American Bibles.
For example Psalm 23 in the New American Bible approved by the Roman Catholic Church
"Even though I walk through a dark place....."
Where it should read,
"Yeah though I walk through the valley of the shadow of death..."
Some of these modern editions lose the beauty of the language and imagery in favor of being "more reader friendly" or even politically correct. Personally, I find this more scandalous than finding a non-blessed copy of the Bible in the reading rack in my "reading room" as my wife calls it. I only keep my version of the New American Bible because it is a study Bible with oodles of footnotes and referneces at the bottom of every page I sometimes find helpful when I am trying to use it as a teaching tool for my children. My kids also understand it better...but at about the age of ten they seem to develop an appreciation for the beauty of the language in other versions.