Yes, that is one of the weirder superstitions people have about Christians. In fact, the Church made a point of having Bibles in as many churches as possible.
Catholic and Eastern Orthodox Christians disagree with many Protestant interpretations of the Bible, but they don't hate those interpretations. For example:
The Church recognizes that in many ways she is linked with those who, being baptized, are honored with the name of Christian, though they do not profess the faith in its entirety or do not preserve unity of communion with the successor of Peter. (14*) For there are many who honor Sacred Scripture, taking it as a norm of belief and a pattern of life, and who show a sincere zeal. They lovingly believe in God the Father Almighty and in Christ, the Son of God and Saviour. (15*) They are consecrated by baptism, in which they are united with Christ. They also recognize and accept other sacraments within their own Churches or ecclesiastical communities. Many of them rejoice in the episcopate, celebrate the Holy Eucharist and cultivate devotion toward the Virgin Mother of God.(16*) They also share with us in prayer and other spiritual benefits. Likewise we can say that in some real way they are joined with us in the Holy Spirit, for to them too He gives His gifts and graces whereby He is operative among them with His sanctifying power. Some indeed He has strengthened to the extent of the shedding of their blood.
From:
LUMEN GENTIUM
SOLEMNLY PROMULGATED BY HIS HOLINESS
POPE PAUL VI
ON NOVEMBER 21, 1964