We are black sheep. We are rejected by many of the people and organizations that socialized us. Those of us who are public are accused of being imperialist tools of the West, of getting paychecks from Zionist organizations, of being part of a larger agenda of globalization and other such ludicrous nonsense.
Also, and this is sickening, horrifying, the women among us are often subjected to the crudest forms of misogynistic threats of rape and violence for daring to advocate for human rights. Our causes are routinely reduced to a desire to legalize sin and fornication and lewdness (all imagined evils) and any humanistic values we endorse are brushed aside as a mere front.
Many of us are also in hiding, and bear significant social and material costs for being what we are. Apostasy bears a great social burden in Muslim societies. At the very least, we are shunned, outcast, disowned if we were to go public. Others of us simply cannot. We live in places with such inescapable codes of living that we are not free to choose a nonreligious life and must continue to practice rituals of faith as though we believed, and are thus forced to suppress ourselves, and live a lie.