Marriage to someone who does not believe what you believe can be problematic. Different religion, different faith, different ideologies, different principles in life and different concept about the word of God in the Bible can stress marriage and end it. When the conflict and arguments becomes too much, separation and divorce usually follow. This is why it is advisable to marry someone of the same faith and who believe what you believe about God and His Word.
Being equally yoked is as essential to marriage as yeast and eggs are to making a cake. You can proceed without those ingredient but you will be deeply disappointed in the results because it won't look or taste at all like what you imagined.
Do not quit your marriage because you don't believe the same thing and because of the conflicts arising from it. Determine to be a good example of your beliefs. Let your partner see Jesus in you and get to meet Him and be changed. Stop arguing and showing by example. Be gentle and meek. Love more, for love never fails. Be patient and give God time to work while you are living the life of God.