Lets say you do something morally neutral such as buy a red car. Society is pro choice on owning red cars. But society would cease to be pro choice on red cars if the government offered to give them for free to low income people. If the government did that, the government would be picking a side and encouraging poor people to get red cars.
Similarly, pro choicers often want the government to stay out of the abortion business. However, they appear to be inconsistent with this idea because the majority of pro choicers (including Biden) want the government to pick a side on the abortion debate by giving women free abortions that want them. If you want a red car, you pay for it yourself, since the government doesn't have a stance on whether or not you get a red car. With the same logic, if you want an abortion, pay for it yourself. The government should not be giving free abortions to people paid for by the taxpayers, many of whom oppose abortion on moral or religious grounds. Just as I wouldn't force a Christian to fund a satanic temple (even though I think they should be allowed to exist), I wouldn't have a Christian who opposes abortion be forced to fund abortions, which they don't approve of. I want the amount of things people are legally forced to fund be minimal.