I came back to say no. Confederate statues looks good on its own, just like most of us can't paint like Hitler. Hitler was an evil dictator, but that does not make his art worse than other people who dropped out of art college. Confederate monuments celebrate people that fought for an outdated cause, but that does not make their statues worse than Union generals standing in similar places.
Art does not represent its artist or whatever it is trying to portray. If it looks good it is good. An artist, however, can have their art as a part of them. That is why we also consider Hitler a decent painter, even if we also consider him as a genocidal racist.
Confederate monuments look not worse than other statues, as a result, there is no clear reason why they should be toppled. Although, if everyone on the streets say monuments about bad people is not art, then I suppose removal is the thing to do. For my personal opinion, for the effort and quality of the statues of most of them, I would say they are decent enough to be kept especially since similar ones are intact.