The theme of Scarlet Letter is social stigma and shame. On the one hand, Dimmesdale is ashamed, and on the other, there is Hester's public humiliation. The relationship between the two characters was not talked about, not even the circumstances that led to the pregnancy, so the affair never became part of the conspiracy.
More like this:
