I know that this reading is one of the foundational arguments for Catholic priests to remain celibate, and I find it either flawed or lacking context. In my personal experience, my wife has actually helped me be closer to God. As a partner in life, she has helped focus my belief, and has helped to steer me back when I stray.
Now, I am not saying that such is true for all marriages, certainly there are some relationships which detract one's faith or beliefs. Perhaps it was those sorts of relationships that Paul was referencing. However, I certainly know many people who develop a stronger faith because of their marriage, not in spite of it. I am certainly grateful to be in one of those marriages.