Pregnant and father is dealing with his own demons...i think he is blowing me off...?

This past summer I had fallen for a married man. I never thought I had the heart (or lack of) to be so morally wrong. He was everything I had dreamed of or so I thought as a little girl. Even the things I would mention in my diarys growing up seemed to describe everything romantic thing he did for me. I fought it at first, and finally gave in. It was a huge secret, even from my best friend whom I told everything before. He seemed to feel the same way and before long his wife caught on. They are going through a divorce, although right now (5 mo. later) he seems to have a connection with her again I suspect. I'm not sure. His mother keeps in touch with me. And i have been often compared to his wife... she seems to love me yet still has a picture of those two on her mantel. Recently I relocated to California due to military orders and am over 5 mo. pregnant with his unborn child. He drove me halway and flew him. Since then i've felt neglected and abandoned by him. He went on a detachment and came home (to florida)...for a week he had been there and never once contacted me. He says he still hasn't found his phone which he lost Dec. 2nd and that he had no excuse for not calling me. I found out he had been home by talking with his mother and I quickly broke into tears. I, of course, thought he met someone new or is playing the field. He ured me through email it wasn't so and he was sorry for being so impersonal during this time he is taking to be a jerk (his words). What is that supposed to mean? Mentioned he got me a christmas gift, yet never called, txt, or wrote and I haven't heard from him in 4 days since that email. Should I believe he hasn't forgotten about me? Haven't talked to him in 2 weeks. Is he pushing me out of his life? He never met his father for his mother was in the same situation as me....on the road to being a single mom. After all this back and forth mess... him saying he loved me, telling his mother he was afraid for me leaving that I may find someone new... but he doesn't seem to be concerned any longer. What should I do? I don't know how to handle this. My heart is broken I do feel I love him, it's like i'm trying everything I can just to keep my mind off of him... I wish he were here and loved me still during my pregnancy. I'm fearful to try and contact him because I don't know if I will push him away. It's painstaking to be left in the dark and my obvious insecurites are getting the best of me. Does anyone have any advice?