Do what you think is best for you. If you can prove that you have a stable family, and a good support network, and that you're either finishing school or working, the courts will lean in your favor. Keep ALL documented proof of his threats to remove your child from you, make recordings if you have to. All this will help you in court, sweetheart. Feel free to message me if you need too. I got pregnant at 18, married at 19, second son at 20(almost 21) and getting divorced at 24.
It helps knowing someone else has been there and gotten through it.
Good luck.