I'm not scared of him, so how do I stop flinching?

What you've described is common for people with a history of DV. Obviously sudden motions and raised voices are triggers for you. Your boyfriend can help by being mindful of his actions and the tone of his voice. And you can help yourself by seeking some counseling from a licensed mental health professional with a concentration in victimization.