Is having a male friend after relationship is bad?

We've known each other for a year, and we both have mutual feelings for each other (it was love at first sight). This year, we opened up and started dating. We want to marry, have kids, and grow old together. He is the best man I've ever known; he lacks nothing. Even our families have met during a family function. All his family members know about me except for his father, and I haven't told anyone in my family. I have a male friend, and we have known each other for a decade now; we are more like family friends. He was with me through all my ups and downs. He has no feelings for me; he just cares about me as any friend does. Now my boyfriend is getting irritated that my friend is talking to me or visiting my home. Here are the arguments arising. His words are quite harsh for me to digest. I'm suffering from anxiety and panic attacks. This issue has disturbed my mental health so much. I'm unable to eat or sleep. I'm constantly trying to make him understand, but he doesn't. He wants me to set boundaries with my friend (he doesn't want me to cut ties with him completely). He wants to be involved in my family issues instead of my friend. I can do anything for him, and I can live without my friend because even my friend has to marry and live away from me. But my friend has been like family. How can he expect me to do it so suddenly, especially when my family doesn't know my boyfriend as my boyfriend?