This is one of the hardest places to be, and nobody can make this decision for you. That is not a dodge, it is just the truth.
When multiple people in your life, people who have direct experience with him, are telling you the same thing, that is worth sitting with seriously. They are not all wrong and they are not all coming from a bad place. People who have been on the receiving end of how someone treats others are giving you information. The question is whether you are willing to hear it.
At the same time, love is real and it does not just turn off because someone tells you it should. What you feel is valid. The issue is not whether you love him. The issue is whether the relationship is good for you and whether he treats you the way you deserve to be treated.
Here is what I have seen more times than I can count. People already know the answer before they ask the question. The fact that you are lost and searching for guidance usually means some part of you already sees what others are seeing, and the fear is not about him. It is about what comes after. The unknown. Starting over. Being alone. Those fears are real but they are not reasons to stay in something that is hurting you.
Have faith in yourself. You are stronger than you think, and a future built on your own terms is worth more than a relationship that everyone around you is warning you about.
Whatever you decide, make sure it is a decision you are making for yourself, not one you are making out of fear.