For me question is not 'what are you trying to avoid in your life?' The question is 'how do you want to live your life?' 'What makes you happy?' Personally I want to explore and know what is possible with this lifetime and share that - that is the example I want to set for my kids.
I try not to make decisions based on fear but on what I want and need to do. Sure there is risk/reward assessment and open eyed acknowledgement of the risks, with accompanying mitigation education, practice, mind-state, but the fear is not where I start. Though I'm not jumping off a cliff in a wingsuit so there are obvious limits.
All that being said the kid equation does affect my riding. I do not push it as hard and "try" to just enjoy the ride more than push the limits - which has to be an intentional mental thing for me because by nature I enjoy finding that limit and pushing my skills even if its at a 'reasonable' pace. Also a big part of it is just having the time and resources to ride as much as I'd like - it's harder to get motivated to go riding when there is
always something that I would be neglecting at the homefront. Which also means it's harder to schedule rides with other peeps. But having some time that I get to just do my own thing is critical for my mental state.
Come to think of it, since my last track day, for various reasons, I haven't really gone on a backroad ride... Yeah, never, ever ride on the track. It will ruin motorcycle riding for you. (unless you are single and have endless $ to burn ≠notme)

twofinger. Fuck I'm turning into a cliche
Though I am a daily commuter and benefits here for me clearly outweigh the risks. Being home predicably on time for dinner, after work/school activities, etc. critical for my homelife. Not to mention that daily I get a little piece of my mental back.
All that said, it's impossible not to acknowledge and give condolences for your brother. That would certainly factor in for me as well. As many others here have said, it is a decision you have to make for yourself. And something that deserves to have a clear understanding with your family about. Especially your wife and kid(s). Let them know why you need to do it, why you are intentionally doing it, and how you are actively mitigating the risks. But some on here are so damn fatalistic. Motorcycles≠Destruction. Keep it sane and

.