The 64-year-old talent manager insisted the "Lemonade" hitmaker hasn't cut him out of her life, after he apparently cheated on her mother Tina and was fired as her manager in 2011, reported Female First.
Last month, Matthew was pictured attending Beyonce's Houston concert during her Formation World Tour.
Talking about the photos, he said, "Unfortunately the media got it wrong - they tried to portray it like it's the first time we've seen each other. They even got all the photos all messed up and confused.
Mathew added he sees more of his family than people seem to believe but he doesn't feel the need to alert the media every time they meet up because ti is "nobody's business".
"Nobody's gonna call and say, 'Hey! Today I was with Beyonce!' That wasn't my first time seeing Beyonce in years. It's nobody's business when I see my kids or my grandkids!