YOU wouldn't get in trouble regardless. It is the responsibility of the person with the conviction to avoid firearms that they know of or could reasonably believe are present. As long as you don't open carry or let them 'hold' your gun you will be fine. They can't be expected to 'know' you have a piece on you so they are in the clear as well. Unless you are LEO, then it would be reasonable to believe that you are armed and may present a conflict.