Black Powder is not nearly as dangerous as some would have you believe. It will not cause an explosion if you drop a bottle of it, or your car gets whacked in an accident etc. And the myths about guys setting it off by being a little too hard with the ramrod are just that - myth's.
I store my black powder with my smokeless powder in the house in a steel cabinet in it's original containers - no issue ever.
If I'm going out hunting I carry it in speed loaders (four or five charges). If I'm going to the range the can goes in my daypack with everything else I'm carrying.
Yes, treat it with respect, but don't be afraid of it - it just isn't "that explosive"...
PS - I assume you are asking about "real black" - if you are referring to the subs (777, Pyrodex et al), those are not even considered explosives and the care and handling is far less restricted - you can treat/store them like loaded shotgun shells/center fire rounds)