How is it that Canadians tolerate "inspections" of their home before they even have either a licence or a firearm? Good lord folks, there is no lawful authority for this. If the Ontario CFO insists, take him to court, on a criminal charge, and get him convicted of abusing his lawful authority.
There is a whole industry out there for competent trial lawyers warding off the excesses of CFO's. Too bad we did not have an NRA to pay them.
To the OP, unless hubby has something unsavory in his past, there is no reason to be stopped by police, nor any reason to let them into your home. Yes, the CFO can arrange an inspection of your firearm storage, by appointment, at mutually reasonable convenience. Which means "Not right now, officer, I'm going out." but doesn't mean - "Come back next year, I might be home." It means, "Next Tuesday at 10 AM would be convenient. Does that work for you?" "No? How about Tuesday at 2PM?"
And yeah, to my experience the cops do hassle some folks. Apparently some folks keep showing upon the cops' radar literally and figuratively. Those folks, if licenced gun owners, would be exremely well advised to follow the gun transport and storage regulations to an extraordinary degree of precision. But us normal folks generally get by just obeying our ludicrous laws. Empty 'em all, lock the ones that need to be locked, put the restricted and prohibs in a locked box, all of 'em in a safe, have the ight papers, in proper order, (expired anything is not good) and you're good to go.