Just say with sincerity (if you fail) that while you may well have inhaled smoke passively, you yourself do not smoke illegal drugs. Be firm, be certain, be almost angry that they might suspect otherwise.

I am pretty certain that the results of a drugs test cannot be held against you either legally or by a future employer. So don't sweat it.