They are if you claimed that a statement must be true if someone doesn't sue those making the statement.
You've talked about circumstantial evidence, or guilt by association, neither of which hold any weight. Body language "experts" can only give an opinion, there's no scientific credibility to what they say. And has the FBI or any law enforcement agency requested an interview with him? To my knowledge there's nothing to cooperate with beyond tabloid speculation.
So I have nothing to substantiate claims against you, and you have nothing to substantiate claims against Prince Andrew!