Yes, as Carl Sagan used to say, “Extraordinary claims require extraordinary proof”.

Still, there are things that are probably not provable, yet are still true. There is enough evidence to suggest that we have probably seen alien craft, although we cannot know for sure, as you say. So perhaps the right attitude is, “We think aliens have visited us — we certainly would not say that they have not — but we don’t know for sure”?