Hmmm... what would an FTL-traveling object look like through a telescope?
If it emitted any waves (EM, gravitational) while it moved, I guess we'd see something appear and then a trail of waves approaching that location for (presumably) a very long time after that.
Or we'd see fast-moving lensing from a warp bubble.
Or, maybe things would simply seem to appear and disappear.
No natural phenomena we know of work this way, but I guess you're right that an FTL space ship would be pretty hard to spot even relatively close by. Even a whole planet moving FTL wouldn't be easy to spot.
On the other hand, based on what we know about physics, if an FTL craft started moving FTL anywhere near earth, the release of energy would have to be tremendous and impossible to miss. So I think we can at least rule out any FTL aliens visiting earth with means of propulsion that are compatible with GR.