Stalker's Flurry isn't advantage
Stalker's Flurry isn't advantage, because it's an actual separate attack. The two features don't interact; Elusive provides no benefit against it (aside from possibly canceling actual advantage, if applicable).
As a note, even ignoring stuff like Elusive, Stalker's Flurry, despite the surface similarity to advantage, is different. It can stack with advantage, unlike actual advantage; if you have advantage on your first attack and miss anyway, you still get to attack again (for a total of three d20 rolls for something to hit, four if the condition granting you advantage persists for the second attack). It isn't canceled by disadvantage either, and is in fact more likely to trigger if you're suffering from disadvantage. And if an effect applies to only one attack roll, for whatever reason, the second attack granted on a miss will not benefit from it.
In short, don't think of Stalker's Flurry as advantage. Aside from a vague similarity on the resulting probabilities when you have neither advantage nor disadvantage, it's not the same thing at all.