There is no way to track which visitors haven't returned, the table only keeps track of first visit.
I can flag this as Under Consideration, but I can't say for sure at this time what amount of changes would be needed in order to implement this, so it may not get added as a result.