> Something else to consider... databases love doing bulk operations. It
> might be useful to load prospective data into a temporary table, and
> then do as many operations as you can locally (ie: within the database)
> on that table, hopefully eleminating as many candidate rows as possible
> along the way.
I wish this would work... it was definitely something I considered early on
in the project. Even thinking of explaining why it won't work is giving me a
headache...
But I sure wish it would.