To follow up...
I did a full vacuum analyze on both tables and re-ran the query. Samestory. I ended the query after eight minutes.