If I may, I got an instance once, where table with bytea field was
pretty slow. Turned out, that queries modified everything apart from
bytea bit.
moving it to separate table actually helped performance.
But that only will happen providing that you have the
bytea/text/whatever that won't change, once inserted.