It looks like I fixed my own problem :)
My problem was I had not downloaded DBD-Pg-0.93.tar.gz from CPAN. What Ihad downloaded was Postgres-1.4.tar.gz, which I thought was the DBD.