From: | Rupesh Choudhary <rupesh(dot)7kumar(dot)rc(at)gmail(dot)com> |
---|---|
To: | pgsql-admin(at)postgresql(dot)org |
Subject: | |
Date: | 2016-06-14 16:27:20 |
Message-ID: | CAOd4mF=3QqCJPVKnnAdwZ6ZhW36dt7cZXvgPtH2pM2Dx2p5rEQ@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-admin |
Hi Team ,
We have been trying to insert data (batch inserts) using a JAVA app which
uses prepared statements with parameterized queries to insert data .We are
able to insert data with small batch size however when we increase the
batch size to a higher value data ingestion fails . We are using pgbouncer
for connection pooling on database side wich is running in session mode
and server_reset_query set to "DISCARD ALL" . Please suggest the how can
we bulk load data with higher batch size .Below the error logs that we are
getting from the application end.
Below are the logs from application :-
*2016-06-07T11:33:04.50-0700 [App/2]* OUT at
org.postgresql.jdbc2.AbstractJdbc2Statement.executeBatch(AbstractJdbc2Statement.java:2959)
~[postgresql-9.4-1205-jdbc41.jar!/:9.4]
*2016-06-07T11:33:04.50-0700 [App/2]* OUT at
com.exelon.drillinginfo.service.PdenDescService.createDrillingInfo(PdenDescService.java:337)
~[app/:na]
*2016-06-07T11:34:35.04-0700 [App/1]* OUT 2016-06-07 18:34:35.048
INFO 29 --- [io-64887-exec-1] c.e.d.service.PdenDescService :
Run id: 33842
*2016-06-07T11:34:35.05-0700 [App/1]* OUT 2016-06-07 18:34:35.051
INFO 29 --- [io-64887-exec-1] c.e.d.service.PdenDescService :
running inserts
********---------------------------------------------------------------***********
*2016-06-07T11:34:35.05-0700 [App/1]* OUT 2016-06-07 18:34:35.058
INFO 29 --- [io-64887-exec-1] c.e.d.service.PdenDescService :
running inserts
********---------------------------------------------------------------***********
*2016-06-07T11:34:35.06-0700 [App/1]* ERR
org.postgresql.util.PSQLException: ERROR: prepared statement "S_3" does not
exist
*2016-06-07T11:34:35.06-0700 [App/1]* ERR at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2182)
*2016-06-07T11:34:35.06-0700 [App/1]* ERR at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1911)
*2016-06-07T11:34:35.06-0700 [App/1]* ERR at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:338)
*2016-06-07T11:34:35.06-0700 [App/1]* ERR at
org.postgresql.jdbc2.AbstractJdbc2Statement.executeBatch(AbstractJdbc2Statement.java:2959)
*2016-06-07T11:34:35.06-0700 [App/1]* ERR at
com.exelon.drillinginfo.service.PdenDescService.createDrillingInfo(PdenDescService.java:337)
*2016-06-07T11:34:35.06-0700 [App/1]* ERR at
com.exelon.drillinginfo.service.PdenDescService$$FastClassBySpringCGLIB$$3080db7d.invoke(<generated>)
*2016-06-07T11:34:35.06-0700 [App/1]* ERR at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
Thanks & Regards,
Rupesh Choudhary
From | Date | Subject | |
---|---|---|---|
Next Message | Alvaro Herrera | 2016-06-14 17:31:50 | Re: MultiXactId xxxxxxxxx has not been created yet -- apparent wraparound |
Previous Message | Christian Castelli | 2016-06-14 12:20:50 | Re: [SELinux] How to configure it in RHEL 7? |