RE: BUG #17059: postgresql 13 version problem related to query.

Dear Team,

Please find EXPLAIN ANALYZE details of Query:

Postgresql-12 :

QUERY PLAN

-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------
Limit (cost=87069.03..87069.21 rows=5 width=346) (actual time=1202.073..1202.090 rows=5 loops=1)
-> Unique (cost=87069.03..88023.18 rows=25444 width=346) (actual time=1202.071..1202.086 rows=5 loops=1)
-> Sort (cost=87069.03..87132.64 rows=25444 width=346) (actual time=1202.070..1202.070 rows=5 loops=1)
Sort Key: orderdeliverynote.date DESC, "Order".order_no, "Order".retailer_code, "Order".order_status, orderdeliverynote.assigned_to_username, orderdeliv
erynote.assigned_to_role, orderdeliverynote.delivery_note_no, orderdeliverynote.total_value, leave.date, leave.username, retailerlist.retailer_outlet, dse_user.first_n
ame, "Order".parent_order_no, (CASE WHEN (("Order".order_status)::text = 'dispatched'::text) THEN 3 WHEN (("Order".order_status)::text = 'partially dispatched'::text)
THEN 3 WHEN (("Order".order_status)::text = 'acknowledgement pending'::text) THEN 4 WHEN (("Order".order_status)::text = 'delivered'::text) THEN 2 WHEN (("Order".order
_status)::text = 'dn pending'::text) THEN 1 ELSE 0 END)
Sort Method: quicksort Memory: 7922kB
-> HashAggregate (cost=84634.67..85207.16 rows=25444 width=346) (actual time=1077.387..1097.135 rows=26930 loops=1)
Group Key: orderdeliverynote.date, "Order".order_no, "Order".retailer_code, "Order".order_status, orderdeliverynote.assigned_to_username, orderdel
iverynote.assigned_to_role, orderdeliverynote.delivery_note_no, orderdeliverynote.total_value, leave.date, leave.username, retailerlist.retailer_outlet, dse_user.first
_name, "Order".parent_order_no
-> Merge Join (cost=77821.29..83807.74 rows=25444 width=342) (actual time=779.854..1043.354 rows=26930 loops=1)
Merge Cond: ((retailerlist.retailer_code)::text = ("Order".retailer_code)::text)
-> Index Scan using retailer_code_12390127_idx on tretailer_mst retailerlist (cost=0.42..5468.67 rows=146923 width=25) (actual time=0.018.
.180.502 rows=144211 loops=1)
-> Sort (cost=77651.75..77708.45 rows=22681 width=324) (actual time=772.782..786.401 rows=52378 loops=1)
Sort Key: "Order".retailer_code
Sort Method: quicksort Memory: 15449kB
-> Nested Loop Left Join (cost=20331.25..76010.87 rows=22681 width=324) (actual time=432.162..623.429 rows=52378 loops=1)
Join Filter: (("Order".order_no)::text = (orderdeliverynote.order_no)::text)
Filter: ((("Order".order_status)::text = ANY ('{delivered,"dn pending","acknowledgement pending","partially delivered"}'::text[]
)) OR (((("Order".order_status)::text = 'dispatched'::text) OR (("Order".order_status)::text = 'partially dispatched'::text)) AND (leave.date = '2021-06-15'::date)))
-> Merge Join (cost=20330.82..21903.80 rows=25657 width=338) (actual time=431.541..519.748 rows=26189 loops=1)
Merge Cond: ((dse_user.username)::text = (orderdeliverynote.assigned_to_username)::text)
-> Index Scan using username_12891 on tuser_mst dse_user (cost=0.42..6175.73 rows=320827 width=19) (actual time=0.014..4
1.418 rows=54892 loops=1)
-> Sort (cost=20329.65..20393.79 rows=25657 width=326) (actual time=429.095..434.239 rows=26189 loops=1)
Sort Key: orderdeliverynote.assigned_to_username
Sort Method: quicksort Memory: 7725kB
-> Gather (cost=1000.99..18450.65 rows=25657 width=326) (actual time=1.165..394.950 rows=26189 loops=1)
Workers Planned: 1
Workers Launched: 1
-> Nested Loop (cost=0.99..14884.95 rows=15092 width=326) (actual time=0.162..382.671 rows=13094 loops=2)
-> Parallel Index Scan using dbr_code_128932 on torder "Order" (cost=0.43..3219.36 rows=15713 width=25
9) (actual time=0.075..60.880 rows=13094 loops=2)
Index Cond: ((dbr_code)::text = '304717'::text)
Filter: (((order_status)::text = ANY ('{delivered,"dn pending","acknowledgement pending","partiall
y delivered"}'::text[])) OR ((order_status)::text = 'dispatched'::text) OR ((order_status)::text = 'partially dispatched'::text))
Rows Removed by Filter: 2134
-> Index Scan using order_no_128903 on torder_delivery_note orderdeliverynote (cost=0.56..0.73 rows=1
width=67) (actual time=0.023..0.023 rows=1 loops=26189)
Index Cond: ((order_no)::text = ("Order".order_no)::text)
-> Materialize (cost=0.42..2600.82 rows=73 width=10) (actual time=0.000..0.002 rows=2 loops=26189)
-> Index Scan using role_1239084_idx on tleave leave (cost=0.42..2600.45 rows=73 width=10) (actual time=0.600..54.705 ro
ws=2 loops=1)
Index Cond: ((role)::text = 'DB'::text)
Filter: (date = '2021-06-15'::date)
Rows Removed by Filter: 81185
Planning Time: 4.242 ms
Execution Time: 1204.463 ms
(39 rows)

Postgresql-13

QUERY PLAN

-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------
Limit (cost=504.66..504.70 rows=1 width=1592) (actual time=1365687.289..1365687.314 rows=5 loops=1)
-> Unique (cost=504.66..504.70 rows=1 width=1592) (actual time=1365687.287..1365687.310 rows=5 loops=1)
-> Sort (cost=504.66..504.67 rows=1 width=1592) (actual time=1365687.279..1365687.288 rows=5 loops=1)
Sort Key: orderdeliverynote.date DESC, "Order".order_no, "Order".retailer_code, "Order".order_status, orderdeliverynote.assigned_to_username, orderdeliv
erynote.assigned_to_role, orderdeliverynote.delivery_note_no, orderdeliverynote.total_value, leave.date, leave.username, retailerlist.retailer_outlet, dse_user.first_n
ame, "Order".parent_order_no, (CASE WHEN (("Order".order_status)::text = 'dispatched'::text) THEN 3 WHEN (("Order".order_status)::text = 'partially dispatched'::text)
THEN 3 WHEN (("Order".order_status)::text = 'acknowledgement pending'::text) THEN 4 WHEN (("Order".order_status)::text = 'delivered'::text) THEN 2 WHEN (("Order".order
_status)::text = 'dn pending'::text) THEN 1 ELSE 0 END)
Sort Method: quicksort Memory: 11262kB
-> Group (cost=504.60..504.65 rows=1 width=1592) (actual time=1365623.456..1365652.824 rows=36615 loops=1)
Group Key: orderdeliverynote.date, "Order".order_no, "Order".retailer_code, "Order".order_status, orderdeliverynote.assigned_to_username, orderdel
iverynote.assigned_to_role, orderdeliverynote.delivery_note_no, orderdeliverynote.total_value, leave.date, leave.username, retailerlist.retailer_outlet, dse_user.first
_name, "Order".parent_order_no
-> Sort (cost=504.60..504.61 rows=1 width=1588) (actual time=1365623.429..1365629.121 rows=36615 loops=1)
Sort Key: orderdeliverynote.date DESC, "Order".order_no, "Order".retailer_code, "Order".order_status, orderdeliverynote.assigned_to_username
, orderdeliverynote.assigned_to_role, orderdeliverynote.delivery_note_no, orderdeliverynote.total_value, leave.date, leave.username, retailerlist.retailer_outlet, dse_
user.first_name, "Order".parent_order_no
Sort Method: quicksort Memory: 11259kB
-> Nested Loop (cost=78.24..504.59 rows=1 width=1588) (actual time=5822.819..1365512.599 rows=36615 loops=1)
-> Nested Loop Left Join (cost=77.81..504.14 rows=1 width=1576) (actual time=5822.790..1365306.549 rows=36615 loops=1)
Join Filter: (("Order".order_no)::text = (orderdeliverynote.order_no)::text)
Filter: ((("Order".order_status)::text = ANY ('{delivered,"dn pending","acknowledgement pending","partially delivered"}'::text[]
)) OR (((("Order".order_status)::text = 'dispatched'::text) OR (("Order".order_status)::text = 'partially dispatched'::text)) AND (leave.date = '2021-06-15'::date)))
-> Nested Loop (cost=77.40..454.63 rows=2 width=1622) (actual time=5776.507..1365239.064 rows=36615 loops=1)
-> Nested Loop (cost=76.84..79.44 rows=1 width=1198) (actual time=5776.467..1364698.436 rows=36615 loops=1)
-> Index Scan using retailer_code_12390127_idx on tretailer_mst retailerlist (cost=0.38..0.59 rows=1 width=684) (a
ctual time=0.028..928.347 rows=221068 loops=1)
-> Bitmap Heap Scan on torder "Order" (cost=76.47..78.84 rows=1 width=682) (actual time=6.163..6.164 rows=0 loops=
221068)
Recheck Cond: (((dbr_code)::text = '304717'::text) AND ((retailer_code)::text = (retailerlist.retailer_code)::
text))
Filter: (((order_status)::text = ANY ('{delivered,"dn pending","acknowledgement pending","partially delivered"
}'::text[])) OR ((order_status)::text = 'dispatched'::text) OR ((order_status)::text = 'partially dispatched'::text))
Rows Removed by Filter: 0
Heap Blocks: exact=41645
-> BitmapAnd (cost=76.47..76.47 rows=19 width=0) (actual time=6.027..6.027 rows=0 loops=221068)
-> Bitmap Index Scan on dbr_code_128932 (cost=0.00..37.89 rows=3756 width=0) (actual time=5.054..5.054
rows=42741 loops=221068)
Index Cond: ((dbr_code)::text = '304717'::text)
-> Bitmap Index Scan on retailer_code_128923 (cost=0.00..38.29 rows=3756 width=0) (actual time=0.014..
0.014 rows=28 loops=221068)
Index Cond: ((retailer_code)::text = (retailerlist.retailer_code)::text)
-> Index Scan using order_no_128903 on torder_delivery_note orderdeliverynote (cost=0.55..307.20 rows=6799 width=424) (a
ctual time=0.014..0.014 rows=1 loops=36615)
Index Cond: ((order_no)::text = ("Order".order_no)::text)
-> Materialize (cost=0.42..49.41 rows=2 width=172) (actual time=0.001..0.001 rows=0 loops=36615)
-> Index Scan using role_1239084_idx on tleave leave (cost=0.42..49.40 rows=2 width=172) (actual time=46.270..46.270 row
s=0 loops=1)
Index Cond: ((role)::text = 'DB'::text)
Filter: (date = '2021-06-15'::date)
Rows Removed by Filter: 144656
-> Index Scan using username_12891 on tuser_mst dse_user (cost=0.42..0.44 rows=1 width=19) (actual time=0.005..0.005 rows=1 loops=36
615)
Index Cond: ((username)::text = (orderdeliverynote.assigned_to_username)::text)
Planning Time: 2.019 ms
Execution Time: 1365688.026 ms
(38 rows)

Query:

EXPLAIN (ANALYZE) select DISTINCT("Order".order_no),"Order".retailer_code,"Order".order_status,OrderDeliveryNote.assigned_to_username, OrderDeliveryNote.assigned_to_role,
OrderDeliveryNote.delivery_note_no, OrderDeliveryNote.date, OrderDeliveryNote.total_value,
leave.date, leave.username, RetailerList.retailer_outlet, DSE_user.first_name, "Order".parent_order_no,
CASE WHEN "Order"."order_status"='dispatched' then 3
WHEN "Order"."order_status"='partially dispatched' then 3
WHEN "Order"."order_status"='acknowledgement pending' then 4
WHEN "Order"."order_status"='delivered' then 2
WHEN "Order"."order_status"='dn pending' then 1 ELSE 0 END AS "Order__actionable"
from torder "Order"
join tretailer_mst as RetailerList on "Order".retailer_code=RetailerList.retailer_code
join torder_delivery_note as OrderDeliveryNote on "Order".order_no=OrderDeliveryNote.order_no
left join tleave leave on "Order".order_no=OrderDeliveryNote.order_no and leave.date='2021-06-15' and leave.role='DB'
join tuser_mst DSE_user on OrderDeliveryNote.assigned_to_username=DSE_user.username
where dbr_code='304717' AND (order_status IN (('delivered'),('dn pending'),('acknowledgement pending'),
('partially delivered')) or ((order_status = 'dispatched' or order_status = 'partially dispatched') and leave.date = '2021-06-15'))
group by "Order".order_no ,"Order".retailer_code,"Order".order_status,OrderDeliveryNote.assigned_to_username, OrderDeliveryNote.assigned_to_role,
OrderDeliveryNote.delivery_note_no, OrderDeliveryNote.date, OrderDeliveryNote.total_value,
leave.date, leave.username, RetailerList.retailer_outlet, DSE_user.first_name, "Order".parent_order_no
order by OrderDeliveryNote.date desc limit 5;

Regards,
Ram Pratap.

From: Pavel Stehule [mailto:pavel(dot)stehule(at)gmail(dot)com]
Sent: 16 June 2021 00:28
To: Ram Pratap Maurya; PostgreSQL mailing lists
Subject: Re: BUG #17059: postgresql 13 version problem related to query.

út 15. 6. 2021 v 20:53 odesílatel PG Bug reporting form <noreply(at)postgresql(dot)org<mailto:noreply(at)postgresql(dot)org>> napsal:
The following bug has been logged on the website:

Bug reference: 17059
Logged by: Ram Pratatp maurya
Email address: ram(dot)maurya(at)lavainternational(dot)in<mailto:ram(dot)maurya(at)lavainternational(dot)in>
PostgreSQL version: 13.0
Operating system: RHEL 8.3
Description:

Hi team,

I am facing problem related to query.

I have two DB server one is running on postgres12 (RHEL 6) and second is
running on postgresql -13 (RHEL 8.3).
Server H/W configuration is same and postgresql.conf file configuration
parameter is also same.

When I am running below queary on server postgresql-12 data comes within 2
min and when I run this quear on postgresql-13 server its take 30 min
display result.

Can you please suggest any problem in postgresql-13.

Note : DB size of postgresql-12 is 242 GB (1 year old data) and DB size of
postgresql-12 is 350 GB.

.........................................................................................................................................................................................................
select
DISTINCT("Order".order_no),"Order".retailer_code,"Order".order_status,OrderDeliveryNote.assigned_to_username,
OrderDeliveryNote.assigned_to_role,
OrderDeliveryNote.delivery_note_no, OrderDeliveryNote.date,
OrderDeliveryNote.total_value,
leave.date, leave.username, RetailerList.retailer_outlet,
DSE_user.first_name, "Order".parent_order_no,
CASE WHEN "Order"."order_status"='dispatched' then 3
WHEN "Order"."order_status"='partially dispatched' then 3
WHEN "Order"."order_status"='acknowledgement pending' then 4
WHEN "Order"."order_status"='delivered' then 2
WHEN "Order"."order_status"='dn pending' then 1 ELSE 0 END AS
"Order__actionable"
from torder "Order"
join tretailer_mst as RetailerList on
"Order".retailer_code=RetailerList.retailer_code
join torder_delivery_note as OrderDeliveryNote on
"Order".order_no=OrderDeliveryNote.order_no
left join tleave leave on "Order".order_no=OrderDeliveryNote.order_no and
leave.date='2021-06-15' and leave.role='DB'
join tuser_mst DSE_user on
OrderDeliveryNote.assigned_to_username=DSE_user.username
where dbr_code='304717' AND (order_status IN (('delivered'),('dn
pending'),('acknowledgement pending'),
('partially delivered')) or ((order_status = 'dispatched' or order_status =
'partially dispatched') and leave.date = '2021-06-15'))
group by "Order".order_no
,"Order".retailer_code,"Order".order_status,OrderDeliveryNote.assigned_to_username,
OrderDeliveryNote.assigned_to_role,
OrderDeliveryNote.delivery_note_no, OrderDeliveryNote.date,
OrderDeliveryNote.total_value,
leave.date, leave.username, RetailerList.retailer_outlet,
DSE_user.first_name, "Order".parent_order_no
order by OrderDeliveryNote.date desc limit 50;

please, send result of explain analyze for pg 12 and pg 13

https://wiki.postgresql.org/wiki/Slow_Query_Questions
https://explain.depesz.com/

Regards

Pavel