./analyze-benchmarks.py -i 'pg-src-17--.*' 'pg-src-16--.*' Best pg-src-17--.* better than pg-src-16--.* by 5.9 percents (9.06 < 9.63): pg_tpch.query1 Average pg-src-17--.* better than pg-src-16--.* by 5.1 percents (9.17 < 9.66): pg_tpch.query1 Best pg-src-17--.* better than pg-src-16--.* by 5.1 percents (2.82 < 2.97): pg_tpch.query3 Best pg-src-17--.* better than pg-src-16--.* by 6.2 percents (1.35 < 1.44): pg_tpch.query6 Average pg-src-17--.* better than pg-src-16--.* by 6.5 percents (1.35 < 1.44): pg_tpch.query6 Best pg-src-17--.* worse than pg-src-16--.* by 10.7 percents (0.93 > 0.84): pg_tpch.query9 Best pg-src-17--.* better than pg-src-16--.* by 5.4 percents (2.99 < 3.16): pg_tpch.query15 Average pg-src-17--.* better than pg-src-16--.* by 5.3 percents (2.99 < 3.16): pg_tpch.query15 Best pg-src-17--.* better than pg-src-16--.* by 5.4 percents (5.46 < 5.77): pg_tpch.query20 Best pg-src-17--.* better than pg-src-16--.* by 5.1 percents (2.06 < 2.17): pg_tpcds.vacuum_freeze_time Average pg-src-17--.* worse than pg-src-16--.* by 9.3 percents (2.39 > 2.18): pg_tpcds.vacuum_freeze_time Best pg-src-17--.* better than pg-src-16--.* by 7.1 percents (73.18 < 78.73): pg_tpcds.query92 Average pg-src-17--.* better than pg-src-16--.* by 6.6 percents (74.65 < 79.94): pg_tpcds.query92 Best pg-src-17--.* better than pg-src-16--.* by 5.7 percents (601.38 < 638.01): pg_tpcds.query13 Average pg-src-17--.* better than pg-src-16--.* by 5.7 percents (603.90 < 640.41): pg_tpcds.query13 Best pg-src-17--.* better than pg-src-16--.* by 6.2 percents (1351.40 < 1440.39): pg_tpcds.query9 Average pg-src-17--.* better than pg-src-16--.* by 5.6 percents (1362.25 < 1443.65): pg_tpcds.query9 Best pg-src-17--.* worse than pg-src-16--.* by 23.2 percents (192.72 > 156.46): pg_tpcds.query21 Average pg-src-17--.* worse than pg-src-16--.* by 22.9 percents (195.02 > 158.73): pg_tpcds.query21 Best pg-src-17--.* better than pg-src-16--.* by 8.2 percents (134.39 < 146.34): pg_tpcds.query90 Average pg-src-17--.* better than pg-src-16--.* by 7.8 percents (136.10 < 147.55): pg_tpcds.query90 Best pg-src-17--.* worse than pg-src-16--.* by 9.1 percents (4.95 > 4.54): pg_tpcds.query93 Average pg-src-17--.* worse than pg-src-16--.* by 7.1 percents (5.09 > 4.75): pg_tpcds.query93 Average pg-src-17--.* worse than pg-src-16--.* by 21.1 percents (116.21 > 95.94): pg_tpcds.query16 Best pg-src-17--.* better than pg-src-16--.* by 7.2 percents (248.11 < 267.27): pg_tpcds.query68 Average pg-src-17--.* better than pg-src-16--.* by 7.1 percents (250.03 < 269.06): pg_tpcds.query68 Best pg-src-17--.* better than pg-src-16--.* by 7.4 percents (7.37 < 7.96): pg_tpcds.query37 Average pg-src-17--.* better than pg-src-16--.* by 8.0 percents (7.39 < 8.03): pg_tpcds.query37 Best pg-src-17--.* better than pg-src-16--.* by 9.6 percents (8.68 < 9.60): pg_tpcds.query82 Average pg-src-17--.* better than pg-src-16--.* by 11.1 percents (8.79 < 9.88): pg_tpcds.query82 Best pg-src-17--.* better than pg-src-16--.* by 6.3 percents (321.06 < 342.47): pg_tpcds.query79 Average pg-src-17--.* better than pg-src-16--.* by 6.5 percents (321.81 < 344.18): pg_tpcds.query79 Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (221.62 < 235.94): pg_tpcds.query71 Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (222.34 < 238.23): pg_tpcds.query71 Best pg-src-17--.* better than pg-src-16--.* by 7.0 percents (226.54 < 243.51): pg_tpcds.query34 Average pg-src-17--.* better than pg-src-16--.* by 7.0 percents (227.35 < 244.50): pg_tpcds.query34 Average pg-src-17--.* worse than pg-src-16--.* by 303.0 percents (526.61 > 130.66): pg_tpcds.query45 Best pg-src-17--.* worse than pg-src-16--.* by 49.1 percents (212.51 > 142.54): pg_tpcds.query15 Average pg-src-17--.* worse than pg-src-16--.* by 55.5 percents (226.34 > 145.60): pg_tpcds.query15 Average pg-src-17--.* better than pg-src-16--.* by 6.6 percents (14.59 < 15.61): pg_tpcds.query84 Best pg-src-17--.* better than pg-src-16--.* by 9.6 percents (181.10 < 200.28): pg_tpcds.query73 Average pg-src-17--.* better than pg-src-16--.* by 9.4 percents (183.64 < 202.65): pg_tpcds.query73 Best pg-src-17--.* better than pg-src-16--.* by 6.6 percents (69.33 < 74.22): pg_tpcds.query94 Average pg-src-17--.* better than pg-src-16--.* by 6.4 percents (70.18 < 75.02): pg_tpcds.query94 Average pg-src-17--.* better than pg-src-16--.* by 15.8 percents (481.98 < 572.48): pg_tpcds.query46 Best pg-src-17--.* better than pg-src-16--.* by 9.4 percents (1505.33 < 1660.93): pg_tpcds.query88 Average pg-src-17--.* better than pg-src-16--.* by 9.2 percents (1511.37 < 1664.83): pg_tpcds.query88 Average pg-src-17--.* worse than pg-src-16--.* by 14.4 percents (83.08 > 72.63): pg_tpcds.query40 Best pg-src-17--.* better than pg-src-16--.* by 9.1 percents (183.54 < 201.95): pg_tpcds.query96 Average pg-src-17--.* better than pg-src-16--.* by 9.2 percents (184.05 < 202.74): pg_tpcds.query96 Best pg-src-17--.* better than pg-src-16--.* by 25.2 percents (16931.08 < 22641.96): pg_tpcds.query6 Average pg-src-17--.* better than pg-src-16--.* by 25.2 percents (16984.32 < 22704.84): pg_tpcds.query6 Best pg-src-17--.* worse than pg-src-16--.* by 7.7 percents (5785.00 > 5373.00): ycsb.load_a_50_runtime Average pg-src-17--.* worse than pg-src-16--.* by 8.2 percents (5891.67 > 5444.33): ycsb.load_a_50_runtime Best pg-src-17--.* better than pg-src-16--.* by 5.4 percents (3191.00 < 3372.00): ycsb.load_b_50_runtime Average pg-src-17--.* worse than pg-src-16--.* by 13.6 percents (7660.33 > 6742.00): ycsb.load_f_25_runtime Average pg-src-17--.* worse than pg-src-16--.* by 5.3 percents (7008.00 > 6658.00): ycsb.load_f_50_runtime Best pg-src-17--.* worse than pg-src-16--.* by 7.1 percents (172860.85 < 186115.76): ycsb.load_a_50_ops Average pg-src-17--.* worse than pg-src-16--.* by 7.6 percents (169781.73 < 183693.11): ycsb.load_a_50_ops Best pg-src-17--.* better than pg-src-16--.* by 5.7 percents (313381.39 > 296559.91): ycsb.load_b_50_ops Average pg-src-17--.* better than pg-src-16--.* by 5.1 percents (306553.51 > 291546.02): ycsb.load_b_50_ops Average pg-src-17--.* worse than pg-src-16--.* by 10.8 percents (132419.58 < 148457.64): ycsb.load_f_25_ops Best pg-src-17--.* better than pg-src-16--.* by 10.8 percents (88362.54 > 79741.88): benchbase.epinions_rps Average pg-src-17--.* better than pg-src-16--.* by 11.4 percents (87834.28 > 78846.51): benchbase.epinions_rps Best pg-src-17--.* better than pg-src-16--.* by 9.5 percents (7963.87 > 7274.82): benchbase.otmetrics_rps Average pg-src-17--.* better than pg-src-16--.* by 8.9 percents (7722.24 > 7094.15): benchbase.otmetrics_rps Best pg-src-17--.* worse than pg-src-16--.* by 15.6 percents (1.02 < 1.21): benchbase.resourcestresser_rps Average pg-src-17--.* worse than pg-src-16--.* by 10.3 percents (0.94 < 1.04): benchbase.resourcestresser_rps Best pg-src-17--.* better than pg-src-16--.* by 38.2 percents (73194.55 > 52952.04): benchbase.sibench_rps Average pg-src-17--.* better than pg-src-16--.* by 32.2 percents (69174.42 > 52343.20): benchbase.sibench_rps Best pg-src-17--.* worse than pg-src-16--.* by 12.6 percents (17241.38 < 19723.87): gdprbench.load_controller_ops Average pg-src-17--.* worse than pg-src-16--.* by 5.1 percents (17008.42 < 17914.10): gdprbench.load_controller_ops Best pg-src-17--.* worse than pg-src-16--.* by 11.6 percents (17513.13 < 19801.98): gdprbench.load_customer_ops Best pg-src-17--.* better than pg-src-16--.* by 5.9 percents (8.71 < 9.26): s64da_tpch.query1 Average pg-src-17--.* better than pg-src-16--.* by 5.1 percents (8.84 < 9.31): s64da_tpch.query1 Best pg-src-17--.* better than pg-src-16--.* by 6.2 percents (2.73 < 2.91): s64da_tpch.query3 Average pg-src-17--.* better than pg-src-16--.* by 6.5 percents (2.73 < 2.92): s64da_tpch.query3 Best pg-src-17--.* better than pg-src-16--.* by 8.2 percents (1.46 < 1.59): s64da_tpch.query5 Average pg-src-17--.* better than pg-src-16--.* by 6.6 percents (1.52 < 1.62): s64da_tpch.query5 Best pg-src-17--.* better than pg-src-16--.* by 8.1 percents (1.24 < 1.35): s64da_tpch.query6 Average pg-src-17--.* better than pg-src-16--.* by 7.4 percents (1.25 < 1.35): s64da_tpch.query6 Best pg-src-17--.* better than pg-src-16--.* by 6.9 percents (1.76 < 1.89): s64da_tpch.query7 Average pg-src-17--.* better than pg-src-16--.* by 6.8 percents (1.77 < 1.90): s64da_tpch.query7 Best pg-src-17--.* better than pg-src-16--.* by 6.4 percents (1.02 < 1.09): s64da_tpch.query8 Average pg-src-17--.* better than pg-src-16--.* by 5.4 percents (1.05 < 1.11): s64da_tpch.query8 Best pg-src-17--.* worse than pg-src-16--.* by 18.2 percents (4.55 > 3.85): s64da_tpch.query9 Average pg-src-17--.* worse than pg-src-16--.* by 16.2 percents (4.58 > 3.94): s64da_tpch.query9 Best pg-src-17--.* better than pg-src-16--.* by 7.1 percents (2.09 < 2.25): s64da_tpch.query10 Average pg-src-17--.* better than pg-src-16--.* by 6.8 percents (2.11 < 2.26): s64da_tpch.query10 Best pg-src-17--.* better than pg-src-16--.* by 8.9 percents (2.26 < 2.48): s64da_tpch.query12 Average pg-src-17--.* better than pg-src-16--.* by 9.0 percents (2.26 < 2.49): s64da_tpch.query12 Best pg-src-17--.* better than pg-src-16--.* by 7.3 percents (1.40 < 1.51): s64da_tpch.query15 Average pg-src-17--.* better than pg-src-16--.* by 8.1 percents (1.40 < 1.53): s64da_tpch.query15 Best pg-src-17--.* better than pg-src-16--.* by 5.2 percents (19.47 < 20.54): s64da_tpch.query18 Best pg-src-17--.* worse than pg-src-16--.* by 36.4 percents (3685.00 > 2702.45): s64da_tpcds.total Average pg-src-17--.* worse than pg-src-16--.* by 38.5 percents (3763.64 > 2717.06): s64da_tpcds.total Best pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06): s64da_tpcds.query8 Average pg-src-17--.* better than pg-src-16--.* by 10.5 percents (0.06 < 0.06): s64da_tpcds.query8 Best pg-src-17--.* better than pg-src-16--.* by 6.7 percents (2.38 < 2.55): s64da_tpcds.query9 Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (2.38 < 2.55): s64da_tpcds.query9 Average pg-src-17--.* better than pg-src-16--.* by 5.2 percents (0.61 < 0.64): s64da_tpcds.query13 Average pg-src-17--.* worse than pg-src-16--.* by 11.1 percents (0.10 > 0.09): s64da_tpcds.query16 Best pg-src-17--.* worse than pg-src-16--.* by 8.7 percents (0.75 > 0.69): s64da_tpcds.query18 Average pg-src-17--.* worse than pg-src-16--.* by 7.7 percents (0.75 > 0.70): s64da_tpcds.query18 Average pg-src-17--.* worse than pg-src-16--.* by 16.9 percents (0.30 > 0.26): s64da_tpcds.query19 Best pg-src-17--.* worse than pg-src-16--.* by 24.6 percents (0.71 > 0.57): s64da_tpcds.query26 Average pg-src-17--.* worse than pg-src-16--.* by 25.6 percents (0.72 > 0.57): s64da_tpcds.query26 Best pg-src-17--.* better than pg-src-16--.* by 6.2 percents (1.82 < 1.94): s64da_tpcds.query28 Average pg-src-17--.* better than pg-src-16--.* by 6.3 percents (1.82 < 1.94): s64da_tpcds.query28 Best pg-src-17--.* better than pg-src-16--.* by 8.0 percents (0.23 < 0.25): s64da_tpcds.query34 Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (0.23 < 0.25): s64da_tpcds.query34 Best pg-src-17--.* better than pg-src-16--.* by 11.1 percents (1.92 < 2.16): s64da_tpcds.query38 Average pg-src-17--.* better than pg-src-16--.* by 8.0 percents (2.00 < 2.17): s64da_tpcds.query38 Best pg-src-17--.* better than pg-src-16--.* by 7.6 percents (3.88 < 4.20): s64da_tpcds.query39a Average pg-src-17--.* better than pg-src-16--.* by 7.6 percents (3.92 < 4.24): s64da_tpcds.query39a Best pg-src-17--.* better than pg-src-16--.* by 5.5 percents (3.94 < 4.17): s64da_tpcds.query39b Best pg-src-17--.* worse than pg-src-16--.* by 37.5 percents (0.11 > 0.08): s64da_tpcds.query40 Average pg-src-17--.* worse than pg-src-16--.* by 41.7 percents (0.11 > 0.08): s64da_tpcds.query40 Best pg-src-17--.* better than pg-src-16--.* by 6.7 percents (0.28 < 0.30): s64da_tpcds.query42 Best pg-src-17--.* worse than pg-src-16--.* by 814.3 percents (1.28 > 0.14): s64da_tpcds.query45 Average pg-src-17--.* worse than pg-src-16--.* by 151.0 percents (1.30 > 0.52): s64da_tpcds.query45 Best pg-src-17--.* worse than pg-src-16--.* by 8.0 percents (2.30 > 2.13): s64da_tpcds.query47 Average pg-src-17--.* worse than pg-src-16--.* by 8.4 percents (2.32 > 2.14): s64da_tpcds.query47 Best pg-src-17--.* better than pg-src-16--.* by 5.2 percents (0.73 < 0.77): s64da_tpcds.query48 Best pg-src-17--.* worse than pg-src-16--.* by 6.7 percents (0.16 > 0.15): s64da_tpcds.query49 Best pg-src-17--.* better than pg-src-16--.* by 25.0 percents (0.06 < 0.08): s64da_tpcds.query50 Average pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.07 < 0.08): s64da_tpcds.query50 Best pg-src-17--.* better than pg-src-16--.* by 7.3 percents (2.41 < 2.60): s64da_tpcds.query51 Average pg-src-17--.* better than pg-src-16--.* by 7.2 percents (2.43 < 2.62): s64da_tpcds.query51 Best pg-src-17--.* worse than pg-src-16--.* by 10.3 percents (1.18 > 1.07): s64da_tpcds.query57 Average pg-src-17--.* worse than pg-src-16--.* by 10.4 percents (1.20 > 1.09): s64da_tpcds.query57 Best pg-src-17--.* better than pg-src-16--.* by 15.2 percents (1.34 < 1.58): s64da_tpcds.query59 Average pg-src-17--.* better than pg-src-16--.* by 15.1 percents (1.35 < 1.59): s64da_tpcds.query59 Best pg-src-17--.* better than pg-src-16--.* by 5.2 percents (0.55 < 0.58): s64da_tpcds.query64 Average pg-src-17--.* better than pg-src-16--.* by 5.1 percents (0.56 < 0.59): s64da_tpcds.query64 Best pg-src-17--.* better than pg-src-16--.* by 8.2 percents (1.35 < 1.47): s64da_tpcds.query65 Average pg-src-17--.* better than pg-src-16--.* by 7.7 percents (1.36 < 1.47): s64da_tpcds.query65 Best pg-src-17--.* better than pg-src-16--.* by 6.7 percents (0.28 < 0.30): s64da_tpcds.query66 Average pg-src-17--.* better than pg-src-16--.* by 5.7 percents (1.86 < 1.97): s64da_tpcds.query67 Best pg-src-17--.* better than pg-src-16--.* by 8.7 percents (0.21 < 0.23): s64da_tpcds.query68 Average pg-src-17--.* better than pg-src-16--.* by 8.7 percents (0.21 < 0.23): s64da_tpcds.query68 Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (1.07 < 1.13): s64da_tpcds.query70 Average pg-src-17--.* better than pg-src-16--.* by 5.3 percents (1.07 < 1.13): s64da_tpcds.query70 Best pg-src-17--.* better than pg-src-16--.* by 5.0 percents (0.19 < 0.20): s64da_tpcds.query73 Average pg-src-17--.* better than pg-src-16--.* by 8.1 percents (0.19 < 0.21): s64da_tpcds.query73 Best pg-src-17--.* better than pg-src-16--.* by 11.2 percents (1.83 < 2.06): s64da_tpcds.query75 Average pg-src-17--.* better than pg-src-16--.* by 10.7 percents (1.84 < 2.06): s64da_tpcds.query75 Best pg-src-17--.* better than pg-src-16--.* by 5.1 percents (0.37 < 0.39): s64da_tpcds.query79 Average pg-src-17--.* better than pg-src-16--.* by 5.1 percents (0.37 < 0.39): s64da_tpcds.query79 Best pg-src-17--.* better than pg-src-16--.* by 10.1 percents (1.95 < 2.17): s64da_tpcds.query87 Average pg-src-17--.* better than pg-src-16--.* by 7.2 percents (2.03 < 2.19): s64da_tpcds.query87 Best pg-src-17--.* better than pg-src-16--.* by 8.4 percents (1.53 < 1.67): s64da_tpcds.query88 Average pg-src-17--.* better than pg-src-16--.* by 8.1 percents (1.54 < 1.68): s64da_tpcds.query88 Best pg-src-17--.* better than pg-src-16--.* by 5.7 percents (0.33 < 0.35): s64da_tpcds.query89 Best pg-src-17--.* better than pg-src-16--.* by 6.7 percents (0.14 < 0.15): s64da_tpcds.query90 Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (0.14 < 0.15): s64da_tpcds.query90 Best pg-src-17--.* better than pg-src-16--.* by 14.3 percents (0.06 < 0.07): s64da_tpcds.query92 Average pg-src-17--.* better than pg-src-16--.* by 18.2 percents (0.06 < 0.07): s64da_tpcds.query92 Average pg-src-17--.* better than pg-src-16--.* by 7.7 percents (0.08 < 0.09): s64da_tpcds.query94 Best pg-src-17--.* worse than pg-src-16--.* by 12.1 percents (196.51 > 175.36): s64da_tpcds.query95 Average pg-src-17--.* worse than pg-src-16--.* by 65.5 percents (305.54 > 184.60): s64da_tpcds.query95 Best pg-src-17--.* worse than pg-src-16--.* by 43.8 percents (0.23 > 0.16): s64da_tpcds.query98 Average pg-src-17--.* worse than pg-src-16--.* by 24.6 percents (0.24 > 0.19): s64da_tpcds.query98 Best pg-src-17--.* worse than pg-src-16--.* by 48.6 percents (0.55 > 0.37): s64da_tpcds.query99 Average pg-src-17--.* worse than pg-src-16--.* by 61.1 percents (0.61 > 0.38): s64da_tpcds.query99 Best pg-src-17--.* better than pg-src-16--.* by 6.0 percents (30.60 < 32.57): s64da_ssb.total Average pg-src-17--.* better than pg-src-16--.* by 6.3 percents (30.85 < 32.93): s64da_ssb.total Best pg-src-17--.* better than pg-src-16--.* by 6.7 percents (2.36 < 2.53): s64da_ssb.queryQ1.1 Average pg-src-17--.* better than pg-src-16--.* by 6.4 percents (2.37 < 2.53): s64da_ssb.queryQ1.1 Best pg-src-17--.* better than pg-src-16--.* by 5.8 percents (2.29 < 2.43): s64da_ssb.queryQ1.2 Average pg-src-17--.* better than pg-src-16--.* by 5.6 percents (2.30 < 2.44): s64da_ssb.queryQ1.2 Best pg-src-17--.* better than pg-src-16--.* by 6.6 percents (2.25 < 2.41): s64da_ssb.queryQ1.3 Average pg-src-17--.* better than pg-src-16--.* by 7.0 percents (2.26 < 2.43): s64da_ssb.queryQ1.3 Best pg-src-17--.* better than pg-src-16--.* by 5.9 percents (2.23 < 2.37): s64da_ssb.queryQ2.2 Average pg-src-17--.* better than pg-src-16--.* by 5.9 percents (2.24 < 2.38): s64da_ssb.queryQ2.2 Best pg-src-17--.* better than pg-src-16--.* by 7.6 percents (1.95 < 2.11): s64da_ssb.queryQ2.3 Average pg-src-17--.* better than pg-src-16--.* by 7.8 percents (1.96 < 2.13): s64da_ssb.queryQ2.3 Best pg-src-17--.* better than pg-src-16--.* by 16.3 percents (2.92 < 3.49): s64da_ssb.queryQ3.1 Average pg-src-17--.* better than pg-src-16--.* by 8.9 percents (3.18 < 3.49): s64da_ssb.queryQ3.1 Best pg-src-17--.* better than pg-src-16--.* by 9.9 percents (1.91 < 2.12): s64da_ssb.queryQ3.2 Average pg-src-17--.* better than pg-src-16--.* by 14.4 percents (1.92 < 2.25): s64da_ssb.queryQ3.2 Best pg-src-17--.* better than pg-src-16--.* by 6.5 percents (1.74 < 1.86): s64da_ssb.queryQ3.3 Average pg-src-17--.* better than pg-src-16--.* by 6.4 percents (1.75 < 1.87): s64da_ssb.queryQ3.3 Best pg-src-17--.* better than pg-src-16--.* by 7.0 percents (1.74 < 1.87): s64da_ssb.queryQ3.4 Average pg-src-17--.* better than pg-src-16--.* by 6.8 percents (1.74 < 1.87): s64da_ssb.queryQ3.4 Best pg-src-17--.* better than pg-src-16--.* by 6.2 percents (3.04 < 3.24): s64da_ssb.queryQ4.1 Average pg-src-17--.* better than pg-src-16--.* by 6.4 percents (3.06 < 3.27): s64da_ssb.queryQ4.1 Best pg-src-17--.* better than pg-src-16--.* by 5.5 percents (2.90 < 3.07): s64da_ssb.queryQ4.2 Average pg-src-17--.* better than pg-src-16--.* by 6.0 percents (2.90 < 3.09): s64da_ssb.queryQ4.2 Best pg-src-17--.* worse than pg-src-16--.* by 9.4 percents (2.55 > 2.33): s64da_ssb.queryQ4.3 Best pg-src-17--.* worse than pg-src-16--.* by 7.7 percents (0.28 > 0.26): job.query11a Average pg-src-17--.* better than pg-src-16--.* by 6.9 percents (0.09 < 0.10): job.query11b Average pg-src-17--.* worse than pg-src-16--.* by 17.5 percents (1.32 > 1.13): job.query11c Average pg-src-17--.* worse than pg-src-16--.* by 5.6 percents (4.82 > 4.57): job.query11d Best pg-src-17--.* worse than pg-src-16--.* by 5.3 percents (0.40 > 0.38): job.query12a Average pg-src-17--.* worse than pg-src-16--.* by 6.1 percents (0.70 > 0.66): job.query14a Average pg-src-17--.* better than pg-src-16--.* by 20.0 percents (0.04 < 0.05): job.query15b Best pg-src-17--.* better than pg-src-16--.* by 15.3 percents (0.72 < 0.85): job.query15c Average pg-src-17--.* better than pg-src-16--.* by 16.0 percents (0.72 < 0.86): job.query15c Average pg-src-17--.* better than pg-src-16--.* by 5.2 percents (0.91 < 0.96): job.query15d Best pg-src-17--.* worse than pg-src-16--.* by 14.3 percents (0.24 > 0.21): job.query16a Average pg-src-17--.* worse than pg-src-16--.* by 9.0 percents (0.24 > 0.22): job.query16a Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (0.36 < 0.38): job.query18a Best pg-src-17--.* worse than pg-src-16--.* by 1170.0 percents (3.81 > 0.30): job.query19a Average pg-src-17--.* worse than pg-src-16--.* by 1181.1 percents (3.84 > 0.30): job.query19a Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (0.18 < 0.19): job.query19b Average pg-src-17--.* better than pg-src-16--.* by 8.5 percents (0.18 < 0.20): job.query19b Average pg-src-17--.* better than pg-src-16--.* by 10.0 percents (0.06 < 0.07): job.query1a Best pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06): job.query1b Average pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06): job.query1b Best pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06): job.query1d Average pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06): job.query1d Best pg-src-17--.* better than pg-src-16--.* by 5.6 percents (0.34 < 0.36): job.query23c Average pg-src-17--.* better than pg-src-16--.* by 26.0 percents (0.49 < 0.67): job.query23c Average pg-src-17--.* better than pg-src-16--.* by 35.3 percents (0.07 < 0.11): job.query24b Average pg-src-17--.* better than pg-src-16--.* by 30.3 percents (3.96 < 5.68): job.query25a Best pg-src-17--.* worse than pg-src-16--.* by 122.2 percents (0.80 > 0.36): job.query26a Average pg-src-17--.* worse than pg-src-16--.* by 72.9 percents (0.81 > 0.47): job.query26a Average pg-src-17--.* worse than pg-src-16--.* by 46.3 percents (0.26 > 0.18): job.query26b Best pg-src-17--.* worse than pg-src-16--.* by 188.0 percents (2.16 > 0.75): job.query26c Average pg-src-17--.* worse than pg-src-16--.* by 40.8 percents (2.19 > 1.55): job.query26c Average pg-src-17--.* better than pg-src-16--.* by 15.7 percents (0.34 < 0.40): job.query27a Best pg-src-17--.* worse than pg-src-16--.* by 33.3 percents (0.20 > 0.15): job.query27b Average pg-src-17--.* worse than pg-src-16--.* by 25.5 percents (0.21 > 0.17): job.query27b Best pg-src-17--.* worse than pg-src-16--.* by 45.1 percents (0.74 > 0.51): job.query27c Average pg-src-17--.* worse than pg-src-16--.* by 12.1 percents (0.74 > 0.66): job.query27c Best pg-src-17--.* better than pg-src-16--.* by 10.8 percents (0.83 < 0.93): job.query28a Average pg-src-17--.* worse than pg-src-16--.* by 172.2 percents (2.55 > 0.94): job.query28a Best pg-src-17--.* better than pg-src-16--.* by 10.4 percents (0.60 < 0.67): job.query28b Average pg-src-17--.* better than pg-src-16--.* by 27.2 percents (0.69 < 0.94): job.query28b Best pg-src-17--.* worse than pg-src-16--.* by 415.2 percents (2.37 > 0.46): job.query28c Average pg-src-17--.* worse than pg-src-16--.* by 37.5 percents (2.37 > 1.73): job.query28c Average pg-src-17--.* better than pg-src-16--.* by 98.0 percents (0.12 < 5.98): job.query29a Average pg-src-17--.* better than pg-src-16--.* by 80.6 percents (0.08 < 0.41): job.query29b Average pg-src-17--.* worse than pg-src-16--.* by 130.4 percents (1.21 > 0.53): job.query29c Best pg-src-17--.* better than pg-src-16--.* by 38.6 percents (1.67 < 2.72): job.query30a Average pg-src-17--.* better than pg-src-16--.* by 8.6 percents (5.94 < 6.50): job.query30a Best pg-src-17--.* better than pg-src-16--.* by 8.3 percents (0.77 < 0.84): job.query33a Average pg-src-17--.* better than pg-src-16--.* by 11.4 percents (0.80 < 0.91): job.query33a Best pg-src-17--.* better than pg-src-16--.* by 17.3 percents (0.81 < 0.98): job.query33b Average pg-src-17--.* better than pg-src-16--.* by 54.7 percents (1.22 < 2.68): job.query33b Best pg-src-17--.* worse than pg-src-16--.* by 178.9 percents (2.51 > 0.90): job.query33c Average pg-src-17--.* worse than pg-src-16--.* by 27.1 percents (2.52 > 1.98): job.query33c Average pg-src-17--.* better than pg-src-16--.* by 18.2 percents (0.18 < 0.22): job.query3a Best pg-src-17--.* better than pg-src-16--.* by 5.9 percents (0.16 < 0.17): job.query5a Average pg-src-17--.* better than pg-src-16--.* by 5.9 percents (0.16 < 0.17): job.query5a Best pg-src-17--.* better than pg-src-16--.* by 6.3 percents (0.15 < 0.16): job.query5b Average pg-src-17--.* better than pg-src-16--.* by 6.3 percents (0.15 < 0.16): job.query5b Best pg-src-17--.* worse than pg-src-16--.* by 10.7 percents (1.35 > 1.22): job.query6b Average pg-src-17--.* worse than pg-src-16--.* by 10.8 percents (1.37 > 1.24): job.query6b Best pg-src-17--.* worse than pg-src-16--.* by 33.3 percents (0.04 > 0.03): job.query6c Average pg-src-17--.* worse than pg-src-16--.* by 33.3 percents (0.04 > 0.03): job.query6c Best pg-src-17--.* worse than pg-src-16--.* by 11.0 percents (7.15 > 6.44): job.query6d Average pg-src-17--.* worse than pg-src-16--.* by 10.8 percents (7.26 > 6.55): job.query6d Best pg-src-17--.* worse than pg-src-16--.* by 11.3 percents (7.20 > 6.47): job.query6f Average pg-src-17--.* worse than pg-src-16--.* by 11.0 percents (7.36 > 6.63): job.query6f Best pg-src-17--.* worse than pg-src-16--.* by 9.1 percents (0.24 > 0.22): job.query7a Best pg-src-17--.* better than pg-src-16--.* by 10.0 percents (0.18 < 0.20): job.query7b Average pg-src-17--.* better than pg-src-16--.* by 8.3 percents (0.18 < 0.20): job.query7b Best pg-src-17--.* better than pg-src-16--.* by 15.0 percents (15.16 < 17.83): job.query7c Average pg-src-17--.* better than pg-src-16--.* by 7.5 percents (20.57 < 22.25): job.query7c Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (2.94 < 3.13): job.query8d Average pg-src-17--.* better than pg-src-16--.* by 5.5 percents (2.97 < 3.14): job.query8d Best pg-src-17--.* worse than pg-src-16--.* by 771.4 percents (2.44 > 0.28): job.query9a Average pg-src-17--.* worse than pg-src-16--.* by 763.5 percents (2.45 > 0.28): job.query9a Best pg-src-17--.* worse than pg-src-16--.* by 433.3 percents (1.44 > 0.27): job.query9b Average pg-src-17--.* worse than pg-src-16--.* by 437.0 percents (1.45 > 0.27): job.query9b Best pg-src-17--.* better than pg-src-16--.* by 6.6 percents (2.26 < 2.42): job.query9c Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (2.27 < 2.43): job.query9c Best pg-src-17--.* worse than pg-src-16--.* by 7.8 percents (4.26 > 3.95): job.query9d Best pg-src-17--.* better than pg-src-16--.* by 19.7 percents (264570.35 > 221029.48): sysbench.load_select_random_points_tps Average pg-src-17--.* better than pg-src-16--.* by 19.8 percents (263014.87 > 219587.61): sysbench.load_select_random_points_tps Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (80.09 > 76.06): sysbench.load_bulk_insert_ops Average pg-src-17--.* better than pg-src-16--.* by 5.0 percents (79.05 > 75.28): sysbench.load_bulk_insert_ops Best pg-src-17--.* better than pg-src-16--.* by 19.7 percents (264570.35 > 221029.48): sysbench.load_select_random_points_ops Average pg-src-17--.* better than pg-src-16--.* by 19.8 percents (263014.87 > 219587.61): sysbench.load_select_random_points_ops