Running TAP regression tests under windows/msvc

From: Mark Dilger <hornschnorter(at)gmail(dot)com>
To: pgsql-general(at)postgresql(dot)org
Cc: Mark Dilger <hornschnorter(at)gmail(dot)com>
Subject: Running TAP regression tests under windows/msvc
Date: 2017-03-07 20:24:56
Message-ID: 65CF2417-3313-42B7-AB65-0755830DE798@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hello,

I am attempting to get the tap tests working under windows so as to
help review patches for the 10.0 development cycle. I can compile
the sources on windows 2008 using the MS Visual C and run the

vcregress.bat check

without any problems or failures. In an attempt to run the tap tests,
I have edited config_default.pl as follows:

diff --git a/src/tools/msvc/config_default.pl b/src/tools/msvc/config_default.pl
index 97f1af8..1e7b19d 100644
--- a/src/tools/msvc/config_default.pl
+++ b/src/tools/msvc/config_default.pl
@@ -16,7 +16,7 @@ our $config = {
extraver => undef, # --with-extra-version=<string>
gss => undef, # --with-gssapi=<path>
nls => undef, # --enable-nls=<path>
- tap_tests => undef, # --enable-tap-tests
+ tap_tests => 1, # --enable-tap-tests
tcl => undef, # --with-tls=<path>
perl => undef, # --with-perl
python => undef, # --with-python=<path>

and when I run

vcregress.bat bincheck

I get a few failures. Am I doing something wrong, or are these failures
the same for other folks? A portion of the log of the regressions follows:

All tests successful.
Files=5, Tests=17, 323 wallclock secs ( 0.08 usr + 0.03 sys = 0.11 CPU)
Result: PASS
t/001_pgbench.pl ..
1..3
ok 1 - concurrent OID generation: exit code 0
ok 2 - concurrent OID generation: no stderr
ok 3 - concurrent OID generation: matches
ok
All tests successful.
Files=1, Tests=3, 12 wallclock secs ( 0.08 usr + 0.03 sys = 0.11 CPU)
Result: PASS

# Failed test 'SQL CLUSTER run: SQL found in server log'
# at c:/jenkins/workspace/unicorns/postgresql/src/test/perl/PostgresNode.pm line 1321.
# ''
# doesn't match '(?^:statement: CLUSTER;)'

# Failed test 'cluster specific table: SQL found in server log'
# at c:/jenkins/workspace/unicorns/postgresql/src/test/perl/PostgresNode.pm line 1321.
# ''
# doesn't match '(?^:statement: CLUSTER test1;)'
# Looks like you failed 2 tests of 14.
t/010_clusterdb.pl ........
1..14
ok 1 - clusterdb --help exit code 0
ok 2 - clusterdb --help goes to stdout
ok 3 - clusterdb --help nothing to stderr
ok 4 - clusterdb --version exit code 0
ok 5 - clusterdb --version goes to stdout
ok 6 - clusterdb --version nothing to stderr
ok 7 - clusterdb with invalid option nonzero exit code
ok 8 - clusterdb with invalid option prints error message
ok 9 - clusterdb exit code 0
not ok 10 - SQL CLUSTER run: SQL found in server log
ok 11 - fails with nonexistent table
ok 12 - clusterdb -t test1 exit code 0
not ok 13 - cluster specific table: SQL found in server log
ok 14 - clusterdb with connection string
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/14 subtests

# Failed test 'cluster all databases: SQL found in server log'
# at c:/jenkins/workspace/unicorns/postgresql/src/test/perl/PostgresNode.pm line 1321.
# ''
# doesn't match '(?^s:statement: CLUSTER.*statement: CLUSTER)'
# Looks like you failed 1 test of 2.
t/011_clusterdb_all.pl ....
1..2
ok 1 - clusterdb -a exit code 0
not ok 2 - cluster all databases: SQL found in server log
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/2 subtests

# Failed test 'SQL CREATE DATABASE run: SQL found in server log'
# at c:/jenkins/workspace/unicorns/postgresql/src/test/perl/PostgresNode.pm line 1321.
# ''
# doesn't match '(?^:statement: CREATE DATABASE foobar1)'

# Failed test 'create database with encoding: SQL found in server log'
# at c:/jenkins/workspace/unicorns/postgresql/src/test/perl/PostgresNode.pm line 1321.
# ''
# doesn't match '(?^:statement: CREATE DATABASE foobar2 ENCODING 'LATIN1')'
# Looks like you failed 2 tests of 13.
t/020_createdb.pl .........
1..13
ok 1 - createdb --help exit code 0
ok 2 - createdb --help goes to stdout
ok 3 - createdb --help nothing to stderr
ok 4 - createdb --version exit code 0
ok 5 - createdb --version goes to stdout
ok 6 - createdb --version nothing to stderr
ok 7 - createdb with invalid option nonzero exit code
ok 8 - createdb with invalid option prints error message
ok 9 - createdb foobar1 exit code 0
not ok 10 - SQL CREATE DATABASE run: SQL found in server log
ok 11 - createdb -l C -E LATIN1 -T template0 foobar2 exit code 0
not ok 12 - create database with encoding: SQL found in server log
ok 13 - fails if database already exists
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/13 subtests

# Failed test 'SQL CREATE EXTENSION run: SQL found in server log'
# at c:/jenkins/workspace/unicorns/postgresql/src/test/perl/PostgresNode.pm line 1321.
# ''
# doesn't match '(?^:statement: CREATE EXTENSION "plpgsql")'
# Looks like you failed 1 test of 14.

Thanks in advance for any clarification regarding what I might be doing wrong.

Mark Dilger

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Pavel Stehule 2017-03-07 20:29:11 Re: Feature request - psql --quote-variable
Previous Message Caleb Cushing 2017-03-07 20:04:40 Re: Feature request - psql --quote-variable