[PATCH] Inbuilt URL validation for dynamic content generated by users.

From: Akshat Jaimini <destrex271(at)gmail(dot)com>
To: pgsql-www(at)lists(dot)postgresql(dot)org
Cc: sfrost(at)snowman(dot)net, Ilaria Battiston <ilaria(dot)battiston(at)gmail(dot)com>
Subject: [PATCH] Inbuilt URL validation for dynamic content generated by users.
Date: 2023-08-14 15:47:41
Message-ID: CAMaW3ViXDSkE4epPdrg-sm1j7NsMU14CHGECGMGmMkYZdsVogA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-www

While working on the PGweb Testing Harness we noticed that although our
testing suite works on checking the entire website for broken links, we are
not able to check the real time data that is present on the main website
since the testing harness uses a development environment with some
predefined fixtures which does not aptly satisfy this particular test.

Therefore we have two patches to tackle the problem of Broken URLs at least
in the dynamic content for the pgweb repository.
1. URL validation in URL specific fields and markup fields in the forms
for adding Events, News, Organisation, Products and Professional
Services.[form_validation_with_markdown_v03.patch]

2. A secondary service which would be run as a cronjob on the prod server
to check tables that consist of specified URL fields and Markup content
fields. (I am currently using the local values for database connection in
the script; changes will be made according to the prod server if we decide
to deploy it.)[url_scan_individual_tables.patch]

Patches have been attached in the above mentioned order. Would love to hear
your thoughts on this. I think this can help us a lot in manually searching
for broken URLs on the website (at least in the dynamically generated
content). I am also working on refining the crawling service already
implemented in the Testing Harness which would be able to check for broken
URLs.

Attachment Content-Type Size
form_validation_with_markdown_v03.patch text/x-patch 7.4 KB
url_scan_individual_tables.patch text/x-patch 6.7 KB

Responses

Browse pgsql-www by date

  From Date Subject
Next Message Akshat Jaimini 2023-08-14 15:53:42 Re: [PATCH] Inbuilt URL validation for dynamic content generated by users.
Previous Message Mathias Koerber 2023-08-14 12:36:29 Wiki editor request