Skype presents: SkyTools 2.1 - queueing, replication and more...

From: "Marko Kreen" <marko(dot)kreen(at)skype(dot)net>
To: pgsql-announce(at)postgresql(dot)org
Subject: Skype presents: SkyTools 2.1 - queueing, replication and more...
Date: 2007-03-13 15:53:02
Message-ID: 54331.194.126.108.9.1173801182.squirrel@mail.skype.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-announce

This is a package of tools used in Skype for replication and
failover. Also it includes a generic queuing mechanism PgQ and
utility library for Python scripts.

https://developer.skype.com/SkypeGarage/DbProjects/SkyTools

Main components are:

PgQ
---

This is the queue machanism we use. Consists of PL/pgsql, PL/python
and C code in database, with Python framework on top of it. It is
based on snapshot based event handling ideas from Slony-I,
written for general usage.

Londiste
--------

Replication tool written in Python, using PgQ as event transport.

Goals:
- Survive high load, long transactions - implemented in PgQ.
- Easy to administer - eg. tables can be added one-by-one to set.
- Initial COPY does not block event replay for other tables.

Compared to Slony-I it is not that featureful, no support for
chained replication, even support for sequences got added
only recently.

walmgr
------
This script will setup WAL archiving, does initial backup and
runtime WAL archive and restore.

Browse pgsql-announce by date

  From Date Subject
Next Message Marko Kreen 2007-03-13 15:54:08 Skype presents: PgBouncer 1.0 - lightweight connection pooler
Previous Message Dan Langille 2007-03-13 12:55:16 PGCon - Schedule/Registration