Re: Using ORDER BY with AGGREGATE/GROUP BY in a SELECT statement

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: "David D(dot) Kilzer" <ddkilzer(at)lubricants-oil(dot)com>
Cc: pgsql-sql(at)postgresql(dot)org
Subject: Re: Using ORDER BY with AGGREGATE/GROUP BY in a SELECT statement
Date: 2001-05-11 16:33:52
Message-ID: 5443.989598832@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

"David D. Kilzer" <ddkilzer(at)lubricants-oil(dot)com> writes:
> [ wants to write an aggregate function that returns its last input ]

The SQL model of query processing has a very definite view of the stages
of processing: first group by, then aggregate, and last order by. Tuple
ordering is irrelevant according to the basic semantics of the language.
Probably the SQL authors would have left out ORDER BY entirely if they
could have got away with it, but instead they made it a vestigial
appendage that is only allowed at the very last instant before query
outputs are forwarded to a client application.

Thus, it is very bad form to write an aggregate that depends on the
order it sees its inputs in. This won't be changed, because it's part
of the nature of the language.

In PG 7.1 it's possible to hack around this by ordering the result of
a subselect-in-FROM:

SELECT orderedagg(ss.x) FROM (select x from tab order by y) ss;

which is a gross violation of the letter and spirit of the spec, and
should not be expected to be portable to other DBMSes; but it gets the
job done if you are intent on writing an ordering-dependent aggregate.

However, I don't see any good way to combine this with grouping, since
if you apply GROUP BY to the output of the subselect you'll lose the
ordering again.

> SELECT r.personid AS personid
> ,SUM(r.laps) AS laps
> ,COUNT(DISTINCT r.id) AS nightsraced
> ,(SELECT r.carid
> FROM race r
> WHERE r.personid = 14
> ORDER BY r.date DESC
> LIMIT 1) AS carid
> FROM race r
> WHERE r.personid = 14
> GROUP BY r.personid
> ORDER BY r.date;

This is likely to be reasonably efficient, actually, since the subselect
will be evaluated only once per output group --- in fact, as you've
written it it'll only be evaluated once, period, since it has no
dependencies on the outer query. More usually you'd probably do

,(SELECT r2.carid
FROM race r2
WHERE r2.personid = r.personid
ORDER BY r2.date DESC
LIMIT 1) AS carid

so that the result tracks the outer query, and in this form it'd be
redone once per output row.

regards, tom lane

In response to

Responses

Browse pgsql-sql by date

  From Date Subject
Next Message Roberto Mello 2001-05-11 17:14:06 Re: Postgres function library
Previous Message Valerio Santinelli 2001-05-11 16:32:56 create type and domains