RE: Proposal for Updating CRC32C with AVX-512 Algorithm.

From: "Devulapalli, Raghuveer" <raghuveer(dot)devulapalli(at)intel(dot)com>
To: John Naylor <johncnaylorls(at)gmail(dot)com>
Cc: "Sterrett, Matthew" <matthewsterrett2(at)gmail(dot)com>, Nathan Bossart <nathandbossart(at)gmail(dot)com>, Andres Freund <andres(at)anarazel(dot)de>, Bruce Momjian <bruce(at)momjian(dot)us>, Alvaro Herrera <alvherre(at)alvh(dot)no-ip(dot)org>, "pgsql-hackers(at)lists(dot)postgresql(dot)org" <pgsql-hackers(at)lists(dot)postgresql(dot)org>, "Shankaran, Akash" <akash(dot)shankaran(at)intel(dot)com>
Subject: RE: Proposal for Updating CRC32C with AVX-512 Algorithm.
Date: 2025-02-05 20:58:03
Message-ID: PH8PR11MB8286492FF1F8DED74200FD64FBF72@PH8PR11MB8286.namprd11.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi John,

> Further, we verified upthread that Intel's current and near-future product line
> includes server chips (some with over 100 cores, so not exactly low-end) that
> don't support AVX-512 at all. I have no idea how common they will be, but they
> will certainly be found in cloud datacenters somewhere. Shouldn't we have an
> answer for them as well?

Just submitted a patch to improve the SSE4.2 version using the source you referenced. See
https://www.postgresql.org/message-id/PH8PR11MB82869FF741DFA4E9A029FF13FBF72%40PH8PR11MB8286.namprd11.prod.outlook.com

> I know you had extended time off work, but I've already shared my findings and
> explained my reasoning [2]. The title of the paper is "Fast CRC Computation for
> iSCSI Polynomial Using CRC32 Instruction", so unsurprisingly it does improve the
> SSE42 version. With a few dozen lines of code, I can get ~3x speedup on page-
> sized inputs. At the very least we want to use this technique on Arm [3], and the
> only blocker now is the question regarding the patents. I'm interested to hear the
> response on this.

Still figuring this out. Will respond as soon as I can.

Thanks,
Raghuveer

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Pavel Stehule 2025-02-05 20:58:11 Re: problems with extensions compiling after upgrade to fc42 (and gcc15)
Previous Message Peter Eisentraut 2025-02-05 20:55:47 Re: problems with extensions compiling after upgrade to fc42 (and gcc15)