Delete 1 Record of 2 Duplicate Records

How do I delete only 1 of the duplicate records?

column_name | column_id
---------------------+--------------
test1 | 5
test1 | 5

I've tried this:

tmp_test=# delete from test where column_id = 5 limit 1;
ERROR: parser: parse error at or near "limit"

I'm using version 7.2.1

Thank you.