Re: Pulling data from Postgres DB table for every 5 seconds.

On 1/9/19 11:02 AM, github kran wrote:
>
>
> Hi Postgres Team,
>
> I have an application using RDS Aurora Postgresql 9.6 version having 4
> TB of DB size. In this DB we have a table PRODUCT_INFO with around  1
> million rows and table size of 1 GB.
> We are looking for a implementation where we want to pull the data in
> real time for every 5 seconds from the DB
>

"the data".  All 1GB every 5 seconds?

> ( Table mentioned above) and send it to IOT topic whenever an event
> occurs for a product. ( event is any new product information or change
> in the existing
> product information.).
>
> This table has few DML operations in real time either INSERT or UPDATE
> based on the productId. ( Update whenever there is a change in the
> product information and INSERT when a record doesnt exists for that
> product).
>
> We have REST API's built in the backend pulling data from this backend
> RDS Aurora POSTGRES DB and used by clients.
>
> *_UseCase_*
> We dont want clients to pull the data for every 5 seconds from DB but
> rather provide a service which can fetch the data from DB in real time
> and push the data to IOT topic by pulling data for every 5 seconds
> from DB.
>

Or just a tiny subset every 5 seconds?

>
> *_Questions_*
> 1) How can I get information by pulling from the DB every 5 seconds
> without impacting the performance of the DB.
> 2) What are the options I have pulling the data from this table every
> 5 seconds. Does POSTGRES has any other options apart from TRIGGER ?.
>
>
> Any ideas would be helpful.
>
> Thanks !!
> GithubKran
>

--
Angular momentum makes the world go 'round.