Choosing datastores

Choosing datastores

Guide on how to select datastores to solve different problems

Tickets

Loading…

Moiz Arsiwala

@workindia

Gotchas! You Created A Many To Many Relationship Without Timestamp

Submitted Jul 16, 2021

When we started WorkIndia we just thought of shipping features out nothing else
We took decisions around data modelling making our system very configurable and apply generalisation principles for root models and specialisation for leaf models. Now, after 4 years down the line when we created our data lake based on Debezium based Sync Source connectors we faced challenges due to ORM modelling not adding timestamp by default in the models making reconsilation engine always go out of sync

What did we do to fix it on short term?
What did we plan to fix in long term?

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid access (members only)

Hosted by

We care about site reliability, cloud costs, security and data privacy