Data integrity and migration testing

Verifying data stays correct through writes, migrations, imports and exports.

Mandatory for 27 of 46 product types. Usually run by a developer.

What it catches

What it misses

Which product types need it and why

Status of data integrity and migration testing on every published playbook, with the risk ids or the condition behind it.
Product typeStatusReason or condition
accounting and invoicing SaaSmandatoryRisks: Records silently wrong, Fine or enforcement by a regulator
clinical trial management softwaremandatoryRisks: Records silently wrong, Fine or enforcement by a regulator
crypto exchangemandatoryRisks: Money leaves or fails to arrive
data pipelinemandatoryRisks: Records silently wrong, Users or operators act on wrong numbers, Fine or enforcement by a regulator
dating appmandatoryRisks: Personal or sensitive data exposed
desktop applicationmandatoryRisks: Records silently wrong
e-signature servicemandatoryRisks: Records silently wrong
ecommerce storemandatoryRisks: Money leaves or fails to arrive
electronic health record systemmandatoryRisks: Records silently wrong, Users or operators act on wrong numbers
email marketing platformmandatoryRisks: Records silently wrong, Fine or enforcement by a regulator
ERP systemmandatoryRisks: Records silently wrong, Users or operators act on wrong numbers
EV charging appmandatoryRisks: Money leaves or fails to arrive
expense management toolmandatoryRisks: Records silently wrong
fleet and logistics trackingmandatoryRisks: Records silently wrong
insurance appmandatoryRisks: Records silently wrong, Money leaves or fails to arrive, Users or operators act on wrong numbers
lending platformmandatoryRisks: Records silently wrong, Fine or enforcement by a regulator
loyalty program appmandatoryRisks: Records silently wrong, Money leaves or fails to arrive
online marketplacemandatoryRisks: Fine or enforcement by a regulator
machine learning model servicemandatoryRisks: Users or operators act on wrong numbers, Physical or psychological harm to a user, Fine or enforcement by a regulator
mobile banking appmandatoryRisks: Records silently wrong, Money leaves or fails to arrive
mobile gamemandatoryRisks: Money leaves or fails to arrive
neobankmandatoryRisks: Records silently wrong, Money leaves or fails to arrive
peer-to-peer payment appmandatoryRisks: Money leaves or fails to arrive
pharmacy delivery appmandatoryRisks: Fine or enforcement by a regulator
ride-hailing appmandatoryRisks: Users or operators act on wrong numbers
subscription box servicemandatoryRisks: Money leaves or fails to arrive, Fine or enforcement by a regulator
stock trading appmandatoryRisks: Users or operators act on wrong numbers
government services portalrecommendedBecomes mandatory when the portal hands data to more than one case system.
grocery delivery apprecommendedBecomes mandatory when shoppers are charged the wrong amount for items priced by weight or for substitutes.
identity and access management servicerecommendedBecomes mandatory when a second regulator action on reuse of security data is attached.
mental health apprecommendedBecomes mandatory when clinicians review mood history to adjust treatment.
patient portalrecommendedBecomes mandatory when the portal moves to a new record system or migrates message history.
software as a medical devicerecommendedBecomes mandatory when clinicians make treatment decisions from the uploaded history.
telemedicine apprecommendedBecomes mandatory when visit notes are exported to a partner EHR or migrated between systems.
event ticketing platformrecommendedBecomes mandatory when resale between fans ships.
travel booking apprecommendedBecomes mandatory when travellers receive confirmations with the wrong flight time or date.
wearable companion apprecommendedBecomes mandatory when readings are shared with a clinician or insurer.
buy now pay later servicenot neededNot needed as a separate test: plan balances are covered by the payment-sandbox and integration cases. Becomes recommended when plan data is migrated between ledgers or furnished to credit bureaus.
smart home or IoT appnot neededNot needed: the app keeps device state, not records that are reported or billed. Becomes recommended when energy-use history is shown or exported.
kids appnot neededNot needed: no financial or official record is kept. Becomes recommended when progress reports go to schools.
language learning appnot neededNot needed: no record above is financial or official. Becomes recommended when the app issues certificates or level scores to schools.
LLM-based assistantnot neededNot needed: the assistant stores chats as written and computes no figures. Becomes recommended when answers write back to customer records.
messaging appnot neededNot needed: message history stays in one store. Becomes recommended when message history migrates to a new store.
SDK or client librarynot neededNot needed: the SDK stores no records of its own. Becomes recommended when it adds a local database or sync.
social networknot neededNot needed: no figures or records are computed for users to act on. Becomes recommended when creator payouts are calculated from views.
video conferencing toolnot neededNot needed: no data-corruption risk is attached. Becomes recommended when meeting records feed billing or compliance archives.

Done conditions used on playbook pages

Each mandatory cell has its own done condition, written for that product type.

Tools

Alphabetical. Not recommendations.

2 tools shown

data integrity and migration testing

  • dbt testsTests on warehouse models inside dbt. apiopen-source
  • Great ExpectationsData validation with declarative expectations. apiopen-source