Integration tests

Automated checks of two or more components together, often with a real database or queue.

Mandatory for 23 of 46 product types. Usually run by a developer.

What it catches

What it misses

Which product types need it and why

Status of integration tests on every published playbook, with the risk ids or the condition behind it.
Product typeStatusReason or condition
accounting and invoicing SaaSmandatoryRisks: Third-party dependency fails, Records silently wrong
buy now pay later servicemandatoryRisks: Money leaves or fails to arrive
clinical trial management softwaremandatoryRisks: Records silently wrong
data pipelinemandatoryRisks: Records silently wrong, Third-party dependency fails
ecommerce storemandatoryRisks: Money leaves or fails to arrive, Fine or enforcement by a regulator
electronic health record systemmandatoryRisks: Physical or psychological harm to a user, Records silently wrong
email marketing platformmandatoryRisks: App rejected or removed by a store, Records silently wrong
ERP systemmandatoryRisks: Records silently wrong
EV charging appmandatoryRisks: Third-party dependency fails
expense management toolmandatoryRisks: Money leaves or fails to arrive, Records silently wrong
identity and access management servicemandatoryRisks: Fraud or abuse by users
insurance appmandatoryRisks: Records silently wrong
lending platformmandatoryRisks: Money leaves or fails to arrive, Records silently wrong
loyalty program appmandatoryRisks: Records silently wrong
messaging appmandatoryRisks: Third-party dependency fails
mobile banking appmandatoryRisks: Money leaves or fails to arrive, Third-party dependency fails
neobankmandatoryRisks: Third-party dependency fails, Records silently wrong
patient portalmandatoryRisks: User actions lost on bad networks or devices
software as a medical devicemandatoryRisks: Physical or psychological harm to a user, User actions lost on bad networks or devices
SDK or client librarymandatoryRisks: Fine or enforcement by a regulator, Personal or sensitive data exposed
subscription box servicemandatoryRisks: Money leaves or fails to arrive
travel booking appmandatoryRisks: Money leaves or fails to arrive
video conferencing toolmandatoryRisks: Personal or sensitive data exposed
crypto exchangerecommendedBecomes mandatory when a new chain or token is listed.
dating apprecommendedBecomes mandatory when photo moderation or identity checks move to a new provider.
e-signature servicerecommendedBecomes mandatory when the risk "Fraud or abuse by users" is attached to this product type with verified evidence (see the methodology).
fleet and logistics trackingrecommendedBecomes mandatory when proof of delivery is pushed into customers' own systems.
government services portalrecommendedBecomes mandatory when a new backend is connected.
grocery delivery apprecommendedBecomes mandatory when store stock comes from a partner retailer's system.
smart home or IoT apprecommendedBecomes mandatory when devices are sold as working with a voice assistant or another home platform.
LLM-based assistantrecommendedBecomes mandatory when the assistant can call tools that write data or send messages.
online marketplacerecommendedBecomes mandatory when a payout released before a dispute closes is recorded for this product type with verified evidence (see the methodology).
peer-to-peer payment apprecommendedBecomes mandatory when cash-out runs through a new bank or card network partner.
pharmacy delivery apprecommendedBecomes mandatory when the risk "Third-party dependency fails" or "Money leaves or fails to arrive" is attached to this product type with verified evidence (see the methodology).
ride-hailing apprecommendedBecomes mandatory when fares or earnings pass between separately deployed services.
telemedicine apprecommendedBecomes mandatory when prescriptions go to pharmacies through an e-prescribing network rather than by fax or phone.
event ticketing platformrecommendedBecomes mandatory when venues use their own access control system.
stock trading apprecommendedBecomes mandatory when the broker changes clearing firm or order router.
wearable companion apprecommendedBecomes mandatory when other apps read the band's data through the phone's health store.
machine learning model serviceoptionalOptional: catches wiring faults between feature store and model.
desktop applicationnot neededNot needed: no attached risk comes from a third-party service. Becomes recommended when the app syncs with an outside service.
kids appnot neededNot needed: the app has no third-party service beyond the store. Becomes recommended when a classroom or cloud save service is added.
language learning appnot neededNot needed as a separate item: the store and speech services are covered by the payment and compatibility tests. Becomes recommended when a second speech provider is added.
mental health appnot neededNot needed while the app has no partner systems beyond its own backend. Becomes recommended when sessions are booked into a provider's scheduling system.
mobile gamenot neededNot needed beyond the payment and load tests above. Becomes recommended when the game adds a third-party login or cross-platform account service.
social networknot neededNot needed: no third-party app gets user data through an API. Becomes recommended when an API for third-party apps ships.

Done conditions used on playbook pages

Each mandatory cell has its own done condition, written for that product type.

Tools

Alphabetical. Not recommendations.

7 tools shown

integration tests

  • Charles ProxyHTTP proxy for inspecting and throttling traffic. iosandroidwebcommercial
  • JestJavaScript test runner with mocking and snapshots. webapiopen-source
  • JUnitTest framework for the JVM. apiandroidopen-source
  • PostmanAPI client with collections and scripted assertions. apifreemium
  • pytestTest framework for Python with fixtures and plugins. apiopen-source
  • VitestTest runner for Vite-based JavaScript and TypeScript projects. webapiopen-source
  • XCTestApple's framework for unit and UI tests. iosopen-source