Release smoke tests

A short fixed set run on every build before release.

Mandatory for 46 of 46 product types. Usually run by a QA engineer.

What it catches

What it misses

Which product types need it and why

Status of release smoke tests on every published playbook, with the risk ids or the condition behind it.
Product typeStatusReason or condition
accounting and invoicing SaaSmandatoryRisks: Records silently wrong
buy now pay later servicemandatoryRisks: Money leaves or fails to arrive
clinical trial management softwaremandatoryRisks: Records silently wrong, Fine or enforcement by a regulator
crypto exchangemandatoryRisks: Outage during a demand peak, App rejected or removed by a store
data pipelinemandatoryRisks: Records silently wrong, Users or operators act on wrong numbers
dating appmandatoryRisks: App rejected or removed by a store
desktop applicationmandatoryRisks: App rejected or removed by a store, Personal or sensitive data exposed
e-signature servicemandatoryRisks: Fine or enforcement by a regulator, Records silently wrong
ecommerce storemandatoryRisks: App rejected or removed by a store, Money leaves or fails to arrive
electronic health record systemmandatoryRisks: Physical or psychological harm to a user
email marketing platformmandatoryRisks: App rejected or removed by a store
ERP systemmandatoryRisks: Money leaves or fails to arrive
EV charging appmandatoryRisks: App rejected or removed by a store, Money leaves or fails to arrive
expense management toolmandatoryRisks: Money leaves or fails to arrive
fleet and logistics trackingmandatoryRisks: User actions lost on bad networks or devices
government services portalmandatoryRisks: Personal or sensitive data exposed
grocery delivery appmandatoryRisks: App rejected or removed by a store
identity and access management servicemandatoryRisks: Fraud or abuse by users, Personal or sensitive data exposed
insurance appmandatoryRisks: Money leaves or fails to arrive
smart home or IoT appmandatoryRisks: App rejected or removed by a store
kids appmandatoryRisks: App rejected or removed by a store
language learning appmandatoryRisks: App rejected or removed by a store
lending platformmandatoryRisks: Money leaves or fails to arrive
LLM-based assistantmandatoryRisks: Third-party dependency fails, Users or operators act on wrong numbers
loyalty program appmandatoryRisks: App rejected or removed by a store
online marketplacemandatoryRisks: App rejected or removed by a store
mental health appmandatoryRisks: App rejected or removed by a store
messaging appmandatoryRisks: App rejected or removed by a store
machine learning model servicemandatoryRisks: Users or operators act on wrong numbers
mobile banking appmandatoryRisks: App rejected or removed by a store, Personal or sensitive data exposed
mobile gamemandatoryRisks: App rejected or removed by a store
neobankmandatoryRisks: App rejected or removed by a store
peer-to-peer payment appmandatoryRisks: App rejected or removed by a store
patient portalmandatoryRisks: User actions lost on bad networks or devices
pharmacy delivery appmandatoryRisks: App rejected or removed by a store
ride-hailing appmandatoryRisks: App rejected or removed by a store
software as a medical devicemandatoryRisks: User actions lost on bad networks or devices, Physical or psychological harm to a user
SDK or client librarymandatoryRisks: Third-party dependency fails, App rejected or removed by a store
social networkmandatoryRisks: App rejected or removed by a store
subscription box servicemandatoryRisks: Money leaves or fails to arrive, Fine or enforcement by a regulator
telemedicine appmandatoryRisks: App rejected or removed by a store, Outage during a demand peak
event ticketing platformmandatoryRisks: Outage during a demand peak
stock trading appmandatoryRisks: App rejected or removed by a store, Money leaves or fails to arrive
travel booking appmandatoryRisks: App rejected or removed by a store
video conferencing toolmandatoryRisks: Personal or sensitive data exposed, App rejected or removed by a store
wearable companion appmandatoryRisks: App rejected or removed by a store

Done conditions used on playbook pages

Each mandatory cell has its own done condition, written for that product type.

Tools

Alphabetical. Not recommendations.

3 tools shown

release smoke tests

  • Firebase Test LabRuns app tests on hosted devices. iosandroidfreemium
  • TestRailTest case and run management. webiosandroidapicommercial
  • XrayTest management inside Jira. webiosandroidapicommercial