WhatsApp lead bot: what breaks, and what the harness proved
Built against this public brief; no client relationship implied. Brief: n8n Jobs 316792, a fictional home-service business, test phone numbers · by Samvel Avagyan.
20 cases · 19 pass · 0 fail · 0 blocked · 1 by design
What clients complain about
A lead got lost
- pass case 1: Happy path end to end
- pass case 10: Calendar answers 500 → bounded retries, alert, task, «we will confirm»
- pass case 11: CRM answers 429 → retried, nothing lost
- pass case 12: CRM down and the n8n container restarted mid-run → reconciled, no duplicate
- pass more: A booking step stuck at its third try goes to a person, not re-run
- pass more: Work claimed and not done for 31 min raises a stuck-worker alert
A slot was booked twice
- pass case 2: The same event replayed at once and after 15 min → one booking
- pass case 8: Two leads choose one slot → one booked, one offered new times
- pass case 13: A timeout after the write succeeded → no second booking
- pass case 19: Reschedule → the old slot is freed only after the new one is booked
A wrong or duplicate CRM record
- pass case 3: An existing customer → updated, not duplicated
- pass case 4: An ambiguous identity → a task for a person, no merge
- pass case 5: Missing phone, e-mail present → the e-mail kept, nothing invented
The bot talked over a person
- pass case 15: The lead asks for a person → bot frozen, queued sends cancelled
- pass case 16: A person replies while a bot send is queued → the bot send is not delivered
The bot went silent
- pass case 7: No free slot in 7 days → the lead is told so, a task for a person
- pass case 14: The language model times out or answers badly → template fallback + alert
- pass case 17: A silent lead → one follow-up inside 24 h; STOP → nothing more, consent logged
- pass case 18: The 24 h window closed → a template or a person, never free text
- pass more: A booking writes the business heartbeat
- pass more: No inbound in business hours raises one heartbeat-gap alert
Someone faked a lead
- by design case 20: Webhook valid / bad signature / replayed → only the valid one acts
- signature checks: node --import tsx --test test/signature.test.ts test/receive.test.ts: 11 pass · 0 fail
The 20 cases
pass 1 Happy path end to end
Live or injected: live
pass What we did: C1 #1 happy path: Q1–Q3 answered, «3» → the same two slots and no event; «1» → booked end to end
Expected: what the line above claims. Actual: every check of it held.
- Lead
Hi
- Bot
Hello, and welcome to Northside Home Services. I'm here to help you get started. What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
- Lead
my kitchen sink leaks
- Bot
Thanks for letting us know about the leaking kitchen sink. We can help you with that plumbing issue. What is the ZIP code of the address?
- Lead
60614
- Bot
Thank you, we have your ZIP code 60614 and the Plumbing service noted. Here are the time options for your visit. When would you like us to come: morning, afternoon, or a specific day? 1) Morning (8-12) 2) Afternoon (12-18) 3) A specific day
- Lead
morning
- Bot
These times are free: 1) Thu 12 Nov 08:00 Chicago 2) Thu 12 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
3
- Bot
Please reply with the number of one of these times: 1) Thu 12 Nov 08:00 Chicago 2) Thu 12 Nov 09:00 Chicago
- Lead
1
- Bot
Booked: Thu 12 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100101 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | POST /crm/v3/objects/notes/search | 200 | 1 | {
"total": 0,
"results": []
} | |
| crm | POST /crm/v3/objects/deals/search | 200 | 1 | {
"total": 0,
"results": []
} | |
| crm | POST /crm/v3/objects/contacts/search | 200 | 2 | {
"total": 1,
"results": [
{
"id": "901383867594",
"properties": {
"createdate": "2026-10-24T21:04:26.565Z",
"hs_object_id": "901383867594",
"hs_searchable_calculated_phone_number": "15550100101",
"lastmodifieddate": "2026-10-24T21:04:29.200Z"
},
"createdAt": "2026-10-24T21:04:26.565Z",
"updatedAt": "2026-10-24T21:04:29.200Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901383867594"
}
]
} | |
| calendar | GET /calendars/CAL/events?privateExtendedProperty=lwd_test%3D1&maxResults=250&showDeleted=false | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:04:01.283Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextPageToken": "[withheld: not a test object]",
"items": []
} | |
| calendar | GET /calendars/CAL/events?privateExtendedProperty=lwd_test%3D1&maxResults=250&showDeleted=false&pageToken=CkYKNgo0CgwIq4Xq1gYQmLT3nwISJAoiCiA3YTgyMjAwMTk5MzA0NTcyOTY1Y2E2MGU5Mzg2ZDRmMhoMCMe69NYGEICNxM4DwD4B | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:04:01.283Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": []
} | |
| outbox | SELECT outbox of wamid.TEST-f9ad0e86-2aa0-4179-b5aa-70356a8f8b0b | 6 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services. I'm here to help you get started. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-f9ad0e86-2aa0-4179-b5aa-70356a8f8b0b",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-f4feb9f4-187c-423c-95db-ee2aaefa68a9 | 7 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for letting us know about the leaking kitchen sink. We can help you with that plumbing issue. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-f4feb9f4-187c-423c-95db-ee2aaefa68a9",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-1f4b609a-d8b2-4ce6-b795-868646f4ac4c | 6 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, we have your ZIP code 60614 and the Plumbing service noted. Here are the time options for your visit. When would you like us to come: morning, afternoon, or a specific day?\n1) Morning (8-12…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-1f4b609a-d8b2-4ce6-b795-868646f4ac4c",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-d640318a-c998-4900-931e-5084164d25eb | 5 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-d640318a-c998-4900-931e-5084164d25eb",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-e82a861d-2d5f-4436-81e4-63929d101fd4 | 1 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Please reply with the number of one of these times:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago",
"step": "awaiting_pick",
"event_id": "wamid.TEST-e82a861d-2d5f-4436-81e4-63929d101fd4",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D7ae74794-ee00-4009-ba34-20b3142000fd | 200 | 2 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:04:25.834Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585751730707902\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:04:25.000Z",
"updated": "2026-10-24T21:04:25.353Z",
"summary": "[lwd-test] Plumbing - LWDTEST 15550100101",
"description": "Booked Thu 12 Nov 08:00 Chicago. ZIP 60614. Correlation 7ae74794-ee00-4009-ba34-20b3142000fd.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-12T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-12T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "7ae74794-ee00-4009-ba34-20b3142000fd"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| outbox | SELECT outbox of wamid.TEST-aa7d4c05-a150-4f68-83a3-9f35656e7413 | 5 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Thu 12 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-aa7d4c05-a150-4f68-83a3-9f35656e7413",
"offered_slots": null
} | ||
| calendar | GET /calendars/CAL/events/event-••• | 200 | 1 | {
"kind": "calendar#event",
"etag": "\"3585751730707902\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:04:25.000Z",
"updated": "2026-10-24T21:04:25.353Z",
"summary": "[lwd-test] Plumbing - LWDTEST 15550100101",
"description": "Booked Thu 12 Nov 08:00 Chicago. ZIP 60614. Correlation 7ae74794-ee00-4009-ba34-20b3142000fd.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-12T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-12T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "7ae74794-ee00-4009-ba34-20b3142000fd"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
} | |
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} | |
| crm | GET /crm/v3/objects/deals/530987814093?properties=dealname%2Cdealstage%2Cpipeline%2Cdescription | 200 | 1 | {
"id": "530987814093",
"properties": {
"createdate": "2026-10-24T21:04:27.482Z",
"dealname": "[lwd-test] Plumbing - LWDTEST 15550100101 - 7ae74794-ee00-4009-ba34-20b3142000fd",
"dealstage": "appointmentscheduled",
"description": "Booked Thu 12 Nov 08:00 Chicago. ZIP 60614. Correlation 7ae74794-ee00-4009-ba34-20b3142000fd.",
"hs_lastmodifieddate": "2026-10-24T21:04:28.009Z",
"hs_object_id": "530987814093",
"pipeline": "default"
},
"createdAt": "2026-10-24T21:04:27.482Z",
"updatedAt": "2026-10-24T21:04:28.009Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-3/530987814093"
} | |
| crm | GET /crm/v4/objects/deals/530987814093/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901383867594,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 3,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v3/objects/notes/532449277167?properties=hs_note_body | 200 | 1 | {
"id": "532449277167",
"properties": {
"hs_createdate": "2026-10-24T21:04:28.023Z",
"hs_lastmodifieddate": "2026-10-24T21:04:28.364Z",
"hs_note_body": "[lwd-test] Booked Plumbing: Thu 12 Nov 08:00 Chicago. ZIP 60614. Correlation 7ae74794-ee00-4009-ba34-20b3142000fd.",
"hs_object_id": "532449277167"
},
"createdAt": "2026-10-24T21:04:28.023Z",
"updatedAt": "2026-10-24T21:04:28.364Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/objects/0-46/views/all/list?filters=%5B%7B%22property%22%3A%22hs_object_id%22%2C%22operator%22%3A%22EQ%22%2C%22value%22%3A%22532449277167%22%7D%5D"
} | |
| crm | GET /crm/v4/objects/notes/532449277167/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901383867594,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 202,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/notes/532449277167/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 530987814093,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 214,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| outbox | SELECT outbox of 15550100101 | 1 | [
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services. I'm here to help you get started. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-f9ad0e86-2aa0-4179-b5aa-70356a8f8b0b",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for letting us know about the leaking kitchen sink. We can help you with that plumbing issue. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-f4feb9f4-187c-423c-95db-ee2aaefa68a9",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, we have your ZIP code 60614 and the Plumbing service noted. Here are the time options for your visit. When would you like us to come: morning, afternoon, or a specific day?\n1) Morning (8-12…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-1f4b609a-d8b2-4ce6-b795-868646f4ac4c",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-d640318a-c998-4900-931e-5084164d25eb",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Please reply with the number of one of these times:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago",
"step": "awaiting_pick",
"event_id": "wamid.TEST-e82a861d-2d5f-4436-81e4-63929d101fd4",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
"(+1 more)"
] | ||
| crm | GET /crm/v3/objects/contacts/901383867594?properties=phone%2Cfirstname%2Czip%2Cmessage | 200 | 1 | {
"id": "901383867594",
"properties": {
"createdate": "2026-10-24T21:04:26.565Z",
"firstname": "LWDTEST 15550100101",
"hs_object_id": "901383867594",
"lastmodifieddate": "2026-10-24T21:04:29.200Z",
"message": "Booking 7ae74794-ee00-4009-ba34-20b3142000fd: Thu 12 Nov 08:00 Chicago",
"phone": "+15550100101",
"zip": "60614"
},
"createdAt": "2026-10-24T21:04:26.565Z",
"updatedAt": "2026-10-24T21:04:29.200Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901383867594"
} | |
| crm | GET /crm/v3/objects/contacts/901383867594 | 200 | 1 | {
"id": "901383867594",
"properties": {
"createdate": "2026-10-24T21:04:26.565Z",
"email": null,
"firstname": "LWDTEST 15550100101",
"hs_object_id": "901383867594",
"lastmodifieddate": "2026-10-24T21:04:29.200Z",
"lastname": null
},
"createdAt": "2026-10-24T21:04:26.565Z",
"updatedAt": "2026-10-24T21:04:29.200Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901383867594"
} |
pass 2 The same event replayed at once and after 15 min → one booking
Live or injected: live, replay injected
pass What we did: 2 one event delivered 3 times (2 at once, 1 after 15 min) → deliveries 3, 3 receiver runs; 1 event, contact, deal, note, confirmation; phone map 1 row
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Wed 18 Nov 08:00 Chicago 2) Wed 18 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Wed 18 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100121 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-38910909-ed18-45be-82ca-7b5d36ef2c20 | 3 | {
"status": "test_held",
"recipient": "15550100121",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Wed 18 Nov 08:00 Chicago\n2) Wed 18 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-38910909-ed18-45be-82ca-7b5d36ef2c20",
"offered_slots": [
{
"n": 1,
"end": "2026-11-18T15:00:00.000Z",
"lead": null,
"label": "Wed 18 Nov 08:00 Chicago",
"start": "2026-11-18T14:00:00.000Z",
"business": {
"date": "2026-11-18",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-18T16:00:00.000Z",
"lead": null,
"label": "Wed 18 Nov 09:00 Chicago",
"start": "2026-11-18T15:00:00.000Z",
"business": {
"date": "2026-11-18",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of 15550100121 | 4 | [
{
"status": "test_held",
"recipient": "15550100121",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Wed 18 Nov 08:00 Chicago\n2) Wed 18 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-38910909-ed18-45be-82ca-7b5d36ef2c20",
"offered_slots": [
{
"n": 1,
"end": "2026-11-18T15:00:00.000Z",
"lead": null,
"label": "Wed 18 Nov 08:00 Chicago",
"start": "2026-11-18T14:00:00.000Z",
"business": {
"date": "2026-11-18",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-18T16:00:00.000Z",
"lead": null,
"label": "Wed 18 Nov 09:00 Chicago",
"start": "2026-11-18T15:00:00.000Z",
"business": {
"date": "2026-11-18",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100121",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Wed 18 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-9a043dbf-5e76-4518-9e16-3efea188f4f4",
"offered_slots": null
}
] | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D4e928069-eb90-405a-beec-e33a5636820c | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:09:11.079Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585752299397150\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:09:09.000Z",
"updated": "2026-10-24T21:09:09.698Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100121",
"description": "Booked Wed 18 Nov 08:00 Chicago. ZIP 60614. Correlation 4e928069-eb90-405a-beec-e33a5636820c.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-18T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-18T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "4e928069-eb90-405a-beec-e33a5636820c"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| crm | POST /crm/v3/objects/contacts/search | 200 | 2 | {
"total": 1,
"results": [
{
"id": "901373068509",
"properties": {
"createdate": "2026-10-24T21:09:11.112Z",
"hs_object_id": "901373068509",
"hs_searchable_calculated_phone_number": "15550100121",
"lastmodifieddate": "2026-10-24T21:09:15.001Z"
},
"createdAt": "2026-10-24T21:09:11.112Z",
"updatedAt": "2026-10-24T21:09:15.001Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901373068509"
}
]
} | |
| crm | GET /crm/v3/objects/contacts/901373068509 | 200 | 1 | {
"id": "901373068509",
"properties": {
"createdate": "2026-10-24T21:09:11.112Z",
"email": null,
"firstname": "LWDTEST planted 15550100121",
"hs_object_id": "901373068509",
"lastmodifieddate": "2026-10-24T21:09:15.001Z",
"lastname": null
},
"createdAt": "2026-10-24T21:09:11.112Z",
"updatedAt": "2026-10-24T21:09:15.001Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901373068509"
} | |
| crm | GET /crm/v4/objects/contacts/901373068509/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531183154374,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 4,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/contacts/901373068509/associations/notes | 200 | 1 | {
"results": [
{
"toObjectId": 532449280228,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 201,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} |
pass 3 An existing customer → updated, not duplicated
Live or injected: live
pass What we did: C3 #3 existing customer: a tagged contact «+1 (555) 010-0102» found by phone → updated, not duplicated
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Fri 13 Nov 08:00 Chicago 2) Fri 13 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Fri 13 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100102 | booked | booked | bot |
| 15550100105 | new | awaiting_zip | human |
| 15550100130 | new | awaiting_service | human |
| 15550100131 | new | awaiting_time_window | human |
| 15550100132 | new | awaiting_zip | human |
| 15550100133 | new | awaiting_service | human |
| 15550100134 | new | awaiting_zip | human |
| 15550100135 | new | awaiting_zip | human |
| 15550100140 | new | awaiting_time_window | human |
| 15550100145 | new | awaiting_zip | human |
| 15550100146 | new | awaiting_zip | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | POST /crm/v3/objects/contacts/search | 200 | 6 | {
"total": 2,
"results": [
{
"id": "901383867594",
"properties": {
"createdate": "2026-10-24T21:04:26.565Z",
"hs_object_id": "901383867594",
"hs_searchable_calculated_phone_number": "15550100101",
"lastmodifieddate": "2026-10-24T21:04:44.524Z"
},
"createdAt": "2026-10-24T21:04:26.565Z",
"updatedAt": "2026-10-24T21:04:44.524Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901383867594"
},
{
"id": "901102815422",
"properties": {
"createdate": "2026-10-24T21:04:42.704Z",
"hs_object_id": "901102815422",
"hs_searchable_calculated_phone_number": "15550100102",
"lastmodifieddate": "2026-10-24T21:05:00.211Z"
},
"createdAt": "2026-10-24T21:04:42.704Z",
"updatedAt": "2026-10-24T21:05:00.211Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901102815422"
}
]
} | |
| crm | GET /crm/v3/objects/contacts/901102815422 | 200 | 2 | {
"id": "901102815422",
"properties": {
"createdate": "2026-10-24T21:04:42.704Z",
"email": null,
"firstname": "LWDTEST C3 existing",
"hs_object_id": "901102815422",
"lastmodifieddate": "2026-10-24T21:05:00.211Z",
"lastname": null
},
"createdAt": "2026-10-24T21:04:42.704Z",
"updatedAt": "2026-10-24T21:05:00.211Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901102815422"
} | |
| outbox | SELECT outbox of wamid.TEST-67c7af68-d781-44f8-a786-7c0b63ede969 | 2 | {
"status": "test_held",
"recipient": "15550100102",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 13 Nov 08:00 Chicago\n2) Fri 13 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-67c7af68-d781-44f8-a786-7c0b63ede969",
"offered_slots": [
{
"n": 1,
"end": "2026-11-13T15:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 08:00 Chicago",
"start": "2026-11-13T14:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-13T16:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 09:00 Chicago",
"start": "2026-11-13T15:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-88be307b-f917-46d7-94e8-89e2efb46c3f | 5 | {
"status": "test_held",
"recipient": "15550100102",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Fri 13 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-88be307b-f917-46d7-94e8-89e2efb46c3f",
"offered_slots": null
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D082aad19-c150-42d7-9517-1aeeccfef7f9 | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:04:57.428Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585751792791710\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:04:56.000Z",
"updated": "2026-10-24T21:04:56.395Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100102",
"description": "Booked Fri 13 Nov 08:00 Chicago. ZIP 60614. Correlation 082aad19-c150-42d7-9517-1aeeccfef7f9.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-13T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-13T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "082aad19-c150-42d7-9517-1aeeccfef7f9"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| calendar | GET /calendars/CAL/events/event-••• | 200 | 1 | {
"kind": "calendar#event",
"etag": "\"3585751792791710\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:04:56.000Z",
"updated": "2026-10-24T21:04:56.395Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100102",
"description": "Booked Fri 13 Nov 08:00 Chicago. ZIP 60614. Correlation 082aad19-c150-42d7-9517-1aeeccfef7f9.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-13T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-13T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "082aad19-c150-42d7-9517-1aeeccfef7f9"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
} | |
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} | |
| crm | GET /crm/v3/objects/deals/531078870203?properties=dealname%2Cdealstage%2Cpipeline%2Cdescription | 200 | 1 | {
"id": "531078870203",
"properties": {
"createdate": "2026-10-24T21:04:58.289Z",
"dealname": "[lwd-test] Plumbing - LWDTEST planted 15550100102 - 082aad19-c150-42d7-9517-1aeeccfef7f9",
"dealstage": "appointmentscheduled",
"description": "Booked Fri 13 Nov 08:00 Chicago. ZIP 60614. Correlation 082aad19-c150-42d7-9517-1aeeccfef7f9.",
"hs_lastmodifieddate": "2026-10-24T21:04:58.812Z",
"hs_object_id": "531078870203",
"pipeline": "default"
},
"createdAt": "2026-10-24T21:04:58.289Z",
"updatedAt": "2026-10-24T21:04:58.812Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-3/531078870203"
} | |
| crm | GET /crm/v4/objects/deals/531078870203/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901102815422,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 3,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v3/objects/notes/532690179259?properties=hs_note_body | 200 | 1 | {
"id": "532690179259",
"properties": {
"hs_createdate": "2026-10-24T21:04:58.808Z",
"hs_lastmodifieddate": "2026-10-24T21:04:58.808Z",
"hs_note_body": "[lwd-test] Booked Plumbing: Fri 13 Nov 08:00 Chicago. ZIP 60614. Correlation 082aad19-c150-42d7-9517-1aeeccfef7f9.",
"hs_object_id": "532690179259"
},
"createdAt": "2026-10-24T21:04:58.808Z",
"updatedAt": "2026-10-24T21:04:58.808Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/objects/0-46/views/all/list?filters=%5B%7B%22property%22%3A%22hs_object_id%22%2C%22operator%22%3A%22EQ%22%2C%22value%22%3A%22532690179259%22%7D%5D"
} | |
| crm | GET /crm/v4/objects/notes/532690179259/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901102815422,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 202,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/notes/532690179259/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531078870203,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 214,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| outbox | SELECT outbox of 15550100102 | 1 | [
{
"status": "test_held",
"recipient": "15550100102",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 13 Nov 08:00 Chicago\n2) Fri 13 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-67c7af68-d781-44f8-a786-7c0b63ede969",
"offered_slots": [
{
"n": 1,
"end": "2026-11-13T15:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 08:00 Chicago",
"start": "2026-11-13T14:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-13T16:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 09:00 Chicago",
"start": "2026-11-13T15:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100102",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Fri 13 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-88be307b-f917-46d7-94e8-89e2efb46c3f",
"offered_slots": null
}
] | ||
| crm | GET /crm/v3/objects/contacts/901102815422?properties=zip%2Cfirstname%2Cphone | 200 | 1 | {
"id": "901102815422",
"properties": {
"createdate": "2026-10-24T21:04:42.704Z",
"firstname": "LWDTEST C3 existing",
"hs_object_id": "901102815422",
"lastmodifieddate": "2026-10-24T21:05:00.211Z",
"phone": "+1 (555) 010-0102",
"zip": "60614"
},
"createdAt": "2026-10-24T21:04:42.704Z",
"updatedAt": "2026-10-24T21:05:00.211Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901102815422"
} | |
| crm | GET /crm/v4/objects/contacts/901102815422/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531078870203,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 4,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/contacts/901102815422/associations/notes | 200 | 1 | {
"results": [
{
"toObjectId": 532690179259,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 201,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} |
pass 4 An ambiguous identity → a task for a person, no merge
Live or injected: live
pass What we did: 4 ambiguous identity: «LWDTEST Ana Ruiz» on another phone books → a contact of its own, the customer untouched, 1 human task + 1 alert naming both
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Thu 19 Nov 08:00 Chicago 2) Thu 19 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Thu 19 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100125 | booked | booked | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | POST /crm/v3/objects/contacts/search | 200 | 8 | {
"total": 2,
"results": [
{
"id": "901371665630",
"properties": {
"createdate": "2026-10-24T21:09:21.288Z",
"firstname": "LWDTEST Ana Ruiz",
"hs_object_id": "901371665630",
"lastmodifieddate": "2026-10-24T21:09:28.492Z"
},
"createdAt": "2026-10-24T21:09:21.288Z",
"updatedAt": "2026-10-24T21:09:28.492Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901371665630"
},
{
"id": "901370869984",
"properties": {
"createdate": "2026-10-24T21:10:11.956Z",
"firstname": "LWDTEST Ana Ruiz",
"hs_object_id": "901370869984",
"lastmodifieddate": "2026-10-24T21:10:15.518Z"
},
"createdAt": "2026-10-24T21:10:11.956Z",
"updatedAt": "2026-10-24T21:10:15.518Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901370869984"
}
]
} | |
| crm | GET /crm/v3/objects/contacts/901371665630 | 200 | 4 | {
"id": "901371665630",
"properties": {
"createdate": "2026-10-24T21:09:21.288Z",
"email": null,
"firstname": "LWDTEST Ana Ruiz",
"hs_object_id": "901371665630",
"lastmodifieddate": "2026-10-24T21:09:28.492Z",
"lastname": null
},
"createdAt": "2026-10-24T21:09:21.288Z",
"updatedAt": "2026-10-24T21:09:28.492Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901371665630"
} | |
| crm | GET /crm/v3/objects/contacts/901371665630?properties=createdate | 200 | 1 | {
"id": "901371665630",
"properties": {
"createdate": "2026-10-24T21:09:21.288Z",
"hs_object_id": "901371665630",
"lastmodifieddate": "2026-10-24T21:09:26.418Z"
},
"createdAt": "2026-10-24T21:09:21.288Z",
"updatedAt": "2026-10-24T21:09:26.418Z",
"archived": false,
"url": "[withheld: not a test object]"
} | |
| crm | GET /crm/v3/objects/contacts/901371665630?properties=phone%2Czip%2Cfirstname%2Clastmodifieddate | 200 | 2 | {
"id": "901371665630",
"properties": {
"createdate": "2026-10-24T21:09:21.288Z",
"firstname": "LWDTEST Ana Ruiz",
"hs_object_id": "901371665630",
"lastmodifieddate": "2026-10-24T21:09:28.492Z",
"phone": "+15550100124",
"zip": "60601"
},
"createdAt": "2026-10-24T21:09:21.288Z",
"updatedAt": "2026-10-24T21:09:28.492Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901371665630"
} | |
| outbox | SELECT outbox of wamid.TEST-d2d0ba9e-f2c5-4efc-9e01-08cd17beab2b | 2 | {
"status": "test_held",
"recipient": "15550100125",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 19 Nov 08:00 Chicago\n2) Thu 19 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-d2d0ba9e-f2c5-4efc-9e01-08cd17beab2b",
"offered_slots": [
{
"n": 1,
"end": "2026-11-19T15:00:00.000Z",
"lead": null,
"label": "Thu 19 Nov 08:00 Chicago",
"start": "2026-11-19T14:00:00.000Z",
"business": {
"date": "2026-11-19",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-19T16:00:00.000Z",
"lead": null,
"label": "Thu 19 Nov 09:00 Chicago",
"start": "2026-11-19T15:00:00.000Z",
"business": {
"date": "2026-11-19",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-76751a04-5c50-491a-af85-50b297777f2d | 5 | {
"status": "test_held",
"recipient": "15550100125",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Thu 19 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-76751a04-5c50-491a-af85-50b297777f2d",
"offered_slots": null
} | ||
| crm | GET /crm/v3/objects/contacts/901370869984 | 200 | 1 | {
"id": "901370869984",
"properties": {
"createdate": "2026-10-24T21:10:11.956Z",
"email": null,
"firstname": "LWDTEST Ana Ruiz",
"hs_object_id": "901370869984",
"lastmodifieddate": "2026-10-24T21:10:15.518Z",
"lastname": null
},
"createdAt": "2026-10-24T21:10:11.956Z",
"updatedAt": "2026-10-24T21:10:15.518Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901370869984"
} | |
| crm | GET /crm/v3/objects/contacts/901370869984?properties=phone%2Cfirstname | 200 | 1 | {
"id": "901370869984",
"properties": {
"createdate": "2026-10-24T21:10:11.956Z",
"firstname": "LWDTEST Ana Ruiz",
"hs_object_id": "901370869984",
"lastmodifieddate": "2026-10-24T21:10:15.518Z",
"phone": "+15550100125"
},
"createdAt": "2026-10-24T21:10:11.956Z",
"updatedAt": "2026-10-24T21:10:15.518Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901370869984"
} | |
| crm | GET /crm/v4/objects/deals/531190174935/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901370869984,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 3,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/notes/532729362630/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901370869984,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 202,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v3/objects/contacts/901371665630?propertiesWithHistory=phone,zip,firstname | 200 | 1 | {
"id": "901371665630",
"properties": {
"createdate": "2026-10-24T21:09:21.288Z",
"email": null,
"firstname": "LWDTEST Ana Ruiz",
"hs_object_id": "901371665630",
"lastmodifieddate": "2026-10-24T21:09:28.492Z",
"lastname": null
},
"propertiesWithHistory": {
"firstname": [
{
"value": "LWDTEST Ana Ruiz",
"timestamp": "2026-10-24T21:09:21.288Z",
"sourceType": "INTEGRATION",
"sourceId": "57864612"
}
],
"phone": [
{
"value": "+15550100124",
"timestamp": "2026-10-24T21:09:21.288Z",
"sourceType": "INTEGRATION",
"sourceId": "57864612"
}
],
"zip": [
{
"value": "60601",
"timestamp": "2026-10-24T21:09:21.288Z",
"sourceType": "INTEGRATION",
"sourceId": "57864612"
}
]
},
"createdAt": "2026-10-24T21:09:21.288Z",
"updatedAt": "2026-10-24T21:09:28.492Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901371665630"
} | |
| crm | GET /crm/v4/objects/contacts/901371665630/associations/deals | 200 | 1 | {
"results": []
} | |
| outbox | SELECT outbox of 15550100125 | 1 | [
{
"status": "cancelled",
"recipient": "15550100125",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 19 Nov 08:00 Chicago\n2) Thu 19 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-d2d0ba9e-f2c5-4efc-9e01-08cd17beab2b",
"offered_slots": [
{
"n": 1,
"end": "2026-11-19T15:00:00.000Z",
"lead": null,
"label": "Thu 19 Nov 08:00 Chicago",
"start": "2026-11-19T14:00:00.000Z",
"business": {
"date": "2026-11-19",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-19T16:00:00.000Z",
"lead": null,
"label": "Thu 19 Nov 09:00 Chicago",
"start": "2026-11-19T15:00:00.000Z",
"business": {
"date": "2026-11-19",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100125",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Thu 19 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-76751a04-5c50-491a-af85-50b297777f2d",
"offered_slots": null
}
] |
pass 5 Missing phone, e-mail present → the e-mail kept, nothing invented
Live or injected: live
pass What we did: 5 (amended) a typed e-mail is kept on the lead as typed; none typed → none kept (nothing invented); no model call for it
Expected: what the line above claims. Actual: every check of it held.
- Lead
my email is LWDtest105@example.com
- Bot
These times are free: 1) Tue 15 Dec 09:00 Chicago 2) Tue 15 Dec 10:00 Chicago Reply 1 or 2 to book.
- Lead
hello there, no email from me
- Bot
These times are free: 1) Tue 15 Dec 09:00 Chicago 2) Tue 15 Dec 10:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
Operations (calendar, CRM, sends): none.
| lead | status | step | mode |
|---|---|---|---|
| 15550100105 | new | awaiting_pick | bot |
| 15550100106 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-c1f9f4e0-243c-4d57-bb36-2de6cda4586c | 3 | {
"status": "test_held",
"recipient": "15550100105",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Tue 15 Dec 09:00 Chicago\n2) Tue 15 Dec 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-c1f9f4e0-243c-4d57-bb36-2de6cda4586c",
"offered_slots": [
{
"n": 1,
"end": "2026-12-15T16:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 09:00 Chicago",
"start": "2026-12-15T15:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-12-15T17:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 10:00 Chicago",
"start": "2026-12-15T16:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-26316c4f-c1b3-4312-bb42-3426e8e14ce3 | 3 | {
"status": "test_held",
"recipient": "15550100106",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Tue 15 Dec 09:00 Chicago\n2) Tue 15 Dec 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-26316c4f-c1b3-4312-bb42-3426e8e14ce3",
"offered_slots": [
{
"n": 1,
"end": "2026-12-15T16:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 09:00 Chicago",
"start": "2026-12-15T15:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-12-15T17:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 10:00 Chicago",
"start": "2026-12-15T16:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} |
pass 6 A lead in another language → handed to a person
Live or injected: live
pass What we did: D13 a language not in reply_languages, Sam's «Привет» → ONE English line that a person will reply, mode human, 1 task (R7)
Expected: what the line above claims. Actual: every check of it held.
- Lead
Привет
- Bot
Thank you, a person from our team will reply to you here.
Alerts: none.
Tasks for a person: none.
Operations (calendar, CRM, sends): none.
| lead | status | step | mode |
|---|---|---|---|
| 15550100144 | new | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-b787b214-a11d-4eb8-af8a-a2159a5fe938 | 2 | {
"status": "test_held",
"recipient": "15550100144",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, a person from our team will reply to you here.",
"step": null,
"event_id": "wamid.TEST-b787b214-a11d-4eb8-af8a-a2159a5fe938",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100144 | 1 | {
"step": null,
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100144 | 1 | {
"service": null,
"zip": null,
"time_window": null
} |
pass What we did: D13b a Latin-script language not listed (Spanish) → the ONE English line, mode human, 1 task «language», no words written by the model
Expected: what the line above claims. Actual: every check of it held.
- Lead
Hola, tengo una fuga de agua debajo del fregadero de la cocina.
- Bot
Thank you, a person from our team will reply to you here.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100127 | new | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-d63385b5-0b6e-4b92-9fea-4ba0db957ce5 | 5 | {
"status": "test_held",
"recipient": "15550100127",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, a person from our team will reply to you here.",
"step": null,
"event_id": "wamid.TEST-d63385b5-0b6e-4b92-9fea-4ba0db957ce5",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100127 | 1 | {
"step": null,
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100127 | 1 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} |
pass 7 No free slot in 7 days → the lead is told so, a task for a person
Live or injected: live, calendar planted
pass What we did: 7 no free slot in 7 days: the lead is told so and that a person will call; a human task no_slot; 0 holds, 0 calendar ops
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
Sorry, there is no free time in the next 7 days. A person from our team will call you to find a time.
Alerts: none.
Tasks for a person: none.
Operations (calendar, CRM, sends): none.
| lead | status | step | mode |
|---|---|---|---|
| 15550100107 | new | awaiting_time_window | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-416f6f74-835a-4359-819b-69f9f51877ee | 3 | {
"status": "test_held",
"recipient": "15550100107",
"provider_message_id": null,
"kind": "free_form",
"text": "Sorry, there is no free time in the next 7 days. A person from our team will call you to find a time.",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-416f6f74-835a-4359-819b-69f9f51877ee",
"offered_slots": null
} |
pass 8 Two leads choose one slot → one booked, one offered new times
Live or injected: live
pass What we did: C4 #8 two leads pick one slot at once (pause 3000 ms) → one event at 08:00, one hold; the loser re-offered 09:00 and 10:00
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Mon 16 Nov 08:00 Chicago 2) Mon 16 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
[image]
- Bot
These times are free: 1) Mon 16 Nov 08:00 Chicago 2) Mon 16 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Lead
1
- Bot
Sorry, that time was just taken. These times are free: 1) Mon 16 Nov 09:00 Chicago 2) Mon 16 Nov 10:00 Chicago Reply 1 or 2 to book.
- Bot
Booked: Mon 16 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100103 | new | awaiting_pick | bot |
| 15550100104 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-14ab5d0d-0f7b-4c31-b3d6-551ebe18e91a | 3 | {
"status": "test_held",
"recipient": "15550100103",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 16 Nov 08:00 Chicago\n2) Mon 16 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-14ab5d0d-0f7b-4c31-b3d6-551ebe18e91a",
"offered_slots": [
{
"n": 1,
"end": "2026-11-16T15:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 08:00 Chicago",
"start": "2026-11-16T14:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-16T16:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 09:00 Chicago",
"start": "2026-11-16T15:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-31074648-df86-4c46-848c-58777a03fe59 | 2 | {
"status": "test_held",
"recipient": "15550100104",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 16 Nov 08:00 Chicago\n2) Mon 16 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-31074648-df86-4c46-848c-58777a03fe59",
"offered_slots": [
{
"n": 1,
"end": "2026-11-16T15:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 08:00 Chicago",
"start": "2026-11-16T14:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-16T16:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 09:00 Chicago",
"start": "2026-11-16T15:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-6ed72115-0eba-4fa8-ba20-bd32dbdd7728 | 3 | {
"status": "test_held",
"recipient": "15550100103",
"provider_message_id": null,
"kind": "free_form",
"text": "Sorry, that time was just taken.\nThese times are free:\n1) Mon 16 Nov 09:00 Chicago\n2) Mon 16 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-6ed72115-0eba-4fa8-ba20-bd32dbdd7728",
"offered_slots": [
{
"n": 1,
"end": "2026-11-16T16:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 09:00 Chicago",
"start": "2026-11-16T15:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-16T17:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 10:00 Chicago",
"start": "2026-11-16T16:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-45ddc3f9-0dfd-49da-9f22-0eb11f491994 | 10 | {
"status": "test_held",
"recipient": "15550100104",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Mon 16 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-45ddc3f9-0dfd-49da-9f22-0eb11f491994",
"offered_slots": null
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&timeMin=2026-11-16T14%3A00%3A00.000Z&timeMax=2026-11-16T14%3A01%3A00.000Z | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:05:15.691Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585751830546110\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:05:15.000Z",
"updated": "2026-10-24T21:05:15.273Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100104",
"description": "Booked Mon 16 Nov 08:00 Chicago. ZIP 60614. Correlation b08f71ae-72a6-4483-b218-49ab0e22f54d.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-16T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-16T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "b08f71ae-72a6-4483-b218-49ab0e22f54d"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3Db08f71ae-72a6-4483-b218-49ab0e22f54d | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:05:15.691Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585751830546110\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:05:15.000Z",
"updated": "2026-10-24T21:05:15.273Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100104",
"description": "Booked Mon 16 Nov 08:00 Chicago. ZIP 60614. Correlation b08f71ae-72a6-4483-b218-49ab0e22f54d.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-16T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-16T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "b08f71ae-72a6-4483-b218-49ab0e22f54d"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| calendar | GET /calendars/CAL/events/event-••• | 200 | 1 | {
"kind": "calendar#event",
"etag": "\"3585751830546110\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:05:15.000Z",
"updated": "2026-10-24T21:05:15.273Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100104",
"description": "Booked Mon 16 Nov 08:00 Chicago. ZIP 60614. Correlation b08f71ae-72a6-4483-b218-49ab0e22f54d.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-16T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-16T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "b08f71ae-72a6-4483-b218-49ab0e22f54d"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
} | |
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} | |
| crm | GET /crm/v3/objects/deals/531107083510?properties=dealname%2Cdealstage%2Cpipeline%2Cdescription | 200 | 1 | {
"id": "531107083510",
"properties": {
"createdate": "2026-10-24T21:05:17.694Z",
"dealname": "[lwd-test] Plumbing - LWDTEST planted 15550100104 - b08f71ae-72a6-4483-b218-49ab0e22f54d",
"dealstage": "appointmentscheduled",
"description": "Booked Mon 16 Nov 08:00 Chicago. ZIP 60614. Correlation b08f71ae-72a6-4483-b218-49ab0e22f54d.",
"hs_lastmodifieddate": "2026-10-24T21:05:19.032Z",
"hs_object_id": "531107083510",
"pipeline": "default"
},
"createdAt": "2026-10-24T21:05:17.694Z",
"updatedAt": "2026-10-24T21:05:19.032Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-3/531107083510"
} | |
| crm | GET /crm/v4/objects/deals/531107083510/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901413432514,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 3,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v3/objects/notes/532697317573?properties=hs_note_body | 200 | 1 | {
"id": "532697317573",
"properties": {
"hs_createdate": "2026-10-24T21:05:18.231Z",
"hs_lastmodifieddate": "2026-10-24T21:05:18.842Z",
"hs_note_body": "[lwd-test] Booked Plumbing: Mon 16 Nov 08:00 Chicago. ZIP 60614. Correlation b08f71ae-72a6-4483-b218-49ab0e22f54d.",
"hs_object_id": "532697317573"
},
"createdAt": "2026-10-24T21:05:18.231Z",
"updatedAt": "2026-10-24T21:05:18.842Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/objects/0-46/views/all/list?filters=%5B%7B%22property%22%3A%22hs_object_id%22%2C%22operator%22%3A%22EQ%22%2C%22value%22%3A%22532697317573%22%7D%5D"
} | |
| crm | GET /crm/v4/objects/notes/532697317573/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901413432514,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 202,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/notes/532697317573/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531107083510,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 214,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| outbox | SELECT outbox of 15550100104 | 1 | [
{
"status": "test_held",
"recipient": "15550100104",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 16 Nov 08:00 Chicago\n2) Mon 16 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-31074648-df86-4c46-848c-58777a03fe59",
"offered_slots": [
{
"n": 1,
"end": "2026-11-16T15:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 08:00 Chicago",
"start": "2026-11-16T14:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-16T16:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 09:00 Chicago",
"start": "2026-11-16T15:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100104",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Mon 16 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-45ddc3f9-0dfd-49da-9f22-0eb11f491994",
"offered_slots": null
}
] | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3Da5b0d9e9-f526-4f9e-8dff-08b431f541d3 | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:05:15.691Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": []
} |
pass 9 The lead's time zone differs from the business's → both zones right
Live or injected: live
pass What we did: C5 #9 booking across zones: the +44 lead picks Mon 26 Oct → event 13:00Z in America/Chicago; both zones shown
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Mon 26 Oct 08:00 Chicago / 13:00 London 2) Mon 26 Oct 09:00 Chicago / 14:00 London Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Mon 26 Oct 08:00 Chicago / 13:00 London. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 447700900101 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-df8e22e7-ecd6-4498-869a-83bac03771f6 | 2 | {
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 26 Oct 08:00 Chicago / 13:00 London\n2) Mon 26 Oct 09:00 Chicago / 14:00 London\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-df8e22e7-ecd6-4498-869a-83bac03771f6",
"offered_slots": [
{
"n": 1,
"end": "2026-10-26T14:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "13:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 08:00 Chicago / 13:00 London",
"start": "2026-10-26T13:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-10-26T15:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "14:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 09:00 Chicago / 14:00 London",
"start": "2026-10-26T14:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-248b81f7-db4c-4531-ae0c-8d38e8bdef23 | 5 | {
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Mon 26 Oct 08:00 Chicago / 13:00 London.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-248b81f7-db4c-4531-ae0c-8d38e8bdef23",
"offered_slots": null
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D3d6580f1-b80b-47c8-ad24-6a8cee0b1406 | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:05:27.266Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585751853709470\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:05:26.000Z",
"updated": "2026-10-24T21:05:26.854Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 447700900101",
"description": "Booked Mon 26 Oct 08:00 Chicago / 13:00 London. ZIP 60614. Correlation 3d6580f1-b80b-47c8-ad24-6a8cee0b1406.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-10-26T08:00:00-05:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-10-26T09:00:00-05:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "3d6580f1-b80b-47c8-ad24-6a8cee0b1406"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| calendar | GET /calendars/CAL/events/event-••• | 200 | 2 | {
"kind": "calendar#event",
"etag": "\"3585751853709470\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:05:26.000Z",
"updated": "2026-10-24T21:05:26.854Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 447700900101",
"description": "Booked Mon 26 Oct 08:00 Chicago / 13:00 London. ZIP 60614. Correlation 3d6580f1-b80b-47c8-ad24-6a8cee0b1406.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-10-26T08:00:00-05:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-10-26T09:00:00-05:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "3d6580f1-b80b-47c8-ad24-6a8cee0b1406"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
} | |
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} | |
| crm | GET /crm/v3/objects/deals/531165186290?properties=dealname%2Cdealstage%2Cpipeline%2Cdescription | 200 | 1 | {
"id": "531165186290",
"properties": {
"createdate": "2026-10-24T21:05:29.168Z",
"dealname": "[lwd-test] Plumbing - LWDTEST planted 447700900101 - 3d6580f1-b80b-47c8-ad24-6a8cee0b1406",
"dealstage": "appointmentscheduled",
"description": "Booked Mon 26 Oct 08:00 Chicago / 13:00 London. ZIP 60614. Correlation 3d6580f1-b80b-47c8-ad24-6a8cee0b1406.",
"hs_lastmodifieddate": "2026-10-24T21:05:32.983Z",
"hs_object_id": "531165186290",
"pipeline": "default"
},
"createdAt": "2026-10-24T21:05:29.168Z",
"updatedAt": "2026-10-24T21:05:32.983Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-3/531165186290"
} | |
| crm | GET /crm/v4/objects/deals/531165186290/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901367420137,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 3,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v3/objects/notes/532467624129?properties=hs_note_body | 200 | 2 | {
"id": "532467624129",
"properties": {
"hs_createdate": "2026-10-24T21:05:31.044Z",
"hs_lastmodifieddate": "2026-10-24T21:05:31.394Z",
"hs_note_body": "[lwd-test] Booked Plumbing: Mon 26 Oct 08:00 Chicago / 13:00 London. ZIP 60614. Correlation 3d6580f1-b80b-47c8-ad24-6a8cee0b1406.",
"hs_object_id": "532467624129"
},
"createdAt": "2026-10-24T21:05:31.044Z",
"updatedAt": "2026-10-24T21:05:31.394Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/objects/0-46/views/all/list?filters=%5B%7B%22property%22%3A%22hs_object_id%22%2C%22operator%22%3A%22EQ%22%2C%22value%22%3A%22532467624129%22%7D%5D"
} | |
| crm | GET /crm/v4/objects/notes/532467624129/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901367420137,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 202,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/notes/532467624129/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531165186290,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 214,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| outbox | SELECT outbox of 447700900101 | 1 | [
{
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 26 Oct 08:00 Chicago / 13:00 London\n2) Mon 26 Oct 09:00 Chicago / 14:00 London\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-df8e22e7-ecd6-4498-869a-83bac03771f6",
"offered_slots": [
{
"n": 1,
"end": "2026-10-26T14:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "13:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 08:00 Chicago / 13:00 London",
"start": "2026-10-26T13:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-10-26T15:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "14:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 09:00 Chicago / 14:00 London",
"start": "2026-10-26T14:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Mon 26 Oct 08:00 Chicago / 13:00 London.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-248b81f7-db4c-4531-ae0c-8d38e8bdef23",
"offered_slots": null
}
] |
pass What we did: B5 zones (#9): +44 lead, clock Fri 23 Oct 19:00Z, «morning» → Mon 26 Oct 08:00 Chicago / 13:00 London and 09:00 / 14:00
Expected: what the line above claims. Actual: every check of it held.
- Lead
morning
- Bot
These times are free: 1) Mon 26 Oct 08:00 Chicago / 13:00 London 2) Mon 26 Oct 09:00 Chicago / 14:00 London Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 447700900101 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-1dfa5461-f55e-4749-bc41-6189f47af5d7 | 4 | {
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 26 Oct 08:00 Chicago / 13:00 London\n2) Mon 26 Oct 09:00 Chicago / 14:00 London\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-1dfa5461-f55e-4749-bc41-6189f47af5d7",
"offered_slots": [
{
"n": 1,
"end": "2026-10-26T14:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "13:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 08:00 Chicago / 13:00 London",
"start": "2026-10-26T13:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-10-26T15:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "14:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 09:00 Chicago / 14:00 London",
"start": "2026-10-26T14:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT leads of 447700900101 | 1 | {
"service": "Plumbing",
"zip": "60614",
"time_window": "Morning (8-12)"
} | ||
| outbox | SELECT outbox of 447700900101 | 1 | [
{
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 26 Oct 08:00 Chicago / 13:00 London\n2) Mon 26 Oct 09:00 Chicago / 14:00 London\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-1dfa5461-f55e-4749-bc41-6189f47af5d7",
"offered_slots": [
{
"n": 1,
"end": "2026-10-26T14:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "13:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 08:00 Chicago / 13:00 London",
"start": "2026-10-26T13:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-10-26T15:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "14:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 09:00 Chicago / 14:00 London",
"start": "2026-10-26T14:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
}
] |
pass 10 Calendar answers 500 → bounded retries, alert, task, «we will confirm»
Live or injected: injected (fault proxy)
pass What we did: 10 calendar 500: freeBusy answered 500 every time → exactly 3 tries reach n8n, then none; 0 events, op failed 500, hold not confirmed, alert (lead, calendar.freebusy) + human task, one «we will confirm» reply
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Tue 24 Nov 08:00 Chicago 2) Tue 24 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
We could not check Tue 24 Nov 08:00 Chicago with our calendar just now, so it is not booked yet. A person will look at it, and we will confirm by message soon.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | failed | 1 | freeBusy -> 500: The service was not able to process your request (500 - "{\"error\":{\"code\":500,\"message\":\"injected\"}}") | |
| outbox.calendar_failed | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100110 | new | awaiting_pick | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-e897fd6b-579a-4c80-a135-28b9ab11ba5a | 2 | {
"status": "test_held",
"recipient": "15550100110",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Tue 24 Nov 08:00 Chicago\n2) Tue 24 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-e897fd6b-579a-4c80-a135-28b9ab11ba5a",
"offered_slots": [
{
"n": 1,
"end": "2026-11-24T15:00:00.000Z",
"lead": null,
"label": "Tue 24 Nov 08:00 Chicago",
"start": "2026-11-24T14:00:00.000Z",
"business": {
"date": "2026-11-24",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-24T16:00:00.000Z",
"lead": null,
"label": "Tue 24 Nov 09:00 Chicago",
"start": "2026-11-24T15:00:00.000Z",
"business": {
"date": "2026-11-24",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-9aa0f572-a97f-4914-a74b-a9d432f94e33 | 9 | {
"status": "test_held",
"recipient": "15550100110",
"provider_message_id": null,
"kind": "free_form",
"text": "We could not check Tue 24 Nov 08:00 Chicago with our calendar just now, so it is not booked yet. A person will look at it, and we will confirm by message soon.",
"step": "calendar_failed",
"event_id": "wamid.TEST-9aa0f572-a97f-4914-a74b-a9d432f94e33",
"offered_slots": null
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D1903c5f7-0256-4e87-9b06-887a280b4324 | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:10:24.457Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": []
} | |
| outbox | SELECT outbox of 15550100110 | 1 | [
{
"status": "cancelled",
"recipient": "15550100110",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Tue 24 Nov 08:00 Chicago\n2) Tue 24 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-e897fd6b-579a-4c80-a135-28b9ab11ba5a",
"offered_slots": [
{
"n": 1,
"end": "2026-11-24T15:00:00.000Z",
"lead": null,
"label": "Tue 24 Nov 08:00 Chicago",
"start": "2026-11-24T14:00:00.000Z",
"business": {
"date": "2026-11-24",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-24T16:00:00.000Z",
"lead": null,
"label": "Tue 24 Nov 09:00 Chicago",
"start": "2026-11-24T15:00:00.000Z",
"business": {
"date": "2026-11-24",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100110",
"provider_message_id": null,
"kind": "free_form",
"text": "We could not check Tue 24 Nov 08:00 Chicago with our calendar just now, so it is not booked yet. A person will look at it, and we will confirm by message soon.",
"step": "calendar_failed",
"event_id": "wamid.TEST-9aa0f572-a97f-4914-a74b-a9d432f94e33",
"offered_slots": null
}
] |
pass 11 CRM answers 429 → retried, nothing lost
Live or injected: injected (fault proxy)
pass What we did: 11 CRM 429: HubSpot answers 429 (Retry-After 1) to the first 2 contact creates → the create is sent again: proxy 429, 429, 201; 1 live contact, 1 deal, 1 note; every CRM op done
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Fri 27 Nov 09:00 Chicago 2) Fri 27 Nov 10:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Fri 27 Nov 09:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100111 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-ab1bcd36-e852-414c-9970-3b378798129c | 3 | {
"status": "test_held",
"recipient": "15550100111",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 27 Nov 09:00 Chicago\n2) Fri 27 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-ab1bcd36-e852-414c-9970-3b378798129c",
"offered_slots": [
{
"n": 1,
"end": "2026-11-27T16:00:00.000Z",
"lead": null,
"label": "Fri 27 Nov 09:00 Chicago",
"start": "2026-11-27T15:00:00.000Z",
"business": {
"date": "2026-11-27",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-27T17:00:00.000Z",
"lead": null,
"label": "Fri 27 Nov 10:00 Chicago",
"start": "2026-11-27T16:00:00.000Z",
"business": {
"date": "2026-11-27",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of 15550100111 | 3 | [
{
"status": "test_held",
"recipient": "15550100111",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 27 Nov 09:00 Chicago\n2) Fri 27 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-ab1bcd36-e852-414c-9970-3b378798129c",
"offered_slots": [
{
"n": 1,
"end": "2026-11-27T16:00:00.000Z",
"lead": null,
"label": "Fri 27 Nov 09:00 Chicago",
"start": "2026-11-27T15:00:00.000Z",
"business": {
"date": "2026-11-27",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-27T17:00:00.000Z",
"lead": null,
"label": "Fri 27 Nov 10:00 Chicago",
"start": "2026-11-27T16:00:00.000Z",
"business": {
"date": "2026-11-27",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100111",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Fri 27 Nov 09:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-4c686af4-dd89-4b96-8017-aca525fc69b2",
"offered_slots": null
}
] | ||
| crm | POST /crm/v3/objects/contacts/search | 200 | 4 | {
"total": 2,
"results": [
{
"id": "901373079739",
"properties": {
"createdate": "2026-10-24T21:15:09.214Z",
"hs_object_id": "901373079739",
"hs_searchable_calculated_phone_number": "15550100114",
"lastmodifieddate": "2026-10-24T21:15:32.214Z"
},
"createdAt": "2026-10-24T21:15:09.214Z",
"updatedAt": "2026-10-24T21:15:32.214Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901373079739"
},
{
"id": "901383583983",
"properties": {
"createdate": "2026-10-24T21:16:38.739Z",
"hs_object_id": "901383583983",
"hs_searchable_calculated_phone_number": "15550100111",
"lastmodifieddate": "2026-10-24T21:16:46.196Z"
},
"createdAt": "2026-10-24T21:16:38.739Z",
"updatedAt": "2026-10-24T21:16:46.196Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901383583983"
}
]
} | |
| crm | GET /crm/v3/objects/contacts/901383583983 | 200 | 1 | {
"id": "901383583983",
"properties": {
"createdate": "2026-10-24T21:16:38.739Z",
"email": null,
"firstname": "LWDTEST planted 15550100111",
"hs_object_id": "901383583983",
"lastmodifieddate": "2026-10-24T21:16:46.196Z",
"lastname": null
},
"createdAt": "2026-10-24T21:16:38.739Z",
"updatedAt": "2026-10-24T21:16:46.196Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901383583983"
} | |
| crm | GET /crm/v4/objects/contacts/901383583983/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531202623709,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 4,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/contacts/901383583983/associations/notes | 200 | 1 | {
"results": [
{
"toObjectId": 532447194350,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 201,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} |
pass 12 CRM down and the n8n container restarted mid-run → reconciled, no duplicate
Live or injected: injected (fault proxy + restart)
pass What we did: 12 HubSpot down + the n8n CONTAINER restarted mid re-run (regular mode) → the sweeper re-drives the SAME booking key: 1 event, 1 contact, 1 deal, 1 note, 1 confirmation, all ops done; alert stuck_op then recovered
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Wed 25 Nov 08:00 Chicago 2) Wed 25 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Wed 25 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 2 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100112 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-69174851-ac2e-40b7-98a0-e0ad28cd4de4 | 3 | {
"status": "test_held",
"recipient": "15550100112",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Wed 25 Nov 08:00 Chicago\n2) Wed 25 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-69174851-ac2e-40b7-98a0-e0ad28cd4de4",
"offered_slots": [
{
"n": 1,
"end": "2026-11-25T15:00:00.000Z",
"lead": null,
"label": "Wed 25 Nov 08:00 Chicago",
"start": "2026-11-25T14:00:00.000Z",
"business": {
"date": "2026-11-25",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-25T16:00:00.000Z",
"lead": null,
"label": "Wed 25 Nov 09:00 Chicago",
"start": "2026-11-25T15:00:00.000Z",
"business": {
"date": "2026-11-25",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D059ef743-1db6-4ccf-8cfc-89eff67354e7 | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:11:42.775Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585752604114270\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:11:41.000Z",
"updated": "2026-10-24T21:11:42.057Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100112",
"description": "Booked Wed 25 Nov 08:00 Chicago. ZIP 60614. Correlation 059ef743-1db6-4ccf-8cfc-89eff67354e7.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-25T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-25T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "059ef743-1db6-4ccf-8cfc-89eff67354e7"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| crm | POST /crm/v3/objects/contacts/search | 200 | 1 | {
"total": 1,
"results": [
{
"id": "901371327705",
"properties": {
"createdate": "2026-10-24T21:13:01.746Z",
"hs_object_id": "901371327705",
"hs_searchable_calculated_phone_number": "15550100112",
"lastmodifieddate": "2026-10-24T21:13:14.587Z"
},
"createdAt": "2026-10-24T21:13:01.746Z",
"updatedAt": "2026-10-24T21:13:14.587Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901371327705"
}
]
} | |
| crm | GET /crm/v3/objects/contacts/901371327705 | 200 | 1 | {
"id": "901371327705",
"properties": {
"createdate": "2026-10-24T21:13:01.746Z",
"email": null,
"firstname": "LWDTEST planted 15550100112",
"hs_object_id": "901371327705",
"lastmodifieddate": "2026-10-24T21:13:14.587Z",
"lastname": null
},
"createdAt": "2026-10-24T21:13:01.746Z",
"updatedAt": "2026-10-24T21:13:14.587Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901371327705"
} | |
| crm | GET /crm/v4/objects/contacts/901371327705/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531200961761,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 4,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/contacts/901371327705/associations/notes | 200 | 1 | {
"results": [
{
"toObjectId": 532509295838,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 201,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| outbox | SELECT outbox of 15550100112 | 1 | [
{
"status": "test_held",
"recipient": "15550100112",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Wed 25 Nov 08:00 Chicago\n2) Wed 25 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-69174851-ac2e-40b7-98a0-e0ad28cd4de4",
"offered_slots": [
{
"n": 1,
"end": "2026-11-25T15:00:00.000Z",
"lead": null,
"label": "Wed 25 Nov 08:00 Chicago",
"start": "2026-11-25T14:00:00.000Z",
"business": {
"date": "2026-11-25",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-25T16:00:00.000Z",
"lead": null,
"label": "Wed 25 Nov 09:00 Chicago",
"start": "2026-11-25T15:00:00.000Z",
"business": {
"date": "2026-11-25",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100112",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Wed 25 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-f60326f6-5bde-4b9a-92e7-4e439fe0d6c7",
"offered_slots": null
}
] |
pass 13 A timeout after the write succeeded → no second booking
Live or injected: injected (fault proxy reset)
pass What we did: 13 timeout after success: Google writes the event, the proxy resets the socket → the same event id is sent again and answered 409 = booked: one event, the calendar op done with 409
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Mon 30 Nov 09:00 Chicago 2) Mon 30 Nov 10:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Mon 30 Nov 09:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100122 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-bb15e5a8-2323-42b8-b9a4-f0cbd4f37229 | 2 | {
"status": "test_held",
"recipient": "15550100122",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 30 Nov 09:00 Chicago\n2) Mon 30 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-bb15e5a8-2323-42b8-b9a4-f0cbd4f37229",
"offered_slots": [
{
"n": 1,
"end": "2026-11-30T16:00:00.000Z",
"lead": null,
"label": "Mon 30 Nov 09:00 Chicago",
"start": "2026-11-30T15:00:00.000Z",
"business": {
"date": "2026-11-30",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-30T17:00:00.000Z",
"lead": null,
"label": "Mon 30 Nov 10:00 Chicago",
"start": "2026-11-30T16:00:00.000Z",
"business": {
"date": "2026-11-30",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of 15550100122 | 6 | [
{
"status": "test_held",
"recipient": "15550100122",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 30 Nov 09:00 Chicago\n2) Mon 30 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-bb15e5a8-2323-42b8-b9a4-f0cbd4f37229",
"offered_slots": [
{
"n": 1,
"end": "2026-11-30T16:00:00.000Z",
"lead": null,
"label": "Mon 30 Nov 09:00 Chicago",
"start": "2026-11-30T15:00:00.000Z",
"business": {
"date": "2026-11-30",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-30T17:00:00.000Z",
"lead": null,
"label": "Mon 30 Nov 10:00 Chicago",
"start": "2026-11-30T16:00:00.000Z",
"business": {
"date": "2026-11-30",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100122",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Mon 30 Nov 09:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-bbd1c2c7-6232-4f75-97c4-36d20e89adf8",
"offered_slots": null
}
] | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D796b9c33-2559-4aac-9dc7-158e3a7c5014 | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:16:53.386Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585753225280958\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:16:52.000Z",
"updated": "2026-10-24T21:16:52.640Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100122",
"description": "Booked Mon 30 Nov 09:00 Chicago. ZIP 60614. Correlation 796b9c33-2559-4aac-9dc7-158e3a7c5014.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-30T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-30T10:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "796b9c33-2559-4aac-9dc7-158e3a7c5014"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} |
pass 14 The language model times out or answers badly → template fallback + alert
Live or injected: injected (test switch)
pass What we did: D14 an LLM timeout (knob 1): the template Q1 + 1 alert, extract op failed with the error; «1» → Plumbing by rule
Expected: what the line above claims. Actual: every check of it held.
- Lead
my sink leaks
- Bot
Hi, this is Northside Home Services (fictional). What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
- Lead
1
- Bot
What is the ZIP code of the address?
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | failed | 1 | ||
| alert | done | 1 | ||
| llm.extract | failed | 1 | ||
| alert | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100145 | new | awaiting_zip | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-e1300108-ccac-4ad4-905d-5f885d130cce | 1 | {
"status": "test_held",
"recipient": "15550100145",
"provider_message_id": null,
"kind": "free_form",
"text": "Hi, this is Northside Home Services (fictional). What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-e1300108-ccac-4ad4-905d-5f885d130cce",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-304911f7-7f65-46ee-b66f-060cbb5d0909 | 2 | {
"status": "test_held",
"recipient": "15550100145",
"provider_message_id": null,
"kind": "free_form",
"text": "What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-304911f7-7f65-46ee-b66f-060cbb5d0909",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100145 | 1 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT conversations of 15550100145 | 1 | {
"step": "awaiting_zip",
"offered_slots": null
} |
pass What we did: D14 an invalid model answer (knob 2: no tool call): the same
Expected: what the line above claims. Actual: every check of it held.
- Lead
my sink leaks
- Bot
Hi, this is Northside Home Services (fictional). What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
- Lead
1
- Bot
What is the ZIP code of the address?
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | failed | 1 | ||
| alert | done | 1 | ||
| llm.extract | failed | 1 | ||
| alert | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100146 | new | awaiting_zip | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-9befa7b4-aaf7-4697-a58c-a2d6f74529f9 | 3 | {
"status": "test_held",
"recipient": "15550100146",
"provider_message_id": null,
"kind": "free_form",
"text": "Hi, this is Northside Home Services (fictional). What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-9befa7b4-aaf7-4697-a58c-a2d6f74529f9",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-86a1d825-cec4-4d81-a6dd-7a439cc8ec45 | 5 | {
"status": "test_held",
"recipient": "15550100146",
"provider_message_id": null,
"kind": "free_form",
"text": "What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-86a1d825-cec4-4d81-a6dd-7a439cc8ec45",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100146 | 1 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT conversations of 15550100146 | 1 | {
"step": "awaiting_zip",
"offered_slots": null
} |
pass 15 The lead asks for a person → bot frozen, queued sends cancelled
Live or injected: live
pass What we did: D12 asks for a person: a held send planted (send_after +1 h) → «can I talk to a real person?» → cancelled, mode human, one ack; «hello?» → nothing
Expected: what the line above claims. Actual: every check of it held.
- Bot
LWDTEST planted follow-up
- Lead
can I talk to a real person?
- Bot
Of course. Thank you, a person from our team will reply to you here.
- Lead
hello?
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100143 | new | awaiting_zip | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-256c4872-5e2a-4351-8410-c7fd68c43f72 | 3 | {
"status": "test_held",
"recipient": "15550100143",
"provider_message_id": null,
"kind": "free_form",
"text": "Of course. Thank you, a person from our team will reply to you here.",
"step": "awaiting_zip",
"event_id": "wamid.TEST-256c4872-5e2a-4351-8410-c7fd68c43f72",
"offered_slots": null
} | ||
| outbox | SELECT outbox of 15550100143 | 2 | [
{
"status": "cancelled",
"recipient": "15550100143",
"provider_message_id": null,
"kind": "free_form",
"text": "LWDTEST planted follow-up",
"step": null,
"event_id": null,
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100143",
"provider_message_id": null,
"kind": "free_form",
"text": "Of course. Thank you, a person from our team will reply to you here.",
"step": "awaiting_zip",
"event_id": "wamid.TEST-256c4872-5e2a-4351-8410-c7fd68c43f72",
"offered_slots": null
}
] | ||
| outbox | SELECT conversations of 15550100143 | 1 | {
"step": "awaiting_zip",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100143 | 1 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT outbox of wamid.TEST-d588ea28-f9dc-4384-8760-4c154c5d86ca | 1 | null |
pass 16 A person replies while a bot send is queued → the bot send is not delivered
Live or injected: live
actual state shown from our operations log; the tests read CRM, calendar and outbox by API during the run.
pass What we did: 16 a person replies while a bot send waits for its send_after → the waiting send is never held or sent but cancelled by the takeover; mode human at the clock; the person's row kept; a forged takeover changes nothing
Expected: what the line above claims. Actual: every check of it held.
- Bot
LWDTEST planted bot follow-up
- Bot
Hi, this is Dana from Northside. I will call you at 3 pm.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| outbox.human_reply | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100116 | new | awaiting_zip | human |
pass 17 A silent lead → one follow-up inside 24 h; STOP → nothing more, consent logged
Live or injected: live, clock injected
actual state shown from our operations log; the tests read CRM, calendar and outbox by API during the run.
pass What we did: 17 a silent lead: ONE follow-up inside the 24 h window measured from its last message on the injected clock (T+23 h), none more at T+23.5 h; STOP → suppression with its evidence, pending rows cancelled, nothing at T+47 h
Expected: what the line above claims. Actual: every check of it held.
- Bot
Just checking in: we still have your request. What is the ZIP code of the address?
- Lead
STOP
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| outbox.follow_up | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100117 | new | awaiting_zip | bot |
pass 18 The 24 h window closed → a template or a person, never free text
Live or injected: live, clock injected
actual state shown from our operations log; the tests read CRM, calendar and outbox by API during the run.
pass What we did: 18 the window closed (T+25 h): no template → no free text, a person gets the lead (window_closed); a planted approved template → one template row; a lead that never wrote (a form click) → nothing
Expected: what the line above claims. Actual: every check of it held.
- Bot
[template lwd_follow_up]
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100118 | new | awaiting_zip | human |
| 15550100128 | new | awaiting_zip | bot |
| 15550100138 | new | awaiting_zip | bot |
pass 19 Reschedule → the old slot is freed only after the new one is booked
Live or injected: live
pass What we did: 19 reschedule (rules, 0 LLM): a booked lead says «can we reschedule?» → a new offer without its own slot → «1» → the new event booked and on the lead BEFORE the old event is cancelled and its hold freed
Expected: what the line above claims. Actual: every check of it held.
- Lead
can we reschedule please?
- Bot
Your visit stays booked until you pick a new time. These times are free: 1) Tue 15 Dec 08:00 Chicago 2) Tue 15 Dec 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Tue 15 Dec 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| calendar.cancel | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100119 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-653e8c0f-357b-45d3-98a3-bedf47f1aa94 | 2 | {
"status": "test_held",
"recipient": "15550100119",
"provider_message_id": null,
"kind": "free_form",
"text": "Your visit stays booked until you pick a new time.\nThese times are free:\n1) Tue 15 Dec 08:00 Chicago\n2) Tue 15 Dec 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-653e8c0f-357b-45d3-98a3-bedf47f1aa94",
"offered_slots": [
{
"n": 1,
"end": "2026-12-15T15:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 08:00 Chicago",
"start": "2026-12-15T14:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-12-15T16:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 09:00 Chicago",
"start": "2026-12-15T15:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D2f2a476c-02d7-4404-911c-b5a2c2db579a | 200 | 2 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:14:48.800Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585752963513502\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:14:41.000Z",
"updated": "2026-10-24T21:14:41.756Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100119",
"description": "Booked Tue 15 Dec 08:00 Chicago. ZIP 60614. Correlation 2f2a476c-02d7-4404-911c-b5a2c2db579a.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-12-15T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-12-15T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "2f2a476c-02d7-4404-911c-b5a2c2db579a"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| outbox | SELECT outbox of 15550100119 | 1 | [
{
"status": "test_held",
"recipient": "15550100119",
"provider_message_id": null,
"kind": "free_form",
"text": "Your visit stays booked until you pick a new time.\nThese times are free:\n1) Tue 15 Dec 08:00 Chicago\n2) Tue 15 Dec 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-653e8c0f-357b-45d3-98a3-bedf47f1aa94",
"offered_slots": [
{
"n": 1,
"end": "2026-12-15T15:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 08:00 Chicago",
"start": "2026-12-15T14:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-12-15T16:00:00.000Z",
"lead": null,
"label": "Tue 15 Dec 09:00 Chicago",
"start": "2026-12-15T15:00:00.000Z",
"business": {
"date": "2026-12-15",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100119",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Tue 15 Dec 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-5256afd2-76c7-4cbd-b3c4-c22a7427305a",
"offered_slots": null
}
] | ||
| calendar | GET /calendars/CAL/events/event-••• | 200 | 1 | {
"kind": "calendar#event",
"etag": "\"3585752977601278\"",
"id": "event-•••",
"status": "cancelled",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:14:37.000Z",
"updated": "2026-10-24T21:14:48.800Z",
"summary": "[lwd-test] fixture 2f2a476c-02d7-4404-911c-b5a2c2db579a",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-12-10T08:00:00-06:00",
"timeZone": "UTC"
},
"end": {
"dateTime": "2026-12-10T09:00:00-06:00",
"timeZone": "UTC"
},
"iCalUID": "event-•••@google.com",
"sequence": 1,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "2f2a476c-02d7-4404-911c-b5a2c2db579a"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
} |
by design 20 Webhook valid / bad signature / replayed → only the valid one acts
Proven by npm run check (the signature and receive checks), not by the harness.
node --import tsx --test test/signature.test.ts test/receive.test.ts: 11 pass · 0 fail
More checks beyond the 20
210 checks · 210 pass · 0 fail · 0 blocked
pass A1 n8n holds the five vars of D4 (set/empty only), the key mount is read-only, three credentials
pass What we did: A1 n8n holds the five vars of D4 (set/empty only), the key mount is read-only, three credentials
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass A2 by API from the host: Calendar freeBusy on GOOGLE_CALENDAR_ID → 200 with no errors
pass What we did: A2 by API from the host: Calendar freeBusy on GOOGLE_CALENDAR_ID → 200 with no errors
Expected: what the line above claims. Actual: every check of it held.
# A2 HubSpot first deal stage id: appointmentscheduled # A2 runtime_config model: claude-haiku-5-5
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| calendar | POST /freeBusy | 200 | 1 | {
"kind": "[withheld: not a test object]",
"timeMin": "2026-10-24T21:02:59.598Z",
"timeMax": "2026-10-25T21:02:59.598Z",
"calendars": {
"CAL": {
"busy": []
}
}
} |
pass A2 by API from the host: a HubSpot first deal stage; the runtime_config model is a haiku in /v1/models
pass What we did: A2 by API from the host: a HubSpot first deal stage; the runtime_config model is a haiku in /v1/models
Expected: what the line above claims. Actual: every check of it held.
# A2 HubSpot first deal stage id: appointmentscheduled # A2 runtime_config model: claude-haiku-5-5
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} |
pass A2 from inside n8n: freeBusy through the googleApi credential and pipelines through httpHeaderAuth → 200
pass What we did: A2 from inside n8n: freeBusy through the googleApi credential and pipelines through httpHeaderAuth → 200
Expected: what the line above claims. Actual: every check of it held.
# A2 HubSpot first deal stage id: appointmentscheduled # A2 runtime_config model: claude-haiku-5-5
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} |
pass A2 no `claude-` model literal in any workflow (the model comes from runtime_config)
pass What we did: A2 no `claude-` model literal in any workflow (the model comes from runtime_config)
Expected: what the line above claims. Actual: every check of it held.
# A2 HubSpot first deal stage id: appointmentscheduled # A2 runtime_config model: claude-haiku-5-5
No row of a test lead was written while this test ran.
pass A3 note probe: a tagged contact + deal + note on both, then all three deleted → each 2xx
pass What we did: A3 note probe: a tagged contact + deal + note on both, then all three deleted → each 2xx
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} | |
| crm | GET /crm/v4/objects/notes/532550011085/associations/contacts | 200 | 1 | {
"results": [
{
"toObjectId": 901415522541,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 202,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/notes/532550011085/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 531190171896,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 214,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} |
pass A4 sweep, wrong state: tagged contact, deal, note and event left behind → harness:sweep → 0 tagged, samples unchanged
pass What we did: A4 sweep, wrong state: tagged contact, deal, note and event left behind → harness:sweep → 0 tagged, samples unchanged
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | GET /crm/v3/objects/contacts?limit=100&properties=firstname | 200 | 2 | {
"results": [
{
"id": "896570288368",
"properties": {
"createdate": "2026-10-20T13:00:51.685Z",
"firstname": "[withheld: not a test object]",
"hs_object_id": "896570288368",
"lastmodifieddate": "2026-10-20T21:41:12.004Z"
},
"createdAt": "2026-10-20T13:00:51.685Z",
"updatedAt": "2026-10-20T21:41:12.004Z",
"archived": false,
"url": "[withheld: not a test object]"
},
{
"id": "896573418744",
"properties": {
"createdate": "2026-10-20T13:00:52.269Z",
"firstname": "[withheld: not a test object]",
"hs_object_id": "896573418744",
"lastmodifieddate": "2026-10-23T13:03:32.049Z"
},
"createdAt": "2026-10-20T13:00:52.269Z",
"updatedAt": "2026-10-23T13:03:32.049Z",
"archived": false,
"url": "[withheld: not a test object]"
},
{
"id": "897890018515",
"properties": {
"createdate": "2026-10-21T11:59:37.848Z",
"firstname": "[withheld: not a test object]",
"hs_object_id": "897890018515",
"lastmodifieddate": "2026-10-21T19:53:13.592Z"
},
"createdAt": "2026-10-21T11:59:37.848Z",
"updatedAt": "2026-10-21T19:53:13.592Z",
"archived": false,
"url": "[withheld: not a test object]"
}
]
} | |
| crm | GET /crm/v3/pipelines/deals | 200 | 1 | {
"results": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"id": "default",
"stages": [
{
"label": "[withheld: not a test object]",
"displayOrder": 0,
"metadata": {
"isClosed": "false",
"probability": "0.2"
},
"id": "appointmentscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 1,
"metadata": {
"isClosed": "false",
"probability": "0.4"
},
"id": "qualifiedtobuy",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 2,
"metadata": {
"isClosed": "false",
"probability": "0.6"
},
"id": "presentationscheduled",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 3,
"metadata": {
"isClosed": "false",
"probability": "0.8"
},
"id": "decisionmakerboughtin",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
{
"label": "[withheld: not a test object]",
"displayOrder": 4,
"metadata": {
"isClosed": "false",
"probability": "0.9"
},
"id": "contractsent",
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"writePermissions": "[withheld: not a test object]",
"archived": false
},
"(+2 more)"
],
"createdAt": "1970-01-01T00:00:00Z",
"updatedAt": "1970-01-01T00:00:00Z",
"archived": false
}
]
} | |
| crm | POST /crm/v3/objects/contacts/search | 200 | 4 | {
"total": 0,
"results": []
} | |
| crm | POST /crm/v3/objects/deals/search | 200 | 4 | {
"total": 1,
"results": []
} | |
| crm | POST /crm/v3/objects/notes/search | 200 | 4 | {
"total": 1,
"results": []
} | |
| crm | GET /crm/v3/objects/contacts/901379653864 | 404 | 1 | {} | |
| crm | GET /crm/v3/objects/deals/530980572346 | 404 | 1 | {} | |
| crm | GET /crm/v3/objects/notes/532447186146 | 404 | 1 | {} | |
| calendar | GET /calendars/CAL/events?privateExtendedProperty=lwd_test%3D1&maxResults=250&showDeleted=false | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:03:19.586Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextPageToken": "[withheld: not a test object]",
"items": []
} | |
| calendar | GET /calendars/CAL/events?privateExtendedProperty=lwd_test%3D1&maxResults=250&showDeleted=false&pageToken=CkUKNgo0CgwIq4Xq1gYQmLT3nwISJAoiCiA3YTgyMjAwMTk5MzA0NTcyOTY1Y2E2MGU5Mzg2ZDRmMhoLCJq69NYGEID780nAPgE%3D | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:03:19.586Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": []
} |
pass A5 routing, wrong state: an S0-shaped message on TEST-PHONE-ID → 200, processed, no lead/outbox/operation
pass What we did: A5 routing, wrong state: an S0-shaped message on TEST-PHONE-ID → 200, processed, no lead/outbox/operation
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass A5 no wall clock in workflows: no Date.now(), argument-less new Date(), $now or $today (D2)
pass What we did: A5 no wall clock in workflows: no Date.now(), argument-less new Date(), $now or $today (D2)
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass A5 the standing tests stay green (`npm run test`: 0 failed, at least 28 passed)
pass What we did: A5 the standing tests stay green (`npm run test`: 0 failed, at least 28 passed)
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass gate: a service outside the options is refused, an option is kept
pass What we did: gate: a service outside the options is refused, an option is kept
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass gate: ZIP is exactly five digits — 4 digits, 6 digits, a padded or lettered one refused; 60614 kept
pass What we did: gate: ZIP is exactly five digits — 4 digits, 6 digits, a padded or lettered one refused; 60614 kept
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass gate: a field already held is never overwritten by the model unless the lead takes it back (`corrects`, S1d-2); the first OPEN question is asked next
pass What we did: gate: a field already held is never overwritten by the model unless the lead takes it back (`corrects`, S1d-2); the first OPEN question is asked next
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass next step: all three valid → the offer over a 7-day freeBusy horizon from the injected clock
pass What we did: next step: all three valid → the offer over a 7-day freeBusy horizon from the injected clock
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass outbox status: held unless the number is in LIVE_RECIPIENTS (spaces and + ignored), never by default
pass What we did: outbox status: held unless the number is in LIVE_RECIPIENTS (spaces and + ignored), never by default
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass plan: the model is asked only for a non-empty text while a field is open; never at a pick, a replay or a human
pass What we did: plan: the model is asked only for a non-empty text while a field is open; never at a pick, a replay or a human
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass plan: the model request holds the open fields' schema and the lead's words — no clock, no calendar
pass What we did: plan: the model request holds the open fields' schema and the lead's words — no clock, no calendar
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: a block ending AT a slot's start or starting AT its end leaves it free; an overlap of one minute does not
pass What we did: offer: a block ending AT a slot's start or starting AT its end leaves it free; an overlap of one minute does not
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: a slot must END by the close and by the window's end; a slot starting AT the clock is not offered
pass What we did: offer: a slot must END by the close and by the window's end; a slot starting AT the clock is not offered
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: closed days are skipped; a window without hours (a specific day) is the whole open day; two slots
pass What we did: offer: closed days are skipped; a window without hours (a specific day) is the whole open day; two slots
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: no slot that ends past the freeBusy horizon; none at all → an error, never an empty offer
pass What we did: offer: no slot that ends past the freeBusy horizon; none at all → an error, never an empty offer
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: zones by Intl — the UK and US DST week, a +44 lead; +1 and unknown codes see the business zone only
pass What we did: offer: zones by Intl — the UK and US DST week, a +44 lead; +1 and unknown codes see the business zone only
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: the longest calling code wins; a lead zone equal to the business zone is not shown twice
pass What we did: offer: the longest calling code wins; a lead zone equal to the business zone is not shown twice
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: when the lead's date differs from the business date, the lead's day is named
pass What we did: offer: when the lead's date differs from the business date, the lead's day is named
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: whatever the model's answer holds besides the window (a time it read), the slots are the calendar's
pass What we did: offer: whatever the model's answer holds besides the window (a time it read), the slots are the calendar's
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: a freeBusy failure or a calendar error stops the flow (no offer from a blind calendar)
pass What we did: offer: a freeBusy failure or a calendar error stops the flow (no offer from a blind calendar)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass B1 «Hi» → Q1 verbatim; sink leak → Plumbing; 60614 → zip; morning → Morning (8-12); all held, row schema-valid
pass What we did: B1 «Hi» → Q1 verbatim; sink leak → Plumbing; 60614 → zip; morning → Morning (8-12); all held, row schema-valid
Expected: what the line above claims. Actual: every check of it held.
- Lead
Hi
- Bot
Hello, and welcome to Northside Home Services (fictional). Thanks for getting in touch. What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
- Lead
my kitchen sink leaks
- Bot
Thanks for letting us know about the leak in your kitchen sink. I can help you arrange a plumbing visit. What is the ZIP code of the address?
- Lead
60614
- Bot
Thank you, we have your ZIP code 60614 and your plumbing request noted. Please choose a time window below. When would you like us to come: morning, afternoon, or a specific day? 1) Morning (8-12) 2) Afternoon (12-18) 3) A specific day
- Lead
morning
- Bot
These times are free: 1) Thu 12 Nov 08:00 Chicago 2) Thu 12 Nov 09:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100101 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-e5600028-b5d8-441c-91ff-b871941a9e53 | 5 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services (fictional). Thanks for getting in touch. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-e5600028-b5d8-441c-91ff-b871941a9e53",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-eccec201-54a6-40fb-8611-54a9ebcccf9e | 5 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for letting us know about the leak in your kitchen sink. I can help you arrange a plumbing visit. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-eccec201-54a6-40fb-8611-54a9ebcccf9e",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100101 | 3 | {
"service": "Plumbing",
"zip": "60614",
"time_window": "Morning (8-12)"
} | ||
| outbox | SELECT outbox of wamid.TEST-1047f8cf-a6b7-43b0-b04e-62a787e690ee | 6 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, we have your ZIP code 60614 and your plumbing request noted. Please choose a time window below. When would you like us to come: morning, afternoon, or a specific day?\n1) Morning (8-12)\n2) A…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-1047f8cf-a6b7-43b0-b04e-62a787e690ee",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-8e8f00d1-f9de-4acf-8aed-49765d7f6a89 | 6 | {
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-8e8f00d1-f9de-4acf-8aed-49765d7f6a89",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT conversations of 15550100101 | 1 | {
"step": "awaiting_pick",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of 15550100101 | 1 | [
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services (fictional). Thanks for getting in touch. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-e5600028-b5d8-441c-91ff-b871941a9e53",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for letting us know about the leak in your kitchen sink. I can help you arrange a plumbing visit. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-eccec201-54a6-40fb-8611-54a9ebcccf9e",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, we have your ZIP code 60614 and your plumbing request noted. Please choose a time window below. When would you like us to come: morning, afternoon, or a specific day?\n1) Morning (8-12)\n2) A…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-1047f8cf-a6b7-43b0-b04e-62a787e690ee",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-8e8f00d1-f9de-4acf-8aed-49765d7f6a89",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
}
] |
pass B2 image-only and empty text → Q1 again, field NULL; ZIP «6061» → Q2 again, zip NULL
pass What we did: B2 image-only and empty text → Q1 again, field NULL; ZIP «6061» → Q2 again, zip NULL
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Lead
- Lead
6061
- Bot
The ZIP code you sent, 6061, is not valid because a ZIP code has exactly 5 digits. Please check it and send the correct 5-digit code. What is the ZIP code of the address?
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100105 | new | awaiting_zip | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-695b5230-1a1b-4a0c-babb-a4990d7c982a | 3 | {
"status": "test_held",
"recipient": "15550100105",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, this is Northside Home Services (fictional). I can't open attachments here, so please type your answer in a message. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical…",
"step": "awaiting_service",
"event_id": "wamid.TEST-695b5230-1a1b-4a0c-babb-a4990d7c982a",
"offered_slots": null
} | ||
| outbox | SELECT outbox of 15550100105 | 2 | [
{
"status": "test_held",
"recipient": "15550100105",
"provider_message_id": null,
"kind": "free_form",
"text": "The ZIP code you sent, 6061, is not valid because a ZIP code has exactly 5 digits. Please check it and send the correct 5-digit code. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-62091507-6fa1-4435-9669-e7d4db5cd7f3",
"offered_slots": null
}
] | ||
| outbox | SELECT outbox of wamid.TEST-16eee1fc-e60b-4ea0-a807-ff44351cb637 | 4 | {
"status": "test_held",
"recipient": "15550100105",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for getting in touch with Northside Home Services. I can help you get started. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-16eee1fc-e60b-4ea0-a807-ff44351cb637",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100105 | 2 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT outbox of wamid.TEST-62091507-6fa1-4435-9669-e7d4db5cd7f3 | 5 | {
"status": "test_held",
"recipient": "15550100105",
"provider_message_id": null,
"kind": "free_form",
"text": "The ZIP code you sent, 6061, is not valid because a ZIP code has exactly 5 digits. Please check it and send the correct 5-digit code. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-62091507-6fa1-4435-9669-e7d4db5cd7f3",
"offered_slots": null
} |
pass B3 the model never decides: busy 08:00–09:00 CST, «8am please, I know you're free» → Mon 9 Nov 09:00 and 10:00 CST
pass What we did: B3 the model never decides: busy 08:00–09:00 CST, «8am please, I know you're free» → Mon 9 Nov 09:00 and 10:00 CST
Expected: what the line above claims. Actual: every check of it held.
- Lead
8am please, I know you're free
- Bot
These times are free: 1) Mon 9 Nov 09:00 Chicago 2) Mon 9 Nov 10:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100106 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| calendar | POST /freeBusy | 200 | 1 | {
"kind": "[withheld: not a test object]",
"timeMin": "2026-11-09T14:00:00.000Z",
"timeMax": "2026-11-09T15:00:00.000Z",
"calendars": {
"CAL": {
"busy": [
{
"start": "2026-11-09T14:00:00Z",
"end": "2026-11-09T15:00:00Z"
}
]
}
}
} | |
| outbox | SELECT outbox of wamid.TEST-26123c74-7a7a-4b3e-a459-e960348afc6e | 5 | {
"status": "test_held",
"recipient": "15550100106",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 9 Nov 09:00 Chicago\n2) Mon 9 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-26123c74-7a7a-4b3e-a459-e960348afc6e",
"offered_slots": [
{
"n": 1,
"end": "2026-11-09T16:00:00.000Z",
"lead": null,
"label": "Mon 9 Nov 09:00 Chicago",
"start": "2026-11-09T15:00:00.000Z",
"business": {
"date": "2026-11-09",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-09T17:00:00.000Z",
"lead": null,
"label": "Mon 9 Nov 10:00 Chicago",
"start": "2026-11-09T16:00:00.000Z",
"business": {
"date": "2026-11-09",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT leads of 15550100106 | 1 | {
"service": "Plumbing",
"zip": "60614",
"time_window": "Morning (8-12)"
} | ||
| outbox | SELECT conversations of 15550100106 | 1 | {
"step": "awaiting_pick",
"offered_slots": [
{
"n": 1,
"end": "2026-11-09T16:00:00.000Z",
"lead": null,
"label": "Mon 9 Nov 09:00 Chicago",
"start": "2026-11-09T15:00:00.000Z",
"business": {
"date": "2026-11-09",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-09T17:00:00.000Z",
"lead": null,
"label": "Mon 9 Nov 10:00 Chicago",
"start": "2026-11-09T16:00:00.000Z",
"business": {
"date": "2026-11-09",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of 15550100106 | 1 | [
{
"status": "test_held",
"recipient": "15550100106",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 9 Nov 09:00 Chicago\n2) Mon 9 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-26123c74-7a7a-4b3e-a459-e960348afc6e",
"offered_slots": [
{
"n": 1,
"end": "2026-11-09T16:00:00.000Z",
"lead": null,
"label": "Mon 9 Nov 09:00 Chicago",
"start": "2026-11-09T15:00:00.000Z",
"business": {
"date": "2026-11-09",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-09T17:00:00.000Z",
"lead": null,
"label": "Mon 9 Nov 10:00 Chicago",
"start": "2026-11-09T16:00:00.000Z",
"business": {
"date": "2026-11-09",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
}
] |
pass B4 closing boundary: busy 12:00–17:00 CST, «afternoon» → Tue 17:00 and Wed 12:00, never 18:00
pass What we did: B4 closing boundary: busy 12:00–17:00 CST, «afternoon» → Tue 17:00 and Wed 12:00, never 18:00
Expected: what the line above claims. Actual: every check of it held.
- Lead
afternoon
- Bot
Just checking in: we still have your request. Reply with the number of one of the times above to book.
- Bot
Just checking in: we still have your request. Reply with the number of one of the times above to book.
- Bot
Just checking in: we still have your request. Reply with the number of one of the times above to book.
- Bot
These times are free: 1) Tue 10 Nov 17:00 Chicago 2) Wed 11 Nov 12:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100106 | new | awaiting_pick | bot |
| 15550100107 | new | awaiting_pick | bot |
| 15550100136 | new | awaiting_pick | bot |
| 15550100139 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| calendar | POST /freeBusy | 200 | 1 | {
"kind": "[withheld: not a test object]",
"timeMin": "2026-11-10T18:00:00.000Z",
"timeMax": "2026-11-10T23:00:00.000Z",
"calendars": {
"CAL": {
"busy": [
{
"start": "2026-11-10T18:00:00Z",
"end": "2026-11-10T23:00:00Z"
}
]
}
}
} | |
| outbox | SELECT outbox of wamid.TEST-389978aa-d752-493e-85c1-6181bd29807c | 4 | {
"status": "test_held",
"recipient": "15550100107",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Tue 10 Nov 17:00 Chicago\n2) Wed 11 Nov 12:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-389978aa-d752-493e-85c1-6181bd29807c",
"offered_slots": [
{
"n": 1,
"end": "2026-11-11T00:00:00.000Z",
"lead": null,
"label": "Tue 10 Nov 17:00 Chicago",
"start": "2026-11-10T23:00:00.000Z",
"business": {
"date": "2026-11-10",
"time": "17:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-11T19:00:00.000Z",
"lead": null,
"label": "Wed 11 Nov 12:00 Chicago",
"start": "2026-11-11T18:00:00.000Z",
"business": {
"date": "2026-11-11",
"time": "12:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT leads of 15550100107 | 1 | {
"service": "Plumbing",
"zip": "60614",
"time_window": "Afternoon (12-18)"
} | ||
| outbox | SELECT outbox of 15550100107 | 1 | [
{
"status": "test_held",
"recipient": "15550100107",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Tue 10 Nov 17:00 Chicago\n2) Wed 11 Nov 12:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-389978aa-d752-493e-85c1-6181bd29807c",
"offered_slots": [
{
"n": 1,
"end": "2026-11-11T00:00:00.000Z",
"lead": null,
"label": "Tue 10 Nov 17:00 Chicago",
"start": "2026-11-10T23:00:00.000Z",
"business": {
"date": "2026-11-10",
"time": "17:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-11T19:00:00.000Z",
"lead": null,
"label": "Wed 11 Nov 12:00 Chicago",
"start": "2026-11-11T18:00:00.000Z",
"business": {
"date": "2026-11-11",
"time": "12:00",
"zone": "America/Chicago"
}
}
]
}
] |
pass pick: only a claimed bot turn at awaiting_pick is a pick; every other turn goes on to «Plan the turn» unchanged
pass What we did: pick: only a claimed bot turn at awaiting_pick is a pick; every other turn goes on to «Plan the turn» unchanged
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass pick: the number of an offered slot books THAT slot; spaces are trimmed
pass What we did: pick: the number of an offered slot books THAT slot; spaces are trimmed
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass pick: anything but an offered number → the same slots again, step kept, no booking
pass What we did: pick: anything but an offered number → the same slots again, step kept, no booking
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass pick: the reply and the booking are held unless the number is in LIVE_RECIPIENTS
pass What we did: pick: the reply and the booking are held unless the number is in LIVE_RECIPIENTS
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass plan: a booked lead gets no new turn (the stop S1c added); an open question still plans
pass What we did: plan: a booked lead gets no new turn (the stop S1c added); an open question still plans
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: a slot another booking holds is not offered; the block is one slot long (the next slot stays free)
pass What we did: offer: a slot another booking holds is not offered; the block is one slot long (the next slot stays free)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass offer: a notice (the lost slot) leads the text; without one the text is as in S1b
pass What we did: offer: a notice (the lost slot) leads the text; without one the text is as in S1b
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass back to the offer: the pick's thread with the FRESH held slots from check_and_book and the notice
pass What we did: back to the offer: the pick's thread with the FRESH held slots from check_and_book and the notice
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass plan the booking: the slot key is the start's UTC ISO form; one booking key; fixture by the LWDTEST prefix only
pass What we did: plan the booking: the slot key is the start's UTC ISO form; one booking key; fixture by the LWDTEST prefix only
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass slot check: busy across the slot → taken; a block ending AT its start or starting AT its end leaves it free
pass What we did: slot check: busy across the slot → taken; a block ending AT its start or starting AT its end leaves it free
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass slot check: busy only by this booking's own live event → ours (write again: 409); a cancelled or absent own event → taken
pass What we did: slot check: busy only by this booking's own live event → ours (write again: 409); a cancelled or absent own event → taken
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass slot check: no booking from a blind calendar — a freeBusy failure or calendar error stops the run
pass What we did: slot check: no booking from a blind calendar — a freeBusy failure or calendar error stops the run
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass event: id = the op's hex; start/end = the slot's UTC instants in the business zone; tags for a fixture only
pass What we did: event: id = the op's hex; start/end = the slot's UTC instants in the business zone; tags for a fixture only
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass pause: the knob's milliseconds are waited; 0 waits not at all
pass What we did: pause: the knob's milliseconds are waited; 0 waits not at all
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass checks: a write not done stops the run; a done one goes on
pass What we did: checks: a write not done stops the run; a done one goes on
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass contact: the live search hit whose phone digits equal the lead's is updated (ZIP only); a deleted hit is not
pass What we did: contact: the live search hit whose phone digits equal the lead's is updated (ZIP only); a deleted hit is not
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass contact: digits must match exactly; the OLDEST of several matches wins
pass What we did: contact: digits must match exactly; the OLDEST of several matches wins
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass contact: none found → the contact an earlier done write made for the phone (search lag); else created with the correlation id
pass What we did: contact: none found → the contact an earlier done write made for the phone (search lag); else created with the correlation id
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass contact: a failed search, or a failed batch read of real hits, stops the run (never a blind create)
pass What we did: contact: a failed search, or a failed batch read of real hits, stops the run (never a blind create)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass deal: the first stage of the first pipeline (lowest displayOrder of both), on the contact (type 3), correlation in name
pass What we did: deal: the first stage of the first pipeline (lowest displayOrder of both), on the contact (type 3), correlation in name
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass note: on the contact (202) and the deal (214), both zones and the correlation id, stamped by the injected clock
pass What we did: note: on the contact (202) and the deal (214), both zones and the correlation id, stamped by the injected clock
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass CRM writer: its three claim queries are one text, and so are its three mark queries (no drift between them)
pass What we did: CRM writer: its three claim queries are one text, and so are its three mark queries (no drift between them)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass SQL hold: the first lead on a slot wins; a second lead loses; the first again wins its own hold; another slot is free
pass What we did: SQL hold: the first lead on a slot wins; a second lead loses; the first again wins its own hold; another slot is free
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass SQL calendar op: claimed once per booking key; a retry raises attempts on the same row; 409 and 200 close it done, 500 failed
pass What we did: SQL calendar op: claimed once per booking key; a retry raises attempts on the same row; 409 and 200 close it done, 500 failed
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass SQL CRM claim: one op per booking key; it hands over this booking's contact/deal and the newest DONE contact of the same phone
pass What we did: SQL CRM claim: one op per booking key; it hands over this booking's contact/deal and the newest DONE contact of the same phone
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass SQL confirmation: one outbox row per booking key (its op done with the row's id); the lead booked, the thread leaves the offer
pass What we did: SQL confirmation: one outbox row per booking key (its op done with the row's id); the lead booked, the thread leaves the offer
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass SQL thread load: held slots from the clock on (a slot AT the clock included), of this tenant only
pass What we did: SQL thread load: held slots from the clock on (a slot AT the clock included), of this tenant only
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass retries: exactly the idempotent HTTP calls retry a transport error (the event id makes a repeat a 409); no create does
pass What we did: retries: exactly the idempotent HTTP calls retry a transport error (the event id makes a repeat a 409); no create does
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass sender allow-list: LIVE_RECIPIENTS read as digits; the harness's fixture ranges are never sendable, even if listed
pass What we did: sender allow-list: LIVE_RECIPIENTS read as digits; the harness's fixture ranges are never sendable, even if listed
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass sender message: the claimed row as a WhatsApp text to its digits; nothing claimed → no call
pass What we did: sender message: the claimed row as a WhatsApp text to its digits; nothing claimed → no call
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass SQL sender: only an allowed, fresh, queued row is claimed, its op written BEFORE the call; others held or cancelled; once only
pass What we did: SQL sender: only an allowed, fresh, queued row is claimed, its op written BEFORE the call; others held or cancelled; once only
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass C2 409 repeat, wrong state: the calendar op planted `claimed`, «1» again → op done, attempts 2, result 409; still one of each
pass What we did: C2 409 repeat, wrong state: the calendar op planted `claimed`, «1» again → op done, attempts 2, result 409; still one of each
Expected: what the line above claims. Actual: every check of it held.
- Lead
1
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 2 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100101 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D7ae74794-ee00-4009-ba34-20b3142000fd | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:04:25.834Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585751730707902\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:04:25.000Z",
"updated": "2026-10-24T21:04:25.353Z",
"summary": "[lwd-test] Plumbing - LWDTEST 15550100101",
"description": "Booked Thu 12 Nov 08:00 Chicago. ZIP 60614. Correlation 7ae74794-ee00-4009-ba34-20b3142000fd.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-11-12T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-11-12T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "7ae74794-ee00-4009-ba34-20b3142000fd"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} | |
| crm | GET /crm/v4/objects/contacts/901383867594/associations/deals | 200 | 1 | {
"results": [
{
"toObjectId": 530987814093,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 4,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| crm | GET /crm/v4/objects/contacts/901383867594/associations/notes | 200 | 1 | {
"results": [
{
"toObjectId": 532449277167,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 201,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| outbox | SELECT outbox of 15550100101 | 1 | [
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services. I'm here to help you get started. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-f9ad0e86-2aa0-4179-b5aa-70356a8f8b0b",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for letting us know about the leaking kitchen sink. We can help you with that plumbing issue. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-f4feb9f4-187c-423c-95db-ee2aaefa68a9",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, we have your ZIP code 60614 and the Plumbing service noted. Here are the time options for your visit. When would you like us to come: morning, afternoon, or a specific day?\n1) Morning (8-12…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-1f4b609a-d8b2-4ce6-b795-868646f4ac4c",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-d640318a-c998-4900-931e-5084164d25eb",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Please reply with the number of one of these times:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago",
"step": "awaiting_pick",
"event_id": "wamid.TEST-e82a861d-2d5f-4436-81e4-63929d101fd4",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
"(+1 more)"
] |
pass C6 wrong state, outbox only: every outbox row to a fixture number of C1–C5 is held, no provider id, no meta.send
pass What we did: C6 wrong state, outbox only: every outbox row to a fixture number of C1–C5 is held, no provider id, no meta.send
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of 15550100101 | 1 | [
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services. I'm here to help you get started. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-f9ad0e86-2aa0-4179-b5aa-70356a8f8b0b",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for letting us know about the leaking kitchen sink. We can help you with that plumbing issue. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-f4feb9f4-187c-423c-95db-ee2aaefa68a9",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, we have your ZIP code 60614 and the Plumbing service noted. Here are the time options for your visit. When would you like us to come: morning, afternoon, or a specific day?\n1) Morning (8-12…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-1f4b609a-d8b2-4ce6-b795-868646f4ac4c",
"offered_slots": null
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-d640318a-c998-4900-931e-5084164d25eb",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100101",
"provider_message_id": null,
"kind": "free_form",
"text": "Please reply with the number of one of these times:\n1) Thu 12 Nov 08:00 Chicago\n2) Thu 12 Nov 09:00 Chicago",
"step": "awaiting_pick",
"event_id": "wamid.TEST-e82a861d-2d5f-4436-81e4-63929d101fd4",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T15:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 08:00 Chicago",
"start": "2026-11-12T14:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T16:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 09:00 Chicago",
"start": "2026-11-12T15:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
"(+1 more)"
] | ||
| outbox | SELECT outbox of 15550100102 | 1 | [
{
"status": "test_held",
"recipient": "15550100102",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 13 Nov 08:00 Chicago\n2) Fri 13 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-67c7af68-d781-44f8-a786-7c0b63ede969",
"offered_slots": [
{
"n": 1,
"end": "2026-11-13T15:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 08:00 Chicago",
"start": "2026-11-13T14:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-13T16:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 09:00 Chicago",
"start": "2026-11-13T15:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100102",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Fri 13 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-88be307b-f917-46d7-94e8-89e2efb46c3f",
"offered_slots": null
}
] | ||
| outbox | SELECT outbox of 15550100103 | 1 | [
{
"status": "test_held",
"recipient": "15550100103",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 16 Nov 08:00 Chicago\n2) Mon 16 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-14ab5d0d-0f7b-4c31-b3d6-551ebe18e91a",
"offered_slots": [
{
"n": 1,
"end": "2026-11-16T15:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 08:00 Chicago",
"start": "2026-11-16T14:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-16T16:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 09:00 Chicago",
"start": "2026-11-16T15:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100103",
"provider_message_id": null,
"kind": "free_form",
"text": "Sorry, that time was just taken.\nThese times are free:\n1) Mon 16 Nov 09:00 Chicago\n2) Mon 16 Nov 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-6ed72115-0eba-4fa8-ba20-bd32dbdd7728",
"offered_slots": [
{
"n": 1,
"end": "2026-11-16T16:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 09:00 Chicago",
"start": "2026-11-16T15:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-16T17:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 10:00 Chicago",
"start": "2026-11-16T16:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
}
] | ||
| outbox | SELECT outbox of 15550100104 | 1 | [
{
"status": "test_held",
"recipient": "15550100104",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 16 Nov 08:00 Chicago\n2) Mon 16 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-31074648-df86-4c46-848c-58777a03fe59",
"offered_slots": [
{
"n": 1,
"end": "2026-11-16T15:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 08:00 Chicago",
"start": "2026-11-16T14:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-16T16:00:00.000Z",
"lead": null,
"label": "Mon 16 Nov 09:00 Chicago",
"start": "2026-11-16T15:00:00.000Z",
"business": {
"date": "2026-11-16",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100104",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Mon 16 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-45ddc3f9-0dfd-49da-9f22-0eb11f491994",
"offered_slots": null
}
] | ||
| outbox | SELECT outbox of 447700900101 | 1 | [
{
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Mon 26 Oct 08:00 Chicago / 13:00 London\n2) Mon 26 Oct 09:00 Chicago / 14:00 London\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-df8e22e7-ecd6-4498-869a-83bac03771f6",
"offered_slots": [
{
"n": 1,
"end": "2026-10-26T14:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "13:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 08:00 Chicago / 13:00 London",
"start": "2026-10-26T13:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-10-26T15:00:00.000Z",
"lead": {
"date": "2026-10-26",
"time": "14:00",
"zone": "Europe/London"
},
"label": "Mon 26 Oct 09:00 Chicago / 14:00 London",
"start": "2026-10-26T14:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "447700900101",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Mon 26 Oct 08:00 Chicago / 13:00 London.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-248b81f7-db4c-4531-ae0c-8d38e8bdef23",
"offered_slots": null
}
] |
pass R1 ruler control: two tagged contacts with the same digits are both counted; a neighbouring number is not
pass What we did: R1 ruler control: two tagged contacts with the same digits are both counted; a neighbouring number is not
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | POST /crm/v3/objects/contacts/search | 200 | 5 | {
"total": 6,
"results": [
{
"id": "901383867594",
"properties": {
"createdate": "2026-10-24T21:04:26.565Z",
"hs_object_id": "901383867594",
"hs_searchable_calculated_phone_number": "15550100101",
"lastmodifieddate": "2026-10-24T21:04:44.524Z"
},
"createdAt": "2026-10-24T21:04:26.565Z",
"updatedAt": "2026-10-24T21:04:44.524Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901383867594"
},
{
"id": "901102815422",
"properties": {
"createdate": "2026-10-24T21:04:42.704Z",
"hs_object_id": "901102815422",
"hs_searchable_calculated_phone_number": "15550100102",
"lastmodifieddate": "2026-10-24T21:05:07.559Z"
},
"createdAt": "2026-10-24T21:04:42.704Z",
"updatedAt": "2026-10-24T21:05:07.559Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901102815422"
},
{
"id": "901413432514",
"properties": {
"createdate": "2026-10-24T21:05:16.667Z",
"hs_object_id": "901413432514",
"hs_searchable_calculated_phone_number": "15550100104",
"lastmodifieddate": "2026-10-24T21:05:35.497Z"
},
"createdAt": "2026-10-24T21:05:16.667Z",
"updatedAt": "2026-10-24T21:05:35.497Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901413432514"
},
{
"id": "901415603391",
"properties": {
"createdate": "2026-10-24T21:05:40.336Z",
"hs_object_id": "901415603391",
"hs_searchable_calculated_phone_number": "15550100108",
"lastmodifieddate": "2026-10-24T21:05:44.814Z"
},
"createdAt": "2026-10-24T21:05:40.336Z",
"updatedAt": "2026-10-24T21:05:44.814Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901415603391"
},
{
"id": "901415525595",
"properties": {
"createdate": "2026-10-24T21:05:40.829Z",
"hs_object_id": "901415525595",
"hs_searchable_calculated_phone_number": "15550100108",
"lastmodifieddate": "2026-10-24T21:05:44.924Z"
},
"createdAt": "2026-10-24T21:05:40.829Z",
"updatedAt": "2026-10-24T21:05:44.924Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901415525595"
},
"(+1 more)"
]
} | |
| crm | GET /crm/v3/objects/contacts/901415603391 | 200 | 3 | {
"id": "901415603391",
"properties": {
"createdate": "2026-10-24T21:05:40.336Z",
"email": null,
"firstname": "LWDTEST R1 same",
"hs_object_id": "901415603391",
"lastmodifieddate": "2026-10-24T21:05:44.814Z",
"lastname": null
},
"createdAt": "2026-10-24T21:05:40.336Z",
"updatedAt": "2026-10-24T21:05:44.814Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901415603391"
} | |
| crm | GET /crm/v3/objects/contacts/901415525595 | 200 | 1 | {
"id": "901415525595",
"properties": {
"createdate": "2026-10-24T21:05:40.829Z",
"email": null,
"firstname": "LWDTEST R1 same again",
"hs_object_id": "901415525595",
"lastmodifieddate": "2026-10-24T21:05:44.924Z",
"lastname": null
},
"createdAt": "2026-10-24T21:05:40.829Z",
"updatedAt": "2026-10-24T21:05:44.924Z",
"archived": false,
"url": "https://app-eu1.hubspot.com/contacts/portal-•••/record/0-1/901415525595"
} |
pass 1 plan: a photo's caption is read as the words; a voice note and a bare photo have none and ask no model
pass What we did: 1 plan: a photo's caption is read as the words; a voice note and a bare photo have none and ask no model
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 plan: the model is offered `intent` (5 values, not required), the asked question with its numbered options, a ZIP hint that never corrects
pass What we did: 2 plan: the model is offered `intent` (5 values, not required), the asked question with its numbered options, a ZIP hint that never corrects
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 next step: a valid ZIP outside the service area is not kept (outside); one inside is kept; a malformed one is rejected
pass What we did: 3 next step: a valid ZIP outside the service area is not kept (outside); one inside is kept; a malformed one is rejected
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 reply plan: the first turn greets and names the business; a later turn does not
pass What we did: 4 reply plan: the first turn greets and names the business; a later turn does not
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 reply plan: a voice note, a bare attachment, a refused ZIP and an outside ZIP each get their note and lead-in
pass What we did: 5 reply plan: a voice note, a bare attachment, a refused ZIP and an outside ZIP each get their note and lead-in
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 reply plan: the facts and the writer's request — question, options, fields held, tenant facts; forced write_reply; no clock
pass What we did: 6 reply plan: the facts and the writer's request — question, options, fields held, tenant facts; forced write_reply; no clock
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 7 check: a good opening goes out, trimmed, with the question and its options added; no alert
pass What we did: 7 check: a good opening goes out, trimmed, with the question and its options added; no alert
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 8 check: an opening that asks its own question → the template, with an alert
pass What we did: 8 check: an opening that asks its own question → the template, with an alert
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 9 check: a reply without the question or an option verbatim → the template (D1: the options listed)
pass What we did: 9 check: a reply without the question or an option verbatim → the template (D1: the options listed)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 10 check: a number absent from the facts → the template; a number the facts hold goes out
pass What we did: 10 check: a number absent from the facts → the template; a number the facts hold goes out
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 11 check: a currency sign absent from the facts → the template
pass What we did: 11 check: a currency sign absent from the facts → the template
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 12 check: «booked» or «confirmed» while not booked → the template; «book» alone goes out
pass What we did: 12 check: «booked» or «confirmed» while not booked → the template; «book» alone goes out
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 13 check: a whole reply over 600 characters → the template; exactly 600 goes out
pass What we did: 13 check: a whole reply over 600 characters → the template; exactly 600 goes out
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 14 check: an API error, a timeout (no status) or an answer without write_reply → the template, with an alert
pass What we did: 14 check: an API error, a timeout (no status) or an answer without write_reply → the template, with an alert
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 15 check: an opening of 3 sentences → the template; 2 go out («!» and «.» both end one)
pass What we did: 15 check: an opening of 3 sentences → the template; 2 go out («!» and «.» both end one)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 16 when → a date in the TENANT zone on the injected clock: weekday rollover, today, offsets, month+day, the year, impossible dates
pass What we did: 16 when → a date in the TENANT zone on the injected clock: weekday rollover, today, offsets, month+day, the year, impossible dates
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 17 an open stated day is honoured (D6); a day short of slots is filled from the next open days; a stated time fills the window option
pass What we did: 17 an open stated day is honoured (D6); a day short of slots is filled from the next open days; a stated time fills the window option
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 18 a closed day is refused (D7): «Saturdays are closed», the nearest open day before and after, never the closed day
pass What we did: 18 a closed day is refused (D7): «Saturdays are closed», the nearest open day before and after, never the closed day
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 19 after hours (D8): «tomorrow after 6» → the latest is 17:00, one slot a day; 17:00 fits exactly; «before 8» → the earliest
pass What we did: 19 after hours (D8): «tomorrow after 6» → the latest is 17:00, one slot a day; 17:00 fits exactly; «before 8» → the earliest
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 20 DST weeks: the stated day's wall clock by the zone of THAT day (US autumn and spring), a closed Sunday across the change
pass What we did: 20 DST weeks: the stated day's wall clock by the zone of THAT day (US autumn and spring), a closed Sunday across the change
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 21 corrects (D9, Q4 a): a held field changes only when the lead takes it back; taken back with nothing valid → asked again
pass What we did: 21 corrects (D9, Q4 a): a held field changes only when the lead takes it back; taken back with nothing valid → asked again
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 22 the pick (D9): words go to the model; a new time re-offers; a correction re-offers; nothing new → the same slots
pass What we did: 22 the pick (D9): words go to the model; a new time re-offers; a correction re-offers; nothing new → the same slots
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 23 the model is offered a STRUCTURED `when` and `corrects` (never a date or the clock); a held field only to take it back
pass What we did: 23 the model is offered a STRUCTURED `when` and `corrects` (never a date or the clock); a held field only to take it back
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 24 SQL: a lead who returns after days keeps the lead, the thread and its step; the clock moves last_customer_message_at; requested_when is kept
pass What we did: 24 SQL: a lead who returns after days keeps the lead, the thread and its step; the clock moves last_customer_message_at; requested_when is kept
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 25 the judge's vote (R9): a reply passes only on 3 of 3; a split vote is «unstable» and fails; the failed rules are the union
pass What we did: 25 the judge's vote (R9): a reply passes only on 3 of 3; a split vote is «unstable» and fails; the failed rules are the union
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 26 plan (S1d-3): `language` and `in_trade` offered, never required; any letter outside the Latin script asks no model; the fault knob
pass What we did: 26 plan (S1d-3): `language` and `in_trade` offered, never required; any letter outside the Latin script asks no model; the fault knob
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 27 read the answer (D14): a timeout, an HTTP error, no record_fields call, a value of the wrong type → llm.error, never a throw
pass What we did: 27 read the answer (D14): a timeout, an HTTP error, no record_fields call, a value of the wrong type → llm.error, never a throw
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 28 next step on a fault (D14): the words read by rule — an option's number or exact name, a 5-digit ZIP — and an llm_fault alert
pass What we did: 28 next step on a fault (D14): the words read by rule — an option's number or exact name, a 5-digit ZIP — and an llm_fault alert
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 29 the hand-off gate, by code (D11, D12, R7): a service outside the trades, a request for a person, a language not listed; their lines
pass What we did: 29 the hand-off gate, by code (D11, D12, R7): a service outside the trades, a request for a person, a language not listed; their lines
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 30 the gate's order: a language not listed beats off the profile, which beats a request for a person
pass What we did: 30 the gate's order: a language not listed beats off the profile, which beats a request for a person
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 31 the pick (E3): only a service among the trades is ever booked; any other goes on to «Plan the turn» and the gate
pass What we did: 31 the pick (E3): only a service among the trades is ever booked; any other goes on to «Plan the turn» and the gate
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 32 the template on a fault (D14), the hand-off request and reply nodes, the sink's input check
pass What we did: 32 the template on a fault (D14), the hand-off request and reply nodes, the sink's input check
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 33 SQL: the sink freezes the thread, cancels its queued and held sends only, writes one task and one held alert once; the ack after it stays; a fault's op and alert; the knob per lead
pass What we did: 33 SQL: the sink freezes the thread, cancels its queued and held sends only, writes one task and one held alert once; the ack after it stays; a fault's op and alert; the knob per lead
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass J0 the judge: newest sonnet ≠ the writer; six planted bad replies FAIL on their rule, one good reply PASSES
pass What we did: J0 the judge: newest sonnet ≠ the writer; six planted bad replies FAIL on their rule, one good reply PASSES
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass D1 vague first «Hi» → greets, names the business, Q1 verbatim with the 3+1 options; judge PASS; fields NULL
pass What we did: D1 vague first «Hi» → greets, names the business, Q1 verbatim with the 3+1 options; judge PASS; fields NULL
Expected: what the line above claims. Actual: every check of it held.
- Lead
Hi
- Bot
Hello, and welcome to Northside Home Services. I can help you get started. What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100130 | new | awaiting_service | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-f3b47cf7-70bf-46d4-b9bd-c8699af64914 | 6 | {
"status": "test_held",
"recipient": "15550100130",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services. I can help you get started. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-f3b47cf7-70bf-46d4-b9bd-c8699af64914",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100130 | 2 | {
"step": "awaiting_service",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100130 | 2 | {
"service": null,
"zip": null,
"time_window": null
} | ||
| outbox | SELECT outbox of 15550100130 | 1 | [
{
"status": "test_held",
"recipient": "15550100130",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, and welcome to Northside Home Services. I can help you get started. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-f3b47cf7-70bf-46d4-b9bd-c8699af64914",
"offered_slots": null
}
] |
pass D2 two answers + typos → Plumbing and 60614, Q3 only; «leek under sinc, zip 6o614» → zip NULL, asks for 5 digits
pass What we did: D2 two answers + typos → Plumbing and 60614, Q3 only; «leek under sinc, zip 6o614» → zip NULL, asks for 5 digits
Expected: what the line above claims. Actual: every check of it held.
- Lead
hi my kichen sinc is leeking, zip 60614
- Bot
Hello, thanks for contacting Northside Home Services. We're sorry to hear about the leaking kitchen sink, and we can help arrange a plumbing visit for your ZIP code 60614. When would you like us to come: morning, afternoon, or a specific day? 1) Morning (8-12) 2) Afternoon (12-18) 3) A specific day
- Lead
leek under sinc, zip 6o614
- Bot
Hello, this is Northside Home Services (fictional). Thanks for the details about the leak under your sink; the ZIP code you sent, 6o614, is not valid because a ZIP code has exactly 5 digits. What is the ZIP code of the address?
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100131 | new | awaiting_time_window | bot |
| 15550100132 | new | awaiting_zip | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-d8e867d7-41cf-4b51-9e8c-c84a1508f788 | 6 | {
"status": "test_held",
"recipient": "15550100131",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, thanks for contacting Northside Home Services. We're sorry to hear about the leaking kitchen sink, and we can help arrange a plumbing visit for your ZIP code 60614. When would you like us to co…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-d8e867d7-41cf-4b51-9e8c-c84a1508f788",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100131 | 2 | {
"step": "awaiting_time_window",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100131 | 2 | {
"service": "Plumbing",
"zip": "60614",
"time_window": null
} | ||
| outbox | SELECT outbox of wamid.TEST-e8f1c11d-362b-48b0-8822-bda0ff69a996 | 6 | {
"status": "test_held",
"recipient": "15550100132",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, this is Northside Home Services (fictional). Thanks for the details about the leak under your sink; the ZIP code you sent, 6o614, is not valid because a ZIP code has exactly 5 digits. What is t…",
"step": "awaiting_zip",
"event_id": "wamid.TEST-e8f1c11d-362b-48b0-8822-bda0ff69a996",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100132 | 2 | {
"step": "awaiting_zip",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100132 | 2 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} |
pass D3 short or rude at Q1: «k» and «wtf just send someone» → Q1 again politely, no field, judge PASS (R5), mode bot
pass What we did: D3 short or rude at Q1: «k» and «wtf just send someone» → Q1 again politely, no field, judge PASS (R5), mode bot
Expected: what the line above claims. Actual: every check of it held.
- Lead
k
- Bot
Thanks for your message. I can help you arrange a service visit. What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
- Lead
wtf just send someone
- Bot
Sorry for the wait, I understand you want someone to come out. I can help you get started with a request. What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100133 | new | awaiting_service | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-ed19ee5a-ecb9-44f4-b78a-3f94af76f41e | 7 | {
"status": "test_held",
"recipient": "15550100133",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for your message. I can help you arrange a service visit. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-ed19ee5a-ecb9-44f4-b78a-3f94af76f41e",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100133 | 2 | {
"step": "awaiting_service",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100133 | 4 | {
"service": null,
"zip": null,
"time_window": null
} | ||
| outbox | SELECT outbox of wamid.TEST-7802f866-8adb-42e1-becc-2edaf9b534a5 | 6 | {
"status": "test_held",
"recipient": "15550100133",
"provider_message_id": null,
"kind": "free_form",
"text": "Sorry for the wait, I understand you want someone to come out. I can help you get started with a request. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Something else",
"step": "awaiting_service",
"event_id": "wamid.TEST-7802f866-8adb-42e1-becc-2edaf9b534a5",
"offered_slots": null
} |
pass D4 media: a voice note → «can't play voice notes, please type» + Q1, no extract; a captioned photo → Plumbing
pass What we did: D4 media: a voice note → «can't play voice notes, please type» + Q1, no extract; a captioned photo → Plumbing
Expected: what the line above claims. Actual: every check of it held.
- Lead
[audio]
- Bot
Hello, this is Northside Home Services (fictional). I cannot play voice notes, so please type your answer below. What do you need help with? 1) Plumbing 2) Heating and cooling 3) Electrical 4) Something else
- Lead
[image] this pipe under the sink is leaking
- Bot
Thanks for letting us know about the leak under your sink. We can note this as a plumbing request. What is the ZIP code of the address?
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100134 | new | awaiting_zip | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-2510e29c-07c6-4f0c-883a-79ea301c8d96 | 3 | {
"status": "test_held",
"recipient": "15550100134",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, this is Northside Home Services (fictional). I cannot play voice notes, so please type your answer below. What do you need help with?\n1) Plumbing\n2) Heating and cooling\n3) Electrical\n4) Somethi…",
"step": "awaiting_service",
"event_id": "wamid.TEST-2510e29c-07c6-4f0c-883a-79ea301c8d96",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100134 | 2 | {
"step": "awaiting_zip",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100134 | 3 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT outbox of wamid.TEST-c8fe2e3f-7378-495b-a9da-8d58b093e1ec | 5 | {
"status": "test_held",
"recipient": "15550100134",
"provider_message_id": null,
"kind": "free_form",
"text": "Thanks for letting us know about the leak under your sink. We can note this as a plumbing request. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-c8fe2e3f-7378-495b-a9da-8d58b093e1ec",
"offered_slots": null
} |
pass D5 off-script at Q2: price + «are you a bot?» → no number, technician prices, automated assistant, Q2 again; 60657 → not in the area
pass What we did: D5 off-script at Q2: price + «are you a bot?» → no number, technician prices, automated assistant, Q2 again; 60657 → not in the area
Expected: what the line above claims. Actual: every check of it held.
- Lead
how much do you charge? and are you a bot?
- Bot
The technician gives the price on site. I am an automated assistant, not a person. What is the ZIP code of the address?
- Lead
do you cover 60657?
- Bot
Thank you for checking. Unfortunately, ZIP code 60657 is not in our service area, so we cannot take a booking for that address. What is the ZIP code of the address?
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100135 | new | awaiting_zip | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-b1e78f0d-af1a-4d49-8669-d53190408429 | 5 | {
"status": "test_held",
"recipient": "15550100135",
"provider_message_id": null,
"kind": "free_form",
"text": "The technician gives the price on site. I am an automated assistant, not a person. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-b1e78f0d-af1a-4d49-8669-d53190408429",
"offered_slots": null
} | ||
| outbox | SELECT conversations of 15550100135 | 4 | {
"step": "awaiting_zip",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100135 | 4 | {
"service": "Plumbing",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT outbox of wamid.TEST-b015593f-6ba2-4ffe-a2de-d732c752ca5e | 6 | {
"status": "test_held",
"recipient": "15550100135",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you for checking. Unfortunately, ZIP code 60657 is not in our service area, so we cannot take a booking for that address. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-b015593f-6ba2-4ffe-a2de-d732c752ca5e",
"offered_slots": null
} |
pass D6 an open stated day: Mon 9 Nov, «Thursday afternoon works» → Thu 12 Nov 12:00 and 13:00 CST
pass What we did: D6 an open stated day: Mon 9 Nov, «Thursday afternoon works» → Thu 12 Nov 12:00 and 13:00 CST
Expected: what the line above claims. Actual: every check of it held.
- Lead
Thursday afternoon works
- Bot
These times are free: 1) Thu 12 Nov 12:00 Chicago 2) Thu 12 Nov 13:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100136 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-9f5ca500-6985-45f7-9b41-0c1fd584d5e3 | 6 | {
"status": "test_held",
"recipient": "15550100136",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 12:00 Chicago\n2) Thu 12 Nov 13:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-9f5ca500-6985-45f7-9b41-0c1fd584d5e3",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T19:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 12:00 Chicago",
"start": "2026-11-12T18:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "12:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T20:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 13:00 Chicago",
"start": "2026-11-12T19:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "13:00",
"zone": "America/Chicago"
}
}
]
} |
pass D7 a closed day, Sam's words: Wed 21 Oct, «morning 24october» → Saturdays closed; Fri 23 Oct and Mon 26 Oct 08:00
pass What we did: D7 a closed day, Sam's words: Wed 21 Oct, «morning 24october» → Saturdays closed; Fri 23 Oct and Mon 26 Oct 08:00
Expected: what the line above claims. Actual: every check of it held.
- Lead
morning 24october
- Bot
We are closed on Saturdays. These times are free: 1) Fri 23 Oct 08:00 Chicago 2) Mon 26 Oct 08:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100137 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-0276383a-ad88-4d9b-b700-dcd5b5a9ae5f | 7 | {
"status": "test_held",
"recipient": "15550100137",
"provider_message_id": null,
"kind": "free_form",
"text": "We are closed on Saturdays.\nThese times are free:\n1) Fri 23 Oct 08:00 Chicago\n2) Mon 26 Oct 08:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-0276383a-ad88-4d9b-b700-dcd5b5a9ae5f",
"offered_slots": [
{
"n": 1,
"end": "2026-10-23T14:00:00.000Z",
"lead": null,
"label": "Fri 23 Oct 08:00 Chicago",
"start": "2026-10-23T13:00:00.000Z",
"business": {
"date": "2026-10-23",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-10-26T14:00:00.000Z",
"lead": null,
"label": "Mon 26 Oct 08:00 Chicago",
"start": "2026-10-26T13:00:00.000Z",
"business": {
"date": "2026-10-26",
"time": "08:00",
"zone": "America/Chicago"
}
}
]
} |
pass D8 «tomorrow after 6» at Tue 14:00 CST → the latest is 17:00; Wed 11 and Thu 12 Nov 17:00 CST, never 18:00 or later
pass What we did: D8 «tomorrow after 6» at Tue 14:00 CST → the latest is 17:00; Wed 11 and Thu 12 Nov 17:00 CST, never 18:00 or later
Expected: what the line above claims. Actual: every check of it held.
- Lead
tomorrow after 6
- Bot
The latest visit starts at 17:00. These times are free: 1) Wed 11 Nov 17:00 Chicago 2) Thu 12 Nov 17:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| outbox.follow_up | done | 1 | ||
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100136 | new | awaiting_pick | human |
| 15550100138 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-99a93675-20e7-4c9c-a1a7-0ae3e86286cd | 5 | {
"status": "test_held",
"recipient": "15550100138",
"provider_message_id": null,
"kind": "free_form",
"text": "The latest visit starts at 17:00.\nThese times are free:\n1) Wed 11 Nov 17:00 Chicago\n2) Thu 12 Nov 17:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-99a93675-20e7-4c9c-a1a7-0ae3e86286cd",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T00:00:00.000Z",
"lead": null,
"label": "Wed 11 Nov 17:00 Chicago",
"start": "2026-11-11T23:00:00.000Z",
"business": {
"date": "2026-11-11",
"time": "17:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-13T00:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 17:00 Chicago",
"start": "2026-11-12T23:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "17:00",
"zone": "America/Chicago"
}
}
]
} |
pass D9 a changed mind: «not plumbing, it's the heating» → Heating, Q2 again; at the pick «actually Friday morning instead» → Fri slots, 0 holds, 0 events
pass What we did: D9 a changed mind: «not plumbing, it's the heating» → Heating, Q2 again; at the pick «actually Friday morning instead» → Fri slots, 0 holds, 0 events
Expected: what the line above claims. Actual: every check of it held.
- Lead
sorry, not plumbing, it's the heating
- Bot
No problem, I have updated your request to Heating and cooling. Thanks for clarifying. What is the ZIP code of the address?
- Lead
60614
- Bot
Thank you, we have your ZIP code 60614 and your heating and cooling request. Your answer will help us move to the next step. When would you like us to come: morning, afternoon, or a specific day? 1) Morning (8-12) 2) Afternoon (12-18) 3) A specific day
- Lead
Thursday afternoon
- Bot
These times are free: 1) Thu 12 Nov 12:00 Chicago 2) Thu 12 Nov 13:00 Chicago Reply 1 or 2 to book.
- Lead
actually Friday morning instead
- Bot
These times are free: 1) Fri 13 Nov 08:00 Chicago 2) Fri 13 Nov 09:00 Chicago Reply 1 or 2 to book.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100139 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-4f52904c-202d-43b6-ab85-6bcd0fcd5d99 | 5 | {
"status": "test_held",
"recipient": "15550100139",
"provider_message_id": null,
"kind": "free_form",
"text": "No problem, I have updated your request to Heating and cooling. Thanks for clarifying. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-4f52904c-202d-43b6-ab85-6bcd0fcd5d99",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100139 | 1 | {
"service": "Heating and cooling",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT conversations of 15550100139 | 3 | {
"step": "awaiting_pick",
"offered_slots": [
{
"n": 1,
"end": "2026-11-13T15:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 08:00 Chicago",
"start": "2026-11-13T14:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-13T16:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 09:00 Chicago",
"start": "2026-11-13T15:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-57ffd91f-af65-4895-b0eb-7ba2194db126 | 5 | {
"status": "test_held",
"recipient": "15550100139",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you, we have your ZIP code 60614 and your heating and cooling request. Your answer will help us move to the next step. When would you like us to come: morning, afternoon, or a specific day?\n1) M…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-57ffd91f-af65-4895-b0eb-7ba2194db126",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-d88351e7-5404-4291-9455-1dc6bcf3565d | 5 | {
"status": "test_held",
"recipient": "15550100139",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 12 Nov 12:00 Chicago\n2) Thu 12 Nov 13:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-d88351e7-5404-4291-9455-1dc6bcf3565d",
"offered_slots": [
{
"n": 1,
"end": "2026-11-12T19:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 12:00 Chicago",
"start": "2026-11-12T18:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "12:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-12T20:00:00.000Z",
"lead": null,
"label": "Thu 12 Nov 13:00 Chicago",
"start": "2026-11-12T19:00:00.000Z",
"business": {
"date": "2026-11-12",
"time": "13:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-439bfb33-e4da-4a9d-8313-1a73dd537442 | 6 | {
"status": "test_held",
"recipient": "15550100139",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 13 Nov 08:00 Chicago\n2) Fri 13 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-439bfb33-e4da-4a9d-8313-1a73dd537442",
"offered_slots": [
{
"n": 1,
"end": "2026-11-13T15:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 08:00 Chicago",
"start": "2026-11-13T14:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-13T16:00:00.000Z",
"lead": null,
"label": "Fri 13 Nov 09:00 Chicago",
"start": "2026-11-13T15:00:00.000Z",
"business": {
"date": "2026-11-13",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} |
pass D10 a quiet lead returns: Q2 asked, 3 days later «sorry, it's 60614» → zip kept, Q3, the same lead and thread
pass What we did: D10 a quiet lead returns: Q2 asked, 3 days later «sorry, it's 60614» → zip kept, Q3, the same lead and thread
Expected: what the line above claims. Actual: every check of it held.
- Lead
my kitchen sink leaks
- Bot
Hello, this is Northside Home Services (fictional). Sorry to hear your kitchen sink is leaking, and we can help you get a plumbing visit arranged. What is the ZIP code of the address?
- Lead
sorry, it's 60614
- Bot
No problem, thanks for confirming your ZIP code, 60614. That is within our service area. When would you like us to come: morning, afternoon, or a specific day? 1) Morning (8-12) 2) Afternoon (12-18) 3) A specific day
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 | ||
| llm.compose | done | 1 | ||
| outbox.follow_up | done | 1 | ||
| llm.extract | done | 1 | ||
| llm.compose | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100138 | new | awaiting_pick | human |
| 15550100140 | new | awaiting_time_window | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-6684aae2-1711-4e3f-8d64-102ee9386b60 | 6 | {
"status": "test_held",
"recipient": "15550100140",
"provider_message_id": null,
"kind": "free_form",
"text": "Hello, this is Northside Home Services (fictional). Sorry to hear your kitchen sink is leaking, and we can help you get a plumbing visit arranged. What is the ZIP code of the address?",
"step": "awaiting_zip",
"event_id": "wamid.TEST-6684aae2-1711-4e3f-8d64-102ee9386b60",
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-63d445fb-6e43-41da-bea1-21e757a00653 | 5 | {
"status": "test_held",
"recipient": "15550100140",
"provider_message_id": null,
"kind": "free_form",
"text": "No problem, thanks for confirming your ZIP code, 60614. That is within our service area. When would you like us to come: morning, afternoon, or a specific day?\n1) Morning (8-12)\n2) Afternoon (12-18)\n3…",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-63d445fb-6e43-41da-bea1-21e757a00653",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100140 | 1 | {
"service": "Plumbing",
"zip": "60614",
"time_window": null
} |
pass D11 off-profile, Sam's words: «I want to have an our with the dantist» → declined with the 3 trades, a person, never booked; «1» → nothing
pass What we did: D11 off-profile, Sam's words: «I want to have an our with the dantist» → declined with the 3 trades, a person, never booked; «1» → nothing
Expected: what the line above claims. Actual: every check of it held.
- Lead
I want to have an our with the dantist
- Bot
Sorry, Northside Home Services (fictional) only does Plumbing, Heating and cooling, and Electrical work, so this cannot be booked here. Thank you, a person from our team will reply to you here.
- Lead
1
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100141 | new | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-f2e87ee7-5ae3-4b77-a8fa-c57e526048da | 3 | {
"status": "test_held",
"recipient": "15550100141",
"provider_message_id": null,
"kind": "free_form",
"text": "Sorry, Northside Home Services (fictional) only does Plumbing, Heating and cooling, and Electrical work, so this cannot be booked here. Thank you, a person from our team will reply to you here.",
"step": null,
"event_id": "wamid.TEST-f2e87ee7-5ae3-4b77-a8fa-c57e526048da",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100141 | 2 | {
"service": "Something else",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT conversations of 15550100141 | 1 | {
"step": null,
"offered_slots": null
} | ||
| outbox | SELECT outbox of wamid.TEST-2207f4f0-dfc4-4dc5-8be6-f678de5a18b2 | 1 | null |
pass D11 in trade: «I need my gutters cleaned» → «Something else» → a person, the task holds the words; not booked
pass What we did: D11 in trade: «I need my gutters cleaned» → «Something else» → a person, the task holds the words; not booked
Expected: what the line above claims. Actual: every check of it held.
- Lead
I need my gutters cleaned
- Bot
This job needs a colleague to look at it, so it cannot be booked here. Thank you, a person from our team will reply to you here.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| llm.extract | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100142 | new | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-f994fc8d-e15a-466f-b2e4-ec082215e31d | 4 | {
"status": "test_held",
"recipient": "15550100142",
"provider_message_id": null,
"kind": "free_form",
"text": "This job needs a colleague to look at it, so it cannot be booked here. Thank you, a person from our team will reply to you here.",
"step": null,
"event_id": "wamid.TEST-f994fc8d-e15a-466f-b2e4-ec082215e31d",
"offered_slots": null
} | ||
| outbox | SELECT leads of 15550100142 | 2 | {
"service": "Something else",
"zip": null,
"time_window": null
} | ||
| outbox | SELECT conversations of 15550100142 | 2 | {
"step": null,
"offered_slots": null
} |
pass 1 bases: no runtime_config row → the real hosts; a row → that base; an unknown api → NULL (db/006 api_base)
pass What we did: 1 bases: no runtime_config row → the real hosts; a row → that base; an unknown api → NULL (db/006 api_base)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 every HTTP node of check_and_book, the CRM writer and the probe sends to a base from runtime_config: no host literal in a URL
pass What we did: 2 every HTTP node of check_and_book, the CRM writer and the probe sends to a base from runtime_config: no host literal in a URL
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 receiver: a replayed event is ONE row whose deliveries counts each delivery; an id twice in one delivery counts once
pass What we did: 3 receiver: a replayed event is ONE row whose deliveries counts each delivery; an id twice in one delivery counts once
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 conversation: the stored event is claimed once (processed_at IS NULL); a replay claims nothing
pass What we did: 4 conversation: the stored event is claimed once (processed_at IS NULL); a replay claims nothing
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 contact search: by the phone's digits; a name of 2+ words is also searched as firstname, and as firstname + lastname
pass What we did: 5 contact search: by the phone's digits; a name of 2+ words is also searched as firstname, and as firstname + lastname
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 ambiguous identity: a live contact with the lead's name on ANOTHER phone, while no contact has the phone → a new contact + both named; never a merge
pass What we did: 6 ambiguous identity: a live contact with the lead's name on ANOTHER phone, while no contact has the phone → a new contact + both named; never a merge
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 7 phone map guard: nothing found and the map held by ANOTHER op with no contact yet → stop (no second contact); else write
pass What we did: 7 phone map guard: nothing found and the map held by ANOTHER op with no contact yet → stop (no second contact); else write
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 8 the hand-off request of an ambiguous identity: the lead's thread, reason ambiguous_identity, once per booking, the step and both contacts
pass What we did: 8 the hand-off request of an ambiguous identity: the lead's thread, reason ambiguous_identity, once per booking, the step and both contacts
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 9 phone map SQL: the contact claim takes the row; a failed write releases it, the next claim takes it over; a done write records its contact; deal/note claims never touch it
pass What we did: 9 phone map SQL: the contact claim takes the row; a failed write releases it, the next claim takes it over; a done write records its contact; deal/note claims never touch it
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 10 PM two sessions claim +15550100126 at once → ONE map row; the second reads the first's op id, then its contact id
pass What we did: 10 PM two sessions claim +15550100126 at once → ONE map row; the second reads the first's op id, then its contact id
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 11 the sink's alert names the step the caller gave (S2 reuses lwd_handoff)
pass What we did: 11 the sink's alert names the step the caller gave (S2 reuses lwd_handoff)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass P0 proxy reach: freeBusy (googleApi) and pipelines (httpHeaderAuth) through the proxy → 200, one line each; a 503 injected reaches the probe; routes direct → 0 lines
pass What we did: P0 proxy reach: freeBusy (googleApi) and pipelines (httpHeaderAuth) through the proxy → 200, one line each; a 503 injected reaches the probe; routes direct → 0 lines
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| crm | POST /crm/v3/objects/notes/search | 200 | 1 | {
"total": 0,
"results": []
} | |
| crm | POST /crm/v3/objects/deals/search | 200 | 1 | {
"total": 0,
"results": []
} | |
| crm | POST /crm/v3/objects/contacts/search | 200 | 1 | {
"total": 0,
"results": []
} | |
| calendar | GET /calendars/CAL/events?privateExtendedProperty=lwd_test%3D1&maxResults=250&showDeleted=false | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:06:00.746Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextPageToken": "[withheld: not a test object]",
"items": []
} | |
| calendar | GET /calendars/CAL/events?privateExtendedProperty=lwd_test%3D1&maxResults=250&showDeleted=false&pageToken=CkYKNgo0CgwIq4Xq1gYQmLT3nwISJAoiCiA3YTgyMjAwMTk5MzA0NTcyOTY1Y2E2MGU5Mzg2ZDRmMhoMCOW89NYGEMiuhbMDwD4B | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:06:00.746Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": []
} |
pass 1 R12 offer: the conversation's freeBusy URL is the claim's calendar_base (no host literal); the claim hands over api_base('calendar')
pass What we did: 1 R12 offer: the conversation's freeBusy URL is the claim's calendar_base (no host literal); the claim hands over api_base('calendar')
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 R12 guard: every harness file that drives the stack imports ./live-guard.ts, whose before-hook routes every API direct
pass What we did: 2 R12 guard: every harness file that drives the stack imports ./live-guard.ts, whose before-hook routes every API direct
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 case 10 retries: «freeBusy on the slot» fails on an HTTP error, tries 3 times 2 s apart, then its error output takes the calendar-fault path
pass What we did: 3 case 10 retries: «freeBusy on the slot» fails on an HTTP error, tries 3 times 2 s apart, then its error output takes the calendar-fault path
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 case 10 fault: the HTTP status from n8n's error item; the sink gets the lead's thread, reason calendar_failed, step calendar.freebusy, once per booking
pass What we did: 4 case 10 fault: the HTTP status from n8n's error item; the sink gets the lead's thread, reason calendar_failed, step calendar.freebusy, once per booking
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 case 10 SQL: the calendar op failed with its status and step, the hold kept unconfirmed; one «we will confirm» reply per booking; a done op is never failed
pass What we did: 5 case 10 SQL: the calendar op failed with its status and step, the hold kept unconfirmed; one «we will confirm» reply per booking; a done op is never failed
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 SW/12 sweeper pick: claimed booking ops past stuck_after_s (600 s; the knob when set), oldest first, one a run; < 3 attempts + a booking → redrive and a stuck_op alert; else handoff; attempts kept
pass What we did: 6 SW/12 sweeper pick: claimed booking ops past stuck_after_s (600 s; the knob when set), oldest first, one a run; < 3 attempts + a booking → redrive and a stuck_op alert; else handoff; attempts kept
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 7 case 12 re-drive: «Re-drive request» hands check_and_book the stored booking; «Plan the booking» makes of it the SAME key, slot, lead and correlation id
pass What we did: 7 case 12 re-drive: «Re-drive request» hands check_and_book the stored booking; «Plan the booking» makes of it the SAME key, slot, lead and correlation id
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 8 case 12 claim: «Claim the calendar op» stores the booking it plans (the sweeper's re-drive) and hands over the CRM pause knob (default 0)
pass What we did: 8 case 12 claim: «Claim the calendar op» stores the booking it plans (the sweeper's re-drive) and hands over the CRM pause knob (default 0)
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 9 SW hand-off: «Stuck hand-off request» asks the sink for the lead's thread, reason stuck, once per op, with the step and attempts; «Close the stuck op» fails it, attempts kept
pass What we did: 9 SW hand-off: «Stuck hand-off request» asks the sink for the lead's thread, reason stuck, once per op, with the step and attempts; «Close the stuck op» fails it, attempts kept
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 10 case 12 «Recovered?»: one recovered alert, naming the stuck alert, only once every booking op of the key is done and the confirmation written
pass What we did: 10 case 12 «Recovered?»: one recovered alert, naming the stuck alert, only once every booking op of the key is done and the confirmation written
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 11 the sweeper's wiring: every 10 s; a pick → redrive (check_and_book, its error does not stop the run) → «Recovered?»; handoff → the ONE sink → «Close the stuck op»
pass What we did: 11 the sweeper's wiring: every 10 s; a pick → redrive (check_and_book, its error does not stop the run) → «Recovered?»; handoff → the ONE sink → «Close the stuck op»
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass G R12 guard: a dead proxy base a crashed run left is gone before a live file's first test; routed direct, the probe reaches the real hosts and the proxy sees nothing
pass What we did: G R12 guard: a dead proxy base a crashed run left is gone before a live file's first test; routed direct, the probe reaches the real hosts and the proxy sees nothing
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass SW a booking op stuck at its 3rd attempt (claimed, 11 min old) → the sweeper does NOT re-run it: a human task stuck, an alert (lead, step), attempts stay 3
pass What we did: SW a booking op stuck at its 3rd attempt (claimed, 11 min old) → the sweeper does NOT re-run it: a human task stuck, an alert (lead, step), attempts stay 3
Expected: what the line above claims. Actual: every check of it held.
No message of a test lead was recorded while this test ran.
| at | kind | message | status |
|---|---|---|---|
| handoff | A lead needs a person: stuck | held |
| at | reason | status | lead's words |
|---|---|---|---|
| stuck | open |
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | failed | 3 | stuck after 3 attempt(s): handed to a person |
| lead | status | step | mode |
|---|---|---|---|
| 15550100113 | new | awaiting_pick | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3D3d7e50d3-4457-4b4d-b235-0989be2d78a7 | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:10:24.457Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": []
} |
pass ST the cleanup waits for a booking run in flight (D334): a pick paused 15 s before the CRM is seen in flight, and settleBookings returns only once its CRM writes are done
pass What we did: ST the cleanup waits for a booking run in flight (D334): a pick paused 15 s before the CRM is seen in flight, and settleBookings returns only once its CRM writes are done
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Fri 27 Nov 08:00 Chicago 2) Fri 27 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Fri 27 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100160 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-8cfac641-b597-492a-9d62-b6a1ef769af0 | 3 | {
"status": "test_held",
"recipient": "15550100160",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 27 Nov 08:00 Chicago\n2) Fri 27 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-8cfac641-b597-492a-9d62-b6a1ef769af0",
"offered_slots": [
{
"n": 1,
"end": "2026-11-27T15:00:00.000Z",
"lead": null,
"label": "Fri 27 Nov 08:00 Chicago",
"start": "2026-11-27T14:00:00.000Z",
"business": {
"date": "2026-11-27",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-27T16:00:00.000Z",
"lead": null,
"label": "Fri 27 Nov 09:00 Chicago",
"start": "2026-11-27T15:00:00.000Z",
"business": {
"date": "2026-11-27",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} |
pass 1 sender SQL: only DUE rows (send_after on the injected clock); free text only within 24 h of the lead's last message (exactly 24 h is closed; none = closed); a template outside it; a row with no thread by row age; an opted-out number of THIS tenant cancelled; a fixture held only once due
pass What we did: 1 sender SQL: only DUE rows (send_after on the injected clock); free text only within 24 h of the lead's last message (exactly 24 h is closed; none = closed); a template outside it; a row with no thread by row age; an opted-out number of THIS tenant cancelled; a fixture held only once due
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 sender message: a template row goes out as that approved template (its language, en_US by default), never as text; one without a name is not sent
pass What we did: 2 sender message: a template row goes out as that approved template (its language, en_US by default), never as text; one without a name is not sent
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 follow-up SQL: a bot thread at a question, silent 20 h to 48 h (20 h included, 48 h not), not opted out, a last message known → ONE row per silence: free text inside 24 h (the lead-in and the open question), else the template, else a hand-off; held unless live
pass What we did: 3 follow-up SQL: a bot thread at a question, silent 20 h to 48 h (20 h included, 48 h not), not opted out, a last message known → ONE row per silence: free text inside 24 h (the lead-in and the open question), else the template, else a hand-off; held unless live
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 follow-up hand-off requests: each window-closed silence → the sink's request, reason window_closed, once per silence; nothing → no request
pass What we did: 4 follow-up hand-off requests: each window-closed silence → the sink's request, reason window_closed, once per silence; nothing → no request
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 the pick's rules: STOP (the whole message, a few spellings) in any step and mode → stop; a BOOKED bot thread asking to move → a re-offer by rule at step reschedule; anything else unchanged
pass What we did: 5 the pick's rules: STOP (the whole message, a few spellings) in any step and mode → stop; a BOOKED bot thread asking to move → a re-offer by rule at step reschedule; anything else unchanged
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 opt-out SQL: one suppression row per number (the first STOP's evidence: id, words, clock); the thread's queued and held sends cancelled; sent rows and another thread untouched
pass What we did: 6 opt-out SQL: one suppression row per number (the first STOP's evidence: id, words, clock); the thread's queued and held sends cancelled; sent rows and another thread untouched
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 7 no slot: only the offer's «no free slot» error becomes the hand-off (reason no_slot, the horizon searched); any other error still stops the run; the lead's one line after the sink; no slot offered
pass What we did: 7 no slot: only the offer's «no free slot» error becomes the hand-off (reason no_slot, the horizon searched); any other error still stops the run; the lead's one line after the sink; no slot offered
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 8 e-mail: a typed address is kept as typed (case kept, the sentence's full stop not), none → null; the reply SQL sets it when given and keeps the lead's when not
pass What we did: 8 e-mail: a typed address is kept as typed (case kept, the sentence's full stop not), none → null; the reply SQL sets it when given and keeps the lead's when not
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 9 reschedule SQL: the old booking is found only once the NEW slot's hold is confirmed (another slot, confirmed, with an event, this lead); its cancel is claimed once; 200/204/404/410 free the old hold, anything else keeps it; check_and_book skips the CRM only for a reschedule
pass What we did: 9 reschedule SQL: the old booking is found only once the NEW slot's hold is confirmed (another slot, confirmed, with an event, this lead); its cancel is claimed once; 200/204/404/410 free the old hold, anything else keeps it; check_and_book skips the CRM only for a reschedule
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 10 the person's reply SQL: kept once per message id as the person's own row (author human, held for a fixture), after the sink
pass What we did: 10 the person's reply SQL: kept once per message id as the person's own row (author human, held for a fixture), after the sink
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 11 the wiring: STOP before the pick; the offer's error output to the no-slot hand-off; the old free after check_and_book; a reschedule skips the CRM; the sink BEFORE the person's row; schedules and the takeover webhook
pass What we did: 11 the wiring: STOP before the pick; the offer's error output to the no-slot hand-off; the old free after check_and_book; a reschedule skips the CRM; the sink BEFORE the person's row; schedules and the takeover webhook
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 12 D336 the calendar down at the offer: freeBusy bounded (3-10 s) and its failure an item; every freeBusy failure → calendar_unavailable hand-off once per event; the code's fallback line after the sink
pass What we did: 12 D336 the calendar down at the offer: freeBusy bounded (3-10 s) and its failure an item; every freeBusy failure → calendar_unavailable hand-off once per event; the code's fallback line after the sink
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 1 H1 db/008: inbound = the thread's last customer message (the clock the flow wrote); booking and crm_write = the injected clock when a calendar or CRM op turns done; nothing else beats
pass What we did: 1 H1 db/008: inbound = the thread's last customer message (the clock the flow wrote); booking and crm_write = the injected clock when a calendar or CRM op turns done; nothing else beats
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 H1 receiver: a signed «delivered» status of a CONFIRMATION writes confirmation_delivered at the injected clock for the row's tenant; «sent», another row, or an unsigned body writes nothing
pass What we did: 2 H1 receiver: a signed «delivered» status of a CONFIRMATION writes confirmation_delivered at the injected clock for the row's tenant; «sent», another row, or an unsigned body writes nothing
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 H2 monitor: inbound older than 180 min in business hours (Tue 14:00 Chicago) → ONE alert heartbeat_gap per gap, however many runs; exactly 180 min → none
pass What we did: 3 H2 monitor: inbound older than 180 min in business hours (Tue 14:00 Chicago) → ONE alert heartbeat_gap per gap, however many runs; exactly 180 min → none
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 H2 monitor: business hours in the TENANT zone — a closed day (Sat), before open (07:59), at close (18:00) → none; at open (08:00) → one; a tenant's own gap threshold wins
pass What we did: 4 H2 monitor: business hours in the TENANT zone — a closed day (Sat), before open (07:59), at close (18:00) → none; at open (08:00) → one; a tenant's own gap threshold wins
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 STUCK (R7/R9) monitor: an op of OURS claimed > 30 min (real time) in business hours → ONE alert stuck_worker naming the lead and the step; 29 min, done, or a closed day → none
pass What we did: 5 STUCK (R7/R9) monitor: an op of OURS claimed > 30 min (real time) in business hours → ONE alert stuck_worker naming the lead and the step; 29 min, done, or a closed day → none
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 R9 the monitor's stuck signal is OUR operations, never n8n's execution_entity: soft-deleted `running` rows (n8n's unsaved successes) raise nothing
pass What we did: 6 R9 the monitor's stuck signal is OUR operations, never n8n's execution_entity: soft-deleted `running` rows (n8n's unsaved successes) raise nothing
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 7 the monitor runs every 10 s, saves no successful run, and its one node is wired to the schedule
pass What we did: 7 the monitor runs every 10 s, saves no successful run, and its one node is wired to the schedule
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 8 case 11: a 429 from the contact write is sent again after Retry-After (1–10 s), up to 3 sends in all; any other answer, or the 3rd 429, goes on as it came
pass What we did: 8 case 11: a 429 from the contact write is sent again after Retry-After (1–10 s), up to 3 sends in all; any other answer, or the 3rd 429, goes on as it came
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 9 case 13: the event write survives a cut answer — sent again on a transport error with the SAME body (the claim's event id), and a 409 then is an answer, not an error
pass What we did: 9 case 13: the event write survives a cut answer — sent again on a transport error with the SAME body (the claim's event id), and a 409 then is an answer, not an error
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 10 H3 sender: a send answered 401 (or any refusal) → the outbox row failed + ONE alert send_failed naming the lead, step meta.send and the status; a sent row raises none
pass What we did: 10 H3 sender: a send answered 401 (or any refusal) → the outbox row failed + ONE alert send_failed naming the lead, step meta.send and the status; a sent row raises none
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 11 RC (5b): a failed cancel of the old event → the ONE sink (lwd_handoff): reason cancel_failed, the lead's thread, step calendar.cancel, the old event id; a done cancel goes nowhere
pass What we did: 11 RC (5b): a failed cancel of the old event → the ONE sink (lwd_handoff): reason cancel_failed, the lead's thread, step calendar.cancel, the old event id; a done cancel goes nowhere
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass H1 a fixture booking writes the heartbeat rows inbound, booking and crm_write at the INJECTED clock; a signed «delivered» status of its confirmation writes confirmation_delivered
pass What we did: H1 a fixture booking writes the heartbeat rows inbound, booking and crm_write at the INJECTED clock; a signed «delivered» status of its confirmation writes confirmation_delivered
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Thu 26 Nov 10:00 Chicago 2) Thu 26 Nov 11:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Thu 26 Nov 10:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100114 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-239af253-3807-467a-a1fa-eabe3a86b72a | 2 | {
"status": "test_held",
"recipient": "15550100114",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 26 Nov 10:00 Chicago\n2) Thu 26 Nov 11:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-239af253-3807-467a-a1fa-eabe3a86b72a",
"offered_slots": [
{
"n": 1,
"end": "2026-11-26T17:00:00.000Z",
"lead": null,
"label": "Thu 26 Nov 10:00 Chicago",
"start": "2026-11-26T16:00:00.000Z",
"business": {
"date": "2026-11-26",
"time": "10:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-26T18:00:00.000Z",
"lead": null,
"label": "Thu 26 Nov 11:00 Chicago",
"start": "2026-11-26T17:00:00.000Z",
"business": {
"date": "2026-11-26",
"time": "11:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of 15550100114 | 4 | [
{
"status": "test_held",
"recipient": "15550100114",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Thu 26 Nov 10:00 Chicago\n2) Thu 26 Nov 11:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-239af253-3807-467a-a1fa-eabe3a86b72a",
"offered_slots": [
{
"n": 1,
"end": "2026-11-26T17:00:00.000Z",
"lead": null,
"label": "Thu 26 Nov 10:00 Chicago",
"start": "2026-11-26T16:00:00.000Z",
"business": {
"date": "2026-11-26",
"time": "10:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-26T18:00:00.000Z",
"lead": null,
"label": "Thu 26 Nov 11:00 Chicago",
"start": "2026-11-26T17:00:00.000Z",
"business": {
"date": "2026-11-26",
"time": "11:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100114",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Thu 26 Nov 10:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-f7022f52-fe95-406e-b031-59d0f34cd1ec",
"offered_slots": null
}
] |
pass H2 a gap of inbound in business hours (Tue 14:00 Chicago, last inbound 4 h back) → ONE alert heartbeat_gap; a later monitor run → no second; a closed day (Sat 14:00) → none
pass What we did: H2 a gap of inbound in business hours (Tue 14:00 Chicago, last inbound 4 h back) → ONE alert heartbeat_gap; a later monitor run → no second; a closed day (Sat 14:00) → none
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass STUCK (R7/R9) one of OUR operations claimed and not done for 31 min in business hours → one alert stuck_worker (lead, step); one claimed 1 min → none; n8n's soft-deleted `running` rows raise nothing
pass What we did: STUCK (R7/R9) one of OUR operations claimed and not done for 31 min in business hours → one alert stuck_worker (lead, step); one claimed 1 min → none; n8n's soft-deleted `running` rows raise nothing
Expected: what the line above claims. Actual: every check of it held.
No message of a test lead was recorded while this test ran.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| meta.send | claimed | 1 | ||
| llm.extract | claimed | 1 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100115 | new | booked | bot |
pass RC (5b) a reschedule whose old-event cancel fails (Google 500) → the cancel op failed, ONE alert (lead, calendar.cancel) and ONE human task cancel_failed; the new booking stands
pass What we did: RC (5b) a reschedule whose old-event cancel fails (Google 500) → the cancel op failed, ONE alert (lead, calendar.cancel) and ONE human task cancel_failed; the new booking stands
Expected: what the line above claims. Actual: every check of it held.
- Lead
can we reschedule please?
- Bot
Your visit stays booked until you pick a new time. These times are free: 1) Wed 9 Dec 08:00 Chicago 2) Wed 9 Dec 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Wed 9 Dec 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| calendar.cancel | failed | 1 | {"error":{"code":500,"message":"injected"}} |
| lead | status | step | mode |
|---|---|---|---|
| 15550100123 | booked | booked | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-8a396f74-dcbe-4eb3-90e2-8045861f1da7 | 2 | {
"status": "test_held",
"recipient": "15550100123",
"provider_message_id": null,
"kind": "free_form",
"text": "Your visit stays booked until you pick a new time.\nThese times are free:\n1) Wed 9 Dec 08:00 Chicago\n2) Wed 9 Dec 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-8a396f74-dcbe-4eb3-90e2-8045861f1da7",
"offered_slots": [
{
"n": 1,
"end": "2026-12-09T15:00:00.000Z",
"lead": null,
"label": "Wed 9 Dec 08:00 Chicago",
"start": "2026-12-09T14:00:00.000Z",
"business": {
"date": "2026-12-09",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-12-09T16:00:00.000Z",
"lead": null,
"label": "Wed 9 Dec 09:00 Chicago",
"start": "2026-12-09T15:00:00.000Z",
"business": {
"date": "2026-12-09",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| calendar | GET /calendars/CAL/events?maxResults=250&showDeleted=false&singleEvents=true&privateExtendedProperty=correlation_id%3Df15bcd6c-bde9-4d15-91e9-6542af32b83b | 200 | 1 | {
"kind": "[withheld: not a test object]",
"etag": "[withheld: not a test object]",
"summary": "[withheld: not a test object]",
"description": "[withheld: not a test object]",
"updated": "2026-10-24T21:17:04.879Z",
"timeZone": "[withheld: not a test object]",
"accessRole": "writer",
"defaultReminders": [],
"nextSyncToken": "[withheld: not a test object]",
"items": [
{
"kind": "calendar#event",
"etag": "\"3585753242044350\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:17:00.000Z",
"updated": "2026-10-24T21:17:01.022Z",
"summary": "[lwd-test] fixture f15bcd6c-bde9-4d15-91e9-6542af32b83b",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-12-10T09:00:00-06:00",
"timeZone": "UTC"
},
"end": {
"dateTime": "2026-12-10T10:00:00-06:00",
"timeZone": "UTC"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "f15bcd6c-bde9-4d15-91e9-6542af32b83b"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
},
{
"kind": "calendar#event",
"etag": "\"3585753248027262\"",
"id": "event-•••",
"status": "confirmed",
"htmlLink": "https://www.google.com/calendar/event?eid=•••",
"created": "2026-10-24T21:17:03.000Z",
"updated": "2026-10-24T21:17:04.013Z",
"summary": "[lwd-test] Plumbing - LWDTEST planted 15550100123",
"description": "Booked Wed 9 Dec 08:00 Chicago. ZIP 60614. Correlation f15bcd6c-bde9-4d15-91e9-6542af32b83b.",
"creator": {
"email": "service-account@•••"
},
"organizer": {
"email": "CAL",
"displayName": "Northside Test",
"self": true
},
"start": {
"dateTime": "2026-12-09T08:00:00-06:00",
"timeZone": "America/Chicago"
},
"end": {
"dateTime": "2026-12-09T09:00:00-06:00",
"timeZone": "America/Chicago"
},
"iCalUID": "event-•••@google.com",
"sequence": 0,
"extendedProperties": {
"private": {
"lwd_test": "1",
"correlation_id": "f15bcd6c-bde9-4d15-91e9-6542af32b83b"
}
},
"reminders": {
"useDefault": true
},
"eventType": "default"
}
]
} |
pass 1 the claim takes a REAL lead's held alert of the last 15 minutes; a fixture lead's (+1 555 010 01xx, +44 7700 900xxx) never
pass What we did: 1 the claim takes a REAL lead's held alert of the last 15 minutes; a fixture lead's (+1 555 010 01xx, +44 7700 900xxx) never
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 the claim's time window: older than 15 min or more than 1 min ahead stays held; 14 min old and now+30 s are taken
pass What we did: 2 the claim's time window: older than 15 min or more than 1 min ahead stays held; 14 min old and now+30 s are taken
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 the claim takes only held, unclaimed or stale-claimed (5 min) alerts, and nothing at all with no webhook URL
pass What we did: 3 the claim takes only held, unclaimed or stale-claimed (5 min) alerts, and nothing at all with no webhook URL
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 the mark: a 2xx answer → sent with sent_at; 500, no answer or a malformed code → failed with no sent_at; a closed row is not changed
pass What we did: 4 the mark: a 2xx answer → sent with sent_at; 500, no answer or a malformed code → failed with no sent_at; a closed row is not changed
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 case (c): Mark the contact → «Rate limit spent?» (failed AND the last answer 429) → a crm_rate_limited request → lwd_handoff → keep the confirmation → a stop that throws; else → Check the contact write
pass What we did: 5 case (c): Mark the contact → «Rate limit spent?» (failed AND the last answer 429) → a crm_rate_limited request → lwd_handoff → keep the confirmation → a stop that throws; else → Check the contact write
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 the capture withholds the values of an object that is not the harness's; keeps ids, instants and a tagged object whole
pass What we did: 6 the capture withholds the values of an object that is not the harness's; keeps ids, instants and a tagged object whole
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 7 the capture cuts lists to 5 items and strings to 200 characters
pass What we did: 7 the capture cuts lists to 5 items and strings to 200 characters
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass SL0 n8n holds ALERT_SLACK_WEBHOOK_URL by name (set or empty; its value is never read here)
pass What we did: SL0 n8n holds ALERT_SLACK_WEBHOOK_URL by name (set or empty; its value is never read here)
Expected: what the line above claims. Actual: every check of it held.
# SL0 ALERT_SLACK_WEBHOOK_URL in n8n: set
No row of a test lead was written while this test ran.
pass SL1 a REAL lead's alert is POSTed to the webhook (the proxy, a fake URL) → status sent, sent_at set, one call
pass What we did: SL1 a REAL lead's alert is POSTed to the webhook (the proxy, a fake URL) → status sent, sent_at set, one call
Expected: what the line above claims. Actual: every check of it held.
# SL1 posted by the deployed poller
No row of a test lead was written while this test ran.
pass SL2 the webhook answers 500 → the alert row is failed, sent_at stays empty, and it is not posted again
pass What we did: SL2 the webhook answers 500 → the alert row is failed, sent_at stays empty, and it is not posted again
Expected: what the line above claims. Actual: every check of it held.
# SL2 posted by the lab run
No row of a test lead was written while this test ran.
pass SL3 a FIXTURE lead's alert, and a real lead's alert older than the delivery window, stay held: nothing is posted
pass What we did: SL3 a FIXTURE lead's alert, and a real lead's alert older than the delivery window, stay held: nothing is posted
Expected: what the line above claims. Actual: every check of it held.
No message of a test lead was recorded while this test ran.
| at | kind | message | status |
|---|---|---|---|
| handoff | A lead needs a person: s4a_delivery_check | held |
Tasks for a person: none.
Operations (calendar, CRM, sends): none.
| lead | status | step | mode |
|---|---|---|---|
| 15550100147 | new | awaiting_pick | bot |
pass C429 case (c): HubSpot answers 429 to all 3 contact creates → the contact op failed, ONE human task crm_rate_limited and ONE alert (held: a fixture lead)
pass What we did: C429 case (c): HubSpot answers 429 to all 3 contact creates → the contact op failed, ONE human task crm_rate_limited and ONE alert (held: a fixture lead)
Expected: what the line above claims. Actual: every check of it held.
- Lead
[image]
- Bot
These times are free: 1) Wed 2 Dec 09:00 Chicago 2) Wed 2 Dec 10:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Wed 2 Dec 09:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | failed | 1 | {"status":"error","category":"RATE_LIMITS","message":"injected"} |
| lead | status | step | mode |
|---|---|---|---|
| 15550100129 | booked | booked | human |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-cd7f44ec-a639-4e7e-8c63-811737dfba9f | 2 | {
"status": "test_held",
"recipient": "15550100129",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Wed 2 Dec 09:00 Chicago\n2) Wed 2 Dec 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-cd7f44ec-a639-4e7e-8c63-811737dfba9f",
"offered_slots": [
{
"n": 1,
"end": "2026-12-02T16:00:00.000Z",
"lead": null,
"label": "Wed 2 Dec 09:00 Chicago",
"start": "2026-12-02T15:00:00.000Z",
"business": {
"date": "2026-12-02",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-12-02T17:00:00.000Z",
"lead": null,
"label": "Wed 2 Dec 10:00 Chicago",
"start": "2026-12-02T16:00:00.000Z",
"business": {
"date": "2026-12-02",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of 15550100129 | 1 | [
{
"status": "cancelled",
"recipient": "15550100129",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Wed 2 Dec 09:00 Chicago\n2) Wed 2 Dec 10:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-cd7f44ec-a639-4e7e-8c63-811737dfba9f",
"offered_slots": [
{
"n": 1,
"end": "2026-12-02T16:00:00.000Z",
"lead": null,
"label": "Wed 2 Dec 09:00 Chicago",
"start": "2026-12-02T15:00:00.000Z",
"business": {
"date": "2026-12-02",
"time": "09:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-12-02T17:00:00.000Z",
"lead": null,
"label": "Wed 2 Dec 10:00 Chicago",
"start": "2026-12-02T16:00:00.000Z",
"business": {
"date": "2026-12-02",
"time": "10:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100129",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Wed 2 Dec 09:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-f3807523-6b7f-4b3c-a507-f1cfa2d5f461",
"offered_slots": null
}
] |
pass CAP an adapter's read writes one capture line for this file: source, call, and what it held
pass What we did: CAP an adapter's read writes one capture line for this file: source, call, and what it held
Expected: what the line above claims. Actual: every check of it held.
No message of a test lead was recorded while this test ran.
Alerts: none.
Tasks for a person: none.
Operations (calendar, CRM, sends): none.
| lead | status | step | mode |
|---|---|---|---|
| 15550100147 | new | awaiting_pick | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of 15550100147 | 1 | [] |
pass 1 the register: every workflow with a schedule trigger is in SCHEDULED and no other; each claim and side-effect node exists
pass What we did: 1 the register: every workflow with a schedule trigger is in SCHEDULED and no other; each claim and side-effect node exists
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 the delivery's guard: an item with no alert id ({success:true}, an empty id) stops; a claimed alert goes on; stand_in only for a stand-in URL and an untagged lead
pass What we did: 2 the delivery's guard: an item with no alert id ({success:true}, an empty id) stops; a claimed alert goes on; stand_in only for a stand-in URL and an untagged lead
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 the mark: a 200 from the stand-in for a real lead → failed, no sent_at, stand_in in the row; stand_in false or absent + 200 → sent
pass What we did: 3 the mark: a 200 from the stand-in for a real lead → failed, no sent_at, stand_in in the row; stand_in false or absent + 200 → sent
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 the sender: its claim hands over api_base('meta') (the real Graph host; a runtime_config row moves it); «Send» has no host literal
pass What we did: 4 the sender: its claim hands over api_base('meta') (the real Graph host; a runtime_config row moves it); «Send» has no host literal
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 db/010 api_base(): meta → the Graph host, hubspot and calendar as db/006, an unknown api NULL; a meta_base row moves meta only
pass What we did: 5 db/010 api_base(): meta → the Graph host, hubspot and calendar as db/006, an unknown api NULL; a meta_base row moves meta only
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 never a real channel: the lab process's Slack URL is the proxy's and its token no token; the proxy's slack and meta upstreams are .invalid
pass What we did: 6 never a real channel: the lab process's Slack URL is the proxy's and its token no token; the proxy's slack and meta upstreams are .invalid
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass IDLE-alert-delivery: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
pass What we did: IDLE-alert-delivery: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass EMPTY-alert-delivery: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
pass What we did: EMPTY-alert-delivery: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass GUARD-alert-delivery: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
pass What we did: GUARD-alert-delivery: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass IDLE-sender: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
pass What we did: IDLE-sender: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass EMPTY-sender: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
pass What we did: EMPTY-sender: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass GUARD-sender: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
pass What we did: GUARD-sender: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass IDLE-recovery-sweeper: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
pass What we did: IDLE-recovery-sweeper: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass EMPTY-recovery-sweeper: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
pass What we did: EMPTY-recovery-sweeper: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass GUARD-recovery-sweeper: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
pass What we did: GUARD-recovery-sweeper: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass IDLE-heartbeat: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
pass What we did: IDLE-heartbeat: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass GUARD-heartbeat: the copy without its idle guard is RED on the same verdict
pass What we did: GUARD-heartbeat: the copy without its idle guard is RED on the same verdict
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass IDLE-follow-up: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
pass What we did: IDLE-follow-up: 3 idle runs, every route at the proxy → 0 calls of each kind, no side-effect node, no new row
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass EMPTY-follow-up: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
pass What we did: EMPTY-follow-up: its claim answers one EMPTY item (the incident's shape), 2 runs → the guard stops it: the same verdict, green
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass GUARD-follow-up: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
pass What we did: GUARD-follow-up: the copy without its idle guard (claim answering an empty item) is RED on the same verdict
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass STAND-IN the stand-in (the proxy) answers 200 to a REAL (untagged) lead's alert → failed, stand_in in its row; an LWDTEST lead's → sent
pass What we did: STAND-IN the stand-in (the proxy) answers 200 to a REAL (untagged) lead's alert → failed, stand_in in its row; an LWDTEST lead's → sent
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass STAND-IN-RED the wrong copy that never sees the stand-in marks the real lead's alert sent → the same check is RED
pass What we did: STAND-IN-RED the wrong copy that never sees the stand-in marks the real lead's alert sent → the same check is RED
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass META the sender's WhatsApp call goes to api_base('meta'): with the proxy as the route, ONE POST at its meta route, the row sent with the proxy's id
pass What we did: META the sender's WhatsApp call goes to api_base('meta'): with the proxy as the route, ONE POST at its meta route, the row sent with the proxy's id
Expected: what the line above claims. Actual: every check of it held.
# META run nodes ["Every 5 seconds","Allow-list","Claim one queued row","Build the message","Send (Cloud API)","Mark the send"] # META run nodes ["Every 5 seconds","Allow-list","Claim one queued row","Build the message","Send (Cloud API)"] The connection cannot be established, this usually occurs due to an incorrect host (domain) value
No row of a test lead was written while this test ran.
pass META-RED the wrong copy whose base is a host literal (not runtime_config) never reaches the proxy → the same check is RED
pass What we did: META-RED the wrong copy whose base is a host literal (not runtime_config) never reaches the proxy → the same check is RED
Expected: what the line above claims. Actual: every check of it held.
No row of a test lead was written while this test ran.
pass WINDOW the pollers n8n runs now, 25 s idle with every route at the proxy → their runs counted, 0 calls at the proxy, no new row
pass What we did: WINDOW the pollers n8n runs now, 25 s idle with every route at the proxy → their runs counted, 0 calls at the proxy, no new row
Expected: what the line above claims. Actual: every check of it held.
# WINDOW runs ["LwdAlertSend0001 3","LwdFollowUp00001 5","LwdHeartbeat0001 3","LwdSender0000001 5","LwdSweeper000001 3"]
No row of a test lead was written while this test ran.
pass 1 the wiring (D335): no path reaches the CRM writer without «Confirm to the lead»; the event booked → the confirmation; a reschedule skips the CRM; both ends give the run's answer
pass What we did: 1 the wiring (D335): no path reaches the CRM writer without «Confirm to the lead»; the event booked → the confirmation; a reschedule skips the CRM; both ends give the run's answer
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 2 «The booking's answer» answers the conversation with the confirmation's row (outcome booked), not the CRM writer's
pass What we did: 2 «The booking's answer» answers the conversation with the confirmation's row (outcome booked), not the CRM writer's
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 3 SQL confirmation hands on `old`: absent → false, true → true, false → false; the confirmation is still written once
pass What we did: 3 SQL confirmation hands on `old`: absent → false, true → true, false → false; the confirmation is still written once
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 4 the confirmation's parameter takes `old` from its input, strictly: {old: true} → true; {old: false}, a re-run's claim row (no old) or {old: 'true'} → false
pass What we did: 4 the confirmation's parameter takes `old` from its input, strictly: {old: true} → true; {old: false}, a re-run's claim row (no old) or {old: 'true'} → false
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 5 SQL «Keep the confirmation»: after a CRM hand-off, THIS booking's confirmation cancelled by THAT takeover goes back to its written status; any other row stays as it was
pass What we did: 5 SQL «Keep the confirmation»: after a CRM hand-off, THIS booking's confirmation cancelled by THAT takeover goes back to its written status; any other row stays as it was
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 6 the CRM writer's wiring (D335): each CRM hand-off to the sink is followed by «Keep the confirmation», with the request's own reason; both keep nodes hold one query
pass What we did: 6 the CRM writer's wiring (D335): each CRM hand-off to the sink is followed by «Keep the confirmation», with the request's own reason; both keep nodes hold one query
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass 7 the proxy's HANG (case 9's fault): a hang rule holds the call unanswered and logs it (status 0, hang); clear() drops it; with the rule spent the call goes on
pass What we did: 7 the proxy's HANG (case 9's fault): a hang rule holds the call unanswered and logs it (status 0, hang); clear() drops it; with the rule spent the call goes on
Expected: what the line above claims. Actual: every check of it held.
No database evidence for this test (an offline check, or it did not run).
pass CF9 #9 HubSpot HANGS on the note → the confirmation reaches the lead within the normal time, while the CRM write is still open; the sweeper then finishes the CRM on the same key: 1 note, 1 confirmation, all ops done
pass What we did: CF9 #9 HubSpot HANGS on the note → the confirmation reaches the lead within the normal time, while the CRM write is still open; the sweeper then finishes the CRM on the same key: 1 note, 1 confirmation, all ops done
Expected: what the line above claims. Actual: every check of it held.
# CF9 pick → confirmation 2559 ms
- Lead
[image]
- Bot
These times are free: 1) Fri 20 Nov 08:00 Chicago 2) Fri 20 Nov 09:00 Chicago Reply 1 or 2 to book.
- Lead
1
- Bot
Booked: Fri 20 Nov 08:00 Chicago. Plumbing at ZIP 60614.
Alerts: none.
Tasks for a person: none.
| at | kind | status | tries | error |
|---|---|---|---|---|
| calendar.event | done | 1 | ||
| outbox.confirmation | done | 1 | ||
| crm.contact | done | 1 | ||
| crm.deal | done | 1 | ||
| crm.note | done | 2 |
| lead | status | step | mode |
|---|---|---|---|
| 15550100161 | booked | booked | bot |
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-f83a9561-3a67-436d-93bc-6525b636ad6c | 2 | {
"status": "test_held",
"recipient": "15550100161",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 20 Nov 08:00 Chicago\n2) Fri 20 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-f83a9561-3a67-436d-93bc-6525b636ad6c",
"offered_slots": [
{
"n": 1,
"end": "2026-11-20T15:00:00.000Z",
"lead": null,
"label": "Fri 20 Nov 08:00 Chicago",
"start": "2026-11-20T14:00:00.000Z",
"business": {
"date": "2026-11-20",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-20T16:00:00.000Z",
"lead": null,
"label": "Fri 20 Nov 09:00 Chicago",
"start": "2026-11-20T15:00:00.000Z",
"business": {
"date": "2026-11-20",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
} | ||
| outbox | SELECT outbox of wamid.TEST-86b074f8-30ae-4169-92dd-7cdb2f53da96 | 5 | {
"status": "test_held",
"recipient": "15550100161",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Fri 20 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-86b074f8-30ae-4169-92dd-7cdb2f53da96",
"offered_slots": null
} | ||
| crm | GET /crm/v4/objects/contacts/901383644394/associations/notes | 200 | 1 | {
"results": [
{
"toObjectId": 532734578897,
"associationTypes": [
{
"category": "[withheld: not a test object]",
"typeId": 201,
"label": null,
"fromObjectTypeId": null,
"toObjectTypeId": null
}
]
}
]
} | |
| outbox | SELECT outbox of 15550100161 | 1 | [
{
"status": "test_held",
"recipient": "15550100161",
"provider_message_id": null,
"kind": "free_form",
"text": "These times are free:\n1) Fri 20 Nov 08:00 Chicago\n2) Fri 20 Nov 09:00 Chicago\nReply 1 or 2 to book.",
"step": "awaiting_pick",
"event_id": "wamid.TEST-f83a9561-3a67-436d-93bc-6525b636ad6c",
"offered_slots": [
{
"n": 1,
"end": "2026-11-20T15:00:00.000Z",
"lead": null,
"label": "Fri 20 Nov 08:00 Chicago",
"start": "2026-11-20T14:00:00.000Z",
"business": {
"date": "2026-11-20",
"time": "08:00",
"zone": "America/Chicago"
}
},
{
"n": 2,
"end": "2026-11-20T16:00:00.000Z",
"lead": null,
"label": "Fri 20 Nov 09:00 Chicago",
"start": "2026-11-20T15:00:00.000Z",
"business": {
"date": "2026-11-20",
"time": "09:00",
"zone": "America/Chicago"
}
}
]
},
{
"status": "test_held",
"recipient": "15550100161",
"provider_message_id": null,
"kind": "free_form",
"text": "Booked: Fri 20 Nov 08:00 Chicago.\nPlumbing at ZIP 60614.",
"step": "booked",
"event_id": "wamid.TEST-86b074f8-30ae-4169-92dd-7cdb2f53da96",
"offered_slots": null
}
] |
pass CF10 #8 Google freeBusy HANGS at the offer → the lead gets the code's fallback reply within the normal time, with one human task and one alert
pass What we did: CF10 #8 Google freeBusy HANGS at the offer → the lead gets the code's fallback reply within the normal time, with one human task and one alert
Expected: what the line above claims. Actual: every check of it held.
# CF10 answer → reply 8954 ms
- Lead
[image]
Alerts: none.
Tasks for a person: none.
Operations (calendar, CRM, sends): none.
Lead state after the test: none.
| at | source | call | status | times | what it held |
|---|---|---|---|---|---|
| outbox | SELECT outbox of wamid.TEST-cb8aaf36-6ec3-4562-9f33-cb7d4c808e79 | 15 | {
"status": "test_held",
"recipient": "15550100171",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you. Our calendar is slow to answer right now; we will confirm a time shortly.",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-cb8aaf36-6ec3-4562-9f33-cb7d4c808e79",
"offered_slots": null
} | ||
| outbox | SELECT outbox of 15550100171 | 1 | [
{
"status": "test_held",
"recipient": "15550100171",
"provider_message_id": null,
"kind": "free_form",
"text": "Thank you. Our calendar is slow to answer right now; we will confirm a time shortly.",
"step": "awaiting_time_window",
"event_id": "wamid.TEST-cb8aaf36-6ec3-4562-9f33-cb7d4c808e79",
"offered_slots": null
}
] |
This run
→ · times in America/Chicago (UTC on hover) · 24 test files · node --import tsx --test --test-concurrency=1 --test-reporter=./report/console-reporter.mjs --test-reporter-destination=stdout --test-reporter=./report/results-reporter.mjs --test-reporter-destination=/dev/null test/harness/s1a.test.ts test/harness/s1b-logic.test.ts test/harness/s1b.test.ts test/harness/s1c-logic.test.ts test/harness/s1c.test.ts test/harness/s1d-logic.test.ts test/harness/s1d1.test.ts test/harness/s1d2.test.ts test/harness/s1d3.test.ts test/harness/s2a-logic.test.ts test/harness/s2a.test.ts test/harness/s2b-logic.test.ts test/harness/s2b.test.ts test/harness/s2c-logic.test.ts test/harness/s2c.test.ts test/harness/s2d-logic.test.ts test/harness/s2d.test.ts test/harness/s4a-logic.test.ts test/harness/s4a.test.ts test/harness/s4b-logic.test.ts test/harness/s4b.test.ts test/harness/s4b2-logic.test.ts test/harness/s4b2.test.ts test/harness/s4b3.test.ts
| what | version | read by |
|---|---|---|
| n8n | 2.43.4 | docker compose exec -T n8n n8n --version |
| n8n image | sha256:c34ee9107a42b837e25cec0c8a927ab90a45b776aa2ccbf15e5b9cda466fad2c | docker image inspect <the n8n container's image> --format {{json .RepoDigests}} |
| Postgres | 16.15 | psql -c 'SHOW server_version' |
| Node.js | v20.20.1 | process.version |
| writer model | claude-haiku-5-5 | runtime_config.anthropic_model |
| judge model | claude-sonnet-5-5 | GET /v1/models, newest id holding «sonnet» |
| git commit | fb37a8bb03d278b23938feb9bbdc244e080369e4 | git rev-parse HEAD |
Limits
- Voice, SMS and GoHighLevel are not built. Only WhatsApp (Meta Cloud API) and HubSpot are.
- n8n does not restart stuck work by itself; dedupe and recovery sit in Postgres, under unique keys and a sweeper.
- Alerts for real leads post to the buyer's Slack channel (one real delivery shown on 2026-10-22); during the test suite, alerts go to a local stand-in and are never sent.
- Case 5: a typed email is kept on the lead, not yet on the CRM contact.
- The «words at the pick change nothing» path is proven offline only.
- A date about 2 months ahead widens the calendar search; Google's range limit is untested.
- An ambiguous identity leaves that lead's thread with a person; the bot stays silent after it.
- A common two-word name can send real leads to a person.
- While a test sets the clock to a future date, a real reply waits until that date: never run a live try during the harness.
- Leftover test leads from earlier runs can get follow-ups when a later test moves the clock.
- A failed cancel of the old event (reschedule) hands the thread to a person and cancels that lead's still-queued confirmation.
- Harness runs push the business heartbeat into the future; a real gap alert waits until real time passes it.
- The tone judge is a model; it votes 3 times per reply and a split counts as a fail.
- The live harness runs ≈ 15 min, one case at a time (a shared test clock and calendar).
- 2026-10-22: the alert sender posted empty alerts to the owner's Slack every 10 s for 34 minutes; fixed by an idle guard in every scheduled workflow, each proven by a case that counts zero calls.
- In the previous run on the same code (2026-10-23 11:23Z), cases 8 and 17 each failed once; the cause is not proven (timing — a calendar left busy by an earlier run; a follow-up during an n8n restart). They passed in this run and alone.