Getting Clean Data OUT of CargoWise Is Harder Than Putting It In

Most eAdapter writing is about pushing data into CargoWise. Then someone asks for a revenue report, a visibility feed, or a migration export — and you discover the extraction side has its own trap list.

The extraction traps

Native XML queries don't paginate. A wide date range returns everything at once — several megabytes in one response — stalling both the transfer and your parser. Narrow every query (one month max, status filters) and cap the clock — past roughly 50MB, CW may silently truncate the response. When it does, your report is missing rows and nothing tells you.

Query endpoints need timeout budgets more than push endpoints. The 15-second budget on bulk queries in our production integration exists because an un-timeouted call hands your entire serverless wall-clock to CW's slowest day.

select('*') thinking doesn't work on CW responses. Job numbers live in ProcessingLog text that speaks three verbs (Updated, Added, and [Pending Change] Updating) — miss one and your extraction silently drops data.

Dates are in UTC — sometimes. Fields ending Utc (P9_ActualDateUtc) are UTC; fields ending Local or with no suffix may be in the creating user's local time. Convert at the presentation layer via IANA zones (never UTC offsets — they change with daylight saving), keyed off a UN/LOCODE→timezone lookup for port-based reporting. An arrival at 23:40 UTC is tomorrow in Dubai, and every date-grouped report crosses that line somewhere.

Charges contain things you didn't put there. CW's rating engine generates charges automatically — including the DOM-CWAF automation fee on every invoicing job. If you extract charges, you need a policy for lines your integration never created.

What Vol 3 covers

Data Extraction & Reporting — the third volume of the CargoWise eAdapter Series — is next in the series. It will cover query formats and their limits, mapper architecture with source-tracking columns, protecting extracted data from being overwritten, and building reporting pipelines that survive CW upgrades.

Own Vol 1 or Vol 2? Waitlist members get first access and early-bird pricing — and when Vol 3 ships, the bundle (all three volumes, Vol 1 free) goes live the same day. Join the Vol 3 waitlist →