Automated Emails sometimes missing inventory images

Incident Report for Orbee

Update

We are continuing to monitor the image queue as it catches up to real-time ingestion. Given the fact that images are hosted on third-party systems before being downloaded to Orbee's CDN, we need to pull these "politely" with proper timing between requests and have pushed the speed at which images can be processed to close to those third-party systems' limits. Therefore we expect the queue to be fully caught up in the next 24 hours.

We'll provide an update tomorrow regarding the wrap-up of the image queue. Currently, images are already being processed same-day for new vehicles ingested into Orbee's Platform.
Posted Mar 29, 2025 - 13:48 PDT

Update

We are continuing to monitor the image queue as it gets back to normal. Vehicle images are largely back up and working but we will continue to monitor while new inventory vehicles come through, to make sure the queue maintains its throughput and stays up-to-date.
Posted Mar 28, 2025 - 09:18 PDT

Monitoring

A hotfix has been implemented in the meantime and we do see images showing up again for many vehicles. We will continue to monitor the situation as the rest of the image processing queue finishes processing.
Posted Mar 27, 2025 - 11:15 PDT

Identified

We have identified that the inventory image download queue is currently lagging. Therefore, this issue only affects vehicles made available in the dealer's inventory feed within the past 72 hours that are already being marketed to customers in automated emails.

We have already increased the amount of processing we support for this queue, and will continue to monitor the situation and identify why the queue fell behind. We'll provide another update on the progress of getting this image download queue back under control.
Posted Mar 27, 2025 - 09:24 PDT

Investigating

We are currently investigating an issue experienced by some customers intermittently, where automated emails going out can sometimes be missing vehicle images when referencing their ingested inventory. We will provide an update once a cause for this issue has been identified.
Posted Mar 27, 2025 - 08:58 PDT
This incident affects: Email Marketing.