Loading failed events into a warehouse or lake

Nick Stanchenko  
Edited

[27-Jan-2025] 

Failed events are events that Snowplow pipeline had some problem processing (for example, events that did not pass validation). It’s important to review failed events to understand and fix tracking issues. Until recently, however, accessing failed events has been non-trivial.

Starting today, for the common failures (validation and enrichment), you can configure continuous loading of any offending events into a separate table in your warehouse or lake. This way, you can easily inspect them and decide how they might be patched up (e.g. with SQL) and merged with the rest of your data.

This feature currently (January 2025) works with Snowflake Streaming and Lake Loaders, with more loaders to be added later.

You can find more details on the data format and setup instructions in our documentation.