With the release of BigQuery v2, the events that fail to be loaded to BigQuery are now written to the bad rows pubsub topic sp-rt-pipeline-bad-prod1
. Previously those failures where written to the failed inserts GCS bucket (e.g. sp-storage-loader-failed-inserts-prod1-com_acme
).
This change was made to consolidate all types of event failures into a single place. For a comprehensive overview of all the changes in BigQuery Loader 2.0.0, please refer to our upgrade guide here.