Media Data Ingestion and BigQuery Integration for a Global Marketing Agency
DBB Software developed data ingestion pipelines for DV360, Google Ads, and GA4 and connected the agency's existing creative-analysis engine to BigQuery without changing its core logic.
Industry
Technology
Service
Digital Transformation
Team
1 Full-Stack Engineer
Project State
Jul 2026 - Ongoing
Country
Not disclosed
About the Client
The client is a global digital marketing agency. Its client portal brings the agency's analytics and AI products together on Google Cloud, with BigQuery as the data warehouse. One of the portal's apps is a creative analytics platform that scores video ad creatives, mostly for YouTube, and links each creative to its delivery data from Display & Video 360 (DV360) and Google Ads.
The Client’s Initial Request
The agency needed to connect its existing creative-analysis engine to BigQuery, replacing the separate platform data pulls it made for each engagement.
Advertising Data Ingestion
Bring DV360, Google Ads, and GA4 data into BigQuery, including video delivery metrics at creative, ad group, and day level.
01
Warehouse Data Validation
Ensure the creative-analysis engine produces equivalent results using warehouse data and direct advertising-platform data.
02
Account-Level Data Isolation
Keep each client's data separate using dedicated identities and least-privilege service accounts.
03
Solutions we delivered
Our engineer developed the data ingestion pipelines, connected the existing analysis engine to BigQuery, and validated its output against the source platforms.
DV360, Google Ads, and GA4 Ingestion
We built ingestion pipelines that bring advertising data into BigQuery according to the agency's data requirements.
DV360 and Google Ads provide video delivery metrics at creative, ad group, and day level, including impressions, clicks, cost, views, watch time, quartile completions, and conversions.
GA4 data is ingested as an additional analytics source.
Each client has a separate identity for data ingestion, with on-demand source verification. Dataform models transform the raw tables into a creative performance dataset.
Platform-Specific Data Handling
The ingestion pipelines account for differences in how DV360 and Google Ads report data.
Conversions, audiences, and conversion-action catalogs use separate tables because the platforms restrict certain field combinations.
DV360 returns different IDs when campaign filters are applied, requiring additional handling.
Quartile completions are reported as rates and converted into counts.
Conversion-Action Catalog
Our engineer changed the conversion-action catalog to use action IDs instead of names. Live data contained 662 actions but only 641 unique names, creating a risk of overwritten records.
BigQuery Integration for the Analysis Engine
We implemented a pluggable delivery source that allows the existing creative-analysis engine to retrieve advertising data from BigQuery without changing its core analysis logic.
Data Equivalence Testing
The equivalence test compared the engine's results using BigQuery against direct advertising-platform data from a real client account.
The test excluded the current day because Google Ads updates its reporting figures throughout the day.
Quartile counts showed rounding differences of a few units out of millions. Impressions, clicks, and cost matched exactly.
A final test blocked all advertising-platform API calls, confirming that the entire analysis could run using BigQuery data.
Zero-Delivery Creative Handling
We changed the query join so analyzed creatives with no delivery in the selected period stay in the analysis population. The existing grading logic did not change.
Results Achieved
37 of 37 facts matched
Warehouse results matched direct advertising-platform data, including exact figures for impressions, clicks, and cost.
Full analysis from BigQuery
The engine completed an end-to-end run with all direct advertising-platform API calls configured to fail.
3 data sources integrated
DV360, Google Ads, and GA4 feed the warehouse, with Dataform preparing the data for creative analysis.
Zero-delivery creatives retained
Analyzed creatives with no delivery in a period now count, so verdicts do not rest only on those that ran.
Put Your Ad and Analytics Data in One Warehouse
DBB Software builds ingestion into a data warehouse and moves existing analysis onto it, with the results checked against the source platforms.
Contact Us
"Most of our work starts with a 30-minute call where someone describes a product they're trying to ship and one part of the engineering picture they can't get around.
If that's where you are, let's set one up; I'll tell you straight whether we're the right fit.”
Mina Morkos
Business Development Manager
Want a similar outcome for your team?
Ask our AI assistant. It can pull related case studies, talk through the approach, and put you in touch with the team if you want a deeper conversation.