A/B Testing & Change Analysis

Use HYPD to understand whether your optimizations actually worked.

Example Prompts

Check the changes made in the last 20 days. Did ROAS or profitability increase?

Compare performance before and after I paused that campaign.

What was the impact of switching to tROAS bidding?

Prompt:

Check changes made in the last 20 days. What were the results? We're optimizing towards pROAS.

HYPD Response: Analyzed 493 changes (Oct 18-27) vs. prior 10 days (Oct 8-17). Overall: NEGATIVE impact on profitability.

Metric	Before	After	Change
ROAS	2.81	2.37	-15.7%
Cost/Conversion	$18.71	$22.45	+20%
Revenue	—	—	-26.1%

Campaign	ROAS Change	Cost/Conv	What Happened
Search - DSA	1.83→1.48 (-19%)	+$54 (+183%)	481 aggressive keyword changes destroyed performance. Conv rate collapsed 3.31%→1.14%.
PMax - Tidy Titles	3.30→2.82 (-15%)	+$3.95	Conv rate dropped 6.07%→4.84%

Campaign	ROAS Change	Cost/Conv	What Happened
Shopping - Catchall	1.72→3.51 (+104%)	-$11.06	Conversion rate doubled

Analysis Type	Example
Before/after changes	”Impact of last week’s optimizations”
Time period comparison	”November vs October performance”
Bidding strategy changes	”tROAS vs Maximize Conversions results”
Campaign experiments	”How did the new ad copy perform?”

Specify the date range and what you changed: “I switched to tROAS on Nov 1. Compare the week before and after.”