Why marketing mix modeling is still hard to get right

Why marketing mix modeling is still hard to get right

Marketing mix modeling (MMM) is becoming more accessible, but getting started remains a challenge.

After several conversations about MMM adoption, I noticed the same question kept coming up: “We believe in the concept of MMM, but we don’t know how to get started.”

The answer is that viable open-source platforms have dramatically lowered the barrier to entry. They haven’t lowered the level of expertise required to produce trustworthy, actionable results.

Open-source MMM has changed the starting point

The floor dropped

MMM adoption is accelerating. Almost half (46.9%) of U.S. marketers will invest more in MMM over the next year, and they ranked MMM as the most reliable measurement methodology (27.6%).

The open-source revolution in MMM is real. Three production-grade libraries now cover the full methodological spectrum:

  • Robyn (Meta, R): Automated hyperparameter search via Nevergrad, Pareto frontier model selection, and built-in decomposition and response curve plots — the most approachable entry point. It’s the one I use most because it’s highly customizable.
  • Meridian (Google, Python/TensorFlow): Bayesian inference with geo-level priors and principled uncertainty quantification — more rigorous, with a steeper learning curve.
  • PyMC-Marketing (PyMC Labs, Python): The most flexible option, offering a full probabilistic model that’s closest to academic-grade Bayesian MMM — but it also requires the most statistical fluency.
3 open-source MM libraries and one spectrum

This generation of tools has eliminated the $150,000 to $500,000 consulting gate that used to be the only path into MMM. Any team with R or Python expertise and relatively clean historical data can now run a model in-house.

The key caveat worth making explicit in any conversation with those exploring MMM is this: “Free tool” doesn’t mean “free model.” The software is free. The domain expertise required to configure it correctly — a hugely important part of the process — isn’t.

See exactly how your competitors win.

Uncover the keywords, ads, landing pages, and strategies driving your competitors’ paid search success—and find your next opportunity to outperform them.

Analyze your competitors

A crowded vendor landscape with an interesting power dynamic

The SaaS layer built on top of open-source MMM has proliferated quickly. It’s worth distinguishing a few tiers.

Data-layer-first vendors

Platforms like Rockerbox and Northbeam started as attribution and data collection platforms, then added MMM. Their edge is data pipelines and speed, not modeling depth or customization.

Measurement-first vendors

Platforms like Measured, Analytic Partners, Ekimetrics, and Nielsen Gracenote offer more rigorous modeling at a higher price point, with enterprise-grade capabilities.

Google Meridian and GA360

One point is worth calling out. Google’s open-sourcing of Meridian was a generous contribution to the field and, at the same time, a strategic one. When a walled garden funds and packages the measurement methodology used to evaluate its own channels, it’s worth maintaining healthy skepticism about model priors and default assumptions, even with transparent code.

The practical question when evaluating vendors is: who owns your data layer, and does that create conflicts in the modeling layer?

Challenge 1: Data access is the silent MMM killer

This is the most underappreciated implementation blocker, and it rarely gets the attention it deserves. A well-specified MMM needs:

  • Two to three years of weekly data as a baseline — enough to capture at least two full seasonality cycles and a meaningful range of spend variation.
  • Consistent channel-level spend granularity — not just “digital,” but search, social, display, and video broken out separately.
  • Offline channels (TV, OOH, radio, events, direct mail — which typically live in different systems) are owned by different teams, and often use incompatible time granularities.
  • External covariates — macro indicators, competitor activity, pricing data, and product launch calendars.
  • For B2B specifically, longer sales cycles and lower conversion volumes make the data requirements even more demanding. You often need more history.

In practice, what blocks most MMM projects is the six-week data archaeology exercise that comes before model building. Finance owns revenue. The brand team owns TV. The agency owns digital spend. The spreadsheet someone built in 2021 is the only record of trade promotions.

The model is only as good as the data archaeology that precedes it, and nobody tells you that in the vendor demo.

Get the newsletter search marketers rely on.


Challenge 2: You still need to roll up your sleeves

AI assistants have meaningfully lowered the syntax barrier. They can scaffold a Robyn run, generate a Meridian config, or help debug a PyMC model. What they can’t yet do is navigate the judgment calls that make an MMM trustworthy:

  • Choose where to sit on a Pareto frontier of hundreds of model solutions (NRMSE vs. DECOMP.RSSD tradeoffs).
  • Know when Nevergrad’s optimizer has meaningfully converged versus landed in a local minimum.
  • Configure adstock transformation parameters (Weibull shape/scale, geometric decay) to match realistic channel dynamics.
  • Diagnose why a model assigns an implausible contribution to a channel, and whether to address it with a prior, a data correction, or a variable exclusion.

In other words, vibe coding your way to an MMM will produce a model that appears to work but is wrong in ways you won’t catch. The scripting isn’t the hard part. The domain expertise required to validate the output includes running channel-specific incrementality experiments to calibrate your MMM.

Challenge 3: The human expertise layer isn’t optional

Even when the tooling matures to the point where AI can run a competent default MMM, the irreplaceable human contribution is encoding business context — things no model can infer from the data alone:

  • Adstock and carryover context: Your TV buy has a four-week carryover. Your paid search has a three-day carryover. Your branded awareness campaign has a decay that spans months. This information isn’t found in the data. It’s in the minds of the channel experts.
  • Saturation curve shape: Knowing a channel is likely approaching diminishing returns before the model tells you so, and questioning the results when the model suggests otherwise.
  • Guardrails and anomaly handling: Factors like COVID troughs, product launches, pricing shifts, and macro disruptions need to be modeled explicitly or flagged as structural breaks. AI doesn’t know your client had a pricing crisis in Q3 2022.
  • Interpretation sanity checks: A modeled TV contribution of 40% for a brand spending $2 million on TV may “feel wrong” and warrant investigation. That intuition is earned, not computed.
  • Organizational translation: The most technically correct model is worthless if you can’t explain why it recommends shifting 15% of the search budget to CTV in terms a CMO and CFO will act on.

Lay the groundwork before you build a model

The best place to begin is understanding what data you need to fuel the model and who needs to help contextualize and translate that data into effective marketing decisions. Neither is easy or fast, but both are essential if you want to get meaningful insights from your model, regardless of whether you choose an open-source or subscription-based platform.

A practical first step is to download Robyn’s demo script and experiment with the sample data before applying it to your own.

https://searchengineland.com/marketing-mix-modeling-get-right-481849