Documentation home/
Analytics and insights
/
Common Analyze Mistakes and Data Traps

Common Analyze Mistakes and Data Traps

The misreadings that lead to bad decisions, from treating bounce rate as a quality score to comparing numbers across tools.

Before you beginYou need Editor access to the CAS.org site. Anything published to the live site is reviewed by the web team first.

Most bad analytics decisions come from reading a real number the wrong way. These are the traps worth knowing before the numbers reach a slide.

Treating Bounce Rate as a Quality Score

A bounce means the visitor left without clicking or moving to another page. On a page whose job is to answer one question, that can be a success. On a solution page whose job is to drive a demo request, it is a problem.

Instead: judge bounce rate against what the page is for, and watch its trend rather than its absolute value.

Reading Signals Into Small Numbers

A page with 30 sessions in a week will produce dramatic percentages that mean nothing. One visitor is 3 percent of that sample.

Instead: widen the date range on low traffic pages, and treat differences under roughly 10 percent on small samples as noise.

Assuming a Change Caused a Result

Traffic and conversion move for reasons that have nothing to do with the site: a conference, a campaign, a holiday, a competitor announcement, or a search algorithm update.

Instead: change one thing at a time, write down the expected result first, and check whether anything external moved in the same window.

Comparing Numbers Across Tools

Analytics tools count sessions, visitors, and bounces differently, so their totals will not match. Discrepancies between Analyze and another tool are expected.

Instead: pick one tool as the source for each metric and stay with it. Report the trend rather than defending the absolute number. Raise a gap large enough to change a decision with a Web Developer.

Comparing Unequal Date Ranges

Seven days against 30 days is not a comparison, and a range ending today includes a partial day that drags the last point down.

Instead: match the length and the days of the week. See Date Ranges, Filters, and Data Limits.

Forgetting the Device Split

A page can look healthy on the all-devices view while failing on mobile, because desktop traffic carries the average.

Instead: check the device split before making any judgment about a layout.

Concluding a Page Is Unpopular Because It Is Not Listed

The Pages list holds up to 150 pages. On a site the size of CAS.org, absence from that list says very little.

Instead: open the page in Analyze Mode to see its actual numbers.

Trusting a Goal That Has Not Been Checked

Goals are attached to specific elements. A rebuild can break a goal without any warning, and a broken goal reports zero rather than an error.

Instead: confirm every goal is still reporting as part of the monthly review.

Reading a Clickmap as an Explanation

A clickmap shows what visitors did, not why. Heavy clicking on one element can mean it is compelling or that it is the only thing that looks clickable.

Instead: pair the clickmap with previous and next pages, then form a hypothesis and test it.

Including Staging Traffic

Internal work on staging domains can inflate results if the staging option is switched on and left on.

Instead: confirm the setting is off before reporting. See How Analyze Tracking Is Configured on CAS.org.

Was this guide helpful?YesNo