Competitor price monitoring: a practical guide for online retailers

· 3 min read · CrawlMine guides

What competitor price monitoring is for

Competitor price monitoring answers one question every morning: for the products that matter, what are competitors charging, and is it in stock? With that answer, a pricing team can match a cut where it matters, hold price where it leads and stop discounting the whole range out of caution.

This guide covers how to set it up so the data is trusted and used, not ignored after the first month.

Step 1: Choose the competitors that matter

Not every store is a competitor for every product. Start with the three to five stores your customers actually compare you with. Look at your own data: where do lost customers go? Which stores appear next to you in search results? Add marketplaces where your products are also sold.

Fewer, well-chosen competitors produce more useful data than a long list nobody reviews.

Step 2: Choose the products

Monitoring every product is rarely necessary. Most of the revenue and most of the price sensitivity sit in a smaller set: best sellers, products customers compare often, and key value items that shape how cheap you look. Start there and expand once the process works.

Step 3: Decide the fields

The minimum is price, list price, stock status and the time of collection. Most teams add:

  • Discount and promotion text
  • Delivery cost and delivery estimate
  • Seller, on marketplaces
  • Product URL, for checking

The e-commerce price monitoring page lists the full set we collect.

Step 4: Get product matching right

This is the step that makes or breaks the project. Each competitor names products differently. Some show barcodes such as EAN or GTIN; many do not. Pack sizes and bundles differ. A price comparison against the wrong product is worse than no comparison.

Good matching uses identifiers where available, falls back to brand, model and attributes, and reports a confidence score. Uncertain matches go to a person once, and the decision is reused on every later run. Our guide to product matching explains the method.

Step 5: Pick a schedule you will act on

Daily collection suits most retailers. Faster schedules cost more and only pay off if your pricing actually changes that often. Around big sale events, you may want several runs a day for a short list of products. Agree a baseline and a sale-season plan.

Step 6: Deliver into the tool you use

Data that lives in a separate portal gets checked less. Deliver it where your team already works: a spreadsheet, your BI tool, your repricing software or your warehouse. A daily CSV in cloud storage or an API are the common choices.

Step 7: Add a simple exceptions view

Nobody reads 20,000 rows. Pricing teams act on exceptions:

  • Products where a competitor is now cheaper than you
  • Competitor price drops above a threshold since yesterday
  • Competitor stock-outs on your best sellers
  • New promotions detected

A short daily list like this is what turns a feed into decisions.

Common pitfalls

  • Comparing different things. A bundle against a single item, or a 500 g pack against 1 kg. Fix it with matching and unit prices.
  • Ignoring delivery cost. A lower price with high shipping is not cheaper for the customer.
  • Location effects. Some stores price by region or pincode. Collect from the locations your customers are in. For instant delivery apps, see quick commerce price tracking.
  • Silent gaps. If a competitor’s site changes and the data stops, you need to know. Ask for monitoring and gap reporting.
  • Racing to the bottom. Monitoring is for informed decisions, not automatic matching of every cut.

Measuring success

Track how often pricing decisions use the data, how quickly you respond to competitor moves and how margin changes on monitored products. These matter more than how many rows arrive.

Start small

Begin with one category, three competitors and daily collection. Review the data with the pricing team for two weeks, then expand. If you want a sample on your own products, send us the stores and SKUs or email [email protected]. For marketplace listings specifically, see Amazon product data.

Talk to us directly

[email protected]

Send the websites and fields you need. A person on our team reads every message.

Email us

Send us the sites tonight. Data by morning.

Tell us which websites and fields you need. We confirm what is practical, how it should be delivered and what it costs.

  • Goes straight to [email protected]
  • Reply within one working day
  • A sample or pilot before any recurring plan
  • NDA available before you share details

[email protected]