If you sell on Shopify, some of your most useful market data sits on your competitors' stores: what they charge, when they mark things down, and which sizes keep selling out. The problem is that it lives on product pages. To see that a shoe is out of stock in size 14 you have to open the page and click through every size, and to notice a price change you have to remember yesterday's price.
Shopify's own APIs don't help here. The Admin API and the Storefront API both need an access token that the store owner creates, so they only work for stores you run.
There is a simpler source. Most Shopify stores publish their catalog as JSON at /products.json. Open https://www.allbirds.com/products.json?limit=1 in a browser and you'll see one product with all of its variants. You could write a script around that yourself. This tutorial uses an Apify Actor that already does the paging, turns every size and color into its own row, adds the store's currency, and runs on a schedule, so the interesting part is the comparison.
Disclosure: I built and maintain this Actor. It is a paid tool ($0.50 per 1,000 results). I've tried to describe what it can't do as plainly as what it can.
What you can do with the data
- See price changes the morning after. Compare today's run with yesterday's and list every variant whose price or compare-at price moved.
- Track sell-outs and restocks by size. Each variant has an
isAvailableflag, so you can see which sizes or colors a competitor runs out of first. - Spot new products and removed ones. Variants that appear or disappear between two runs are new arrivals or discontinued items.
- Watch discounts. In Product mode,
maxDiscountPercentgives the biggest markdown on each product, so a sale across a whole collection is easy to see.
Step 1: Set up a run in Apify Console
Open Shopify Products Scraper and click Try for free. These are the fields that matter for price tracking:
| Field | What it does |
|---|---|
Store URLs (storeUrls) | A store (allbirds.com), a collection (https://www.allbirds.com/collections/mens) or a single product link. One per line. |
One result per (outputMode) | products (default) gives one row per product with a variants list. variants gives one row per size or color, which is what you want in a spreadsheet. |
Max results (maxItems) | Upper limit for the whole run. Leave it empty for scheduled tracking, so every variant is in every run. |
Max results per store (maxProductsPerStore) | Stops one big store from using up the run when you track several. |
| Keywords / Exclude title keywords | Keep products that mention a word, or skip ones like "gift card". |
In stock only / On sale only (availableOnly, onSaleOnly) | Keep only in-stock or reduced items. In Variant mode they apply to each size and color. |
Min price / Max price (minPrice, maxPrice) | Price range in the store's currency. |
Published within (days) (publishedWithinDays) | New arrivals only. |
Include description (includeDescription) | On by default. Turn it off for tracking runs; you don't need the text every day. |
No login, API key or proxy is needed. Filters run before you're charged, so you only pay for rows that match.
Step 2: Run it and export
Click Start, and when the run finishes, open the Output tab and export as JSON, CSV or Excel.
For this article I ran the Allbirds men's collection in Variant mode with maxItems: 30:
{ "storeUrls": ["https://www.allbirds.com/collections/mens"], "outputMode": "variants", "maxItems": 30 } It saved 30 rows in about 5 seconds. Here is one, with the image list, tags and description removed to keep it short (values unchanged):
{ "storeName": "Allbirds", "storeUrl": "https://www.allbirds.com", "currency": "USD", "productId": 7199602016336, "handle": "mens-wool-cruiser", "title": "Men's Wool Cruiser - Natural Grey (Natural White Sole)", "vendor": "Allbirds", "productType": "Shoes", "url": "https://www.allbirds.com/products/mens-wool-cruiser", "publishedAt": "2026-09-25T22:55:10Z", "createdAt": "2025-07-23T20:05:56Z", "updatedAt": "2026-11-02T13:26:05Z", "variantId": 41243415609424, "variantTitle": "8", "sku": "A11723M080", "price": 105, "compareAtPrice": null, "isAvailable": true, "option1Name": "Size", "option1": "8", "option2Name": null, "option2": null, "weightGrams": 685, "isOnSale": false, "scrapedAt": "2026-11-02T13:26:05Z" } Thirty rows only covered three colorways of one shoe, because each colorway has up to 14 sizes. All 30 were priced at $105 with no compare-at price, but 9 of the 30 were out of stock: sizes 13.5, 14 and 15 in two colors, sizes 8 and 8.5 in Light Grey, and size 8 in Natural Black. That kind of detail is invisible on a collection page, which only tells you whether a product is available at all.
Two notes on the fields. Option columns always have fixed names (option1Name/option1 up to option3), so exports from different stores line up even when one store calls it "Size" and another "Shoe size". And don't rely on updatedAt to detect changes: in my run it matched the scrape time for every product, because Allbirds updates its products all the time. Comparing two runs is more reliable.
Step 3: Schedule it and compare runs in Python
In Apify Console, save your input as a task (the Save as a new task option on the Actor's input page), then add a schedule for it, for example every morning at 7:00. Each run keeps its own dataset, so the history builds up by itself.
Install the client and pandas:
pip install apify-client pandas A one-off run from Python looks like this:
from apify_client import ApifyClient import pandas as pd client = ApifyClient("YOUR_APIFY_TOKEN") run = client.actor("pipiagent/shopify-products-scraper").call(run_input={ "storeUrls": ["https://www.allbirds.com/collections/mens"], "outputMode": "variants", "includeDescription": False, }) df = pd.DataFrame(client.dataset(run.default_dataset_id).iterate_items()) # How much of each product is in stock right now stock = (df.groupby("title") .agg(variants=("variantId", "size"), in_stock=("isAvailable", "sum"), price=("price", "max")) .assign(stock_rate=lambda t: (t["in_stock"] / t["variants"]).round(2)) .sort_values("stock_rate")) print(stock.head(10)) Once the schedule has run twice, compare the two latest runs of your task. Replace the task ID with your own (Console shows it as username~task-name):
TASK = "your-username~allbirds-mens-daily" COLS = ["variantId", "title", "variantTitle", "sku", "price", "compareAtPrice", "isAvailable", "url"] runs = client.task(TASK).runs().list(status="SUCCEEDED", desc=True, limit=2).items new_run, old_run = runs[0], runs[1] def load(run): items = client.dataset(run.default_dataset_id).iterate_items() return pd.DataFrame(items)[COLS].set_index("variantId") new, old = load(new_run), load(old_run) both = old.merge(new, left_index=True, right_index=True, suffixes=("_old", "_new")) price_changed = both[(both["price_old"] != both["price_new"]) | (both["compareAtPrice_old"].fillna(0) != both["compareAtPrice_new"].fillna(0))] sold_out = both[both["isAvailable_old"].eq(True) & both["isAvailable_new"].eq(False)] restocked = both[both["isAvailable_old"].eq(False) & both["isAvailable_new"].eq(True)] added = new.loc[new.index.difference(old.index)] removed = old.loc[old.index.difference(new.index)] print(price_changed[["title_new", "variantTitle_new", "price_old", "price_new"]]) print(f"{len(sold_out)} sold out, {len(restocked)} restocked, " f"{len(added)} new variants, {len(removed)} removed") The variant ID is stable across runs, so it is the right key to join on. If you track several stores in one task, add storeName to COLS so you can group the changes by store.
What it costs
You pay per saved result: $0.50 per 1,000 results. In Variant mode one result is one variant, so a shoe with 14 sizes is 14 results. There is no start fee and no monthly rental.
- My 30-variant test: $0.015.
- A collection with 500 variants, checked once: $0.25.
- The same 500 variants every day for 30 days (15,000 rows): $7.50.
Product mode is cheaper for broad monitoring, since one product row carries all its variants in a list. You can also set a maximum charge per run in the run options, and the Actor stops when it reaches that amount.
Limitations
- Shopify stores only. The Actor reads the public
/products.jsonlist. Sites on other platforms, password-protected stores and a few stores with custom storefronts that turn the list off are reported in the log and skipped. - Stock is a yes/no flag. Shopify's public list says whether a variant can be bought, not how many units are left.
- Prices are in the store's main currency, without taxes. Prices shown to visitors from other countries are not included.
- Only published products. Drafts and products hidden from the online store are not visible.
- No store discovery. You need to know which stores to track; the Actor doesn't find Shopify stores for you.
Related tools
If you also want to know what a product costs at the source, Alibaba Search Scraper exports wholesale prices, quantity price tiers and minimum orders. AliExpress Search Scraper shows what similar products sell for at retail, with units sold and ratings.
You can try the variant workflow on any store from the Shopify Products Scraper store page. If something doesn't work the way this article says, open an issue there and I'll look into it.

