Coverage
Every source we read, when we last read it, and what it gave us. A site that blocks us is recorded and left alone.
- sources set up
- 1,113
- gave adverts on their last read
- 1,034
- marketplaces left alone
- 15
- public datasets joined
- 8
Every source
- 365 Car Sales21 of 21
- 5th Street Automotive2 of 2
- A1 Motors21 of 21
- AC Cars161 of 161
- Adelaide BMWnothing on this read
- Adelaide Chery12 of 12
- Adelaide City Kianothing on this read
- Adelaide Vehicle Centre21 of 21
- Adrian Brien Renault - New Inventory300 of 627
- affordableautosnothing on this read
- Agostino GWM2 of 2
- Albany Toyota21 of 21
- Alice Springs Toyotanothing on this read
- allroundmotors21 of 21
- Alto Groupnothing on this read
- altousmotors139 of 139
- alwaysmovingmotors31 of 31
- AMR Used Carsnothing on this read
- Anthony Motorsnothing on this read
- anthonymotorsales21 of 21
- arrowcarsalesnothing on this read
- Ashmore Used Cars24 of 24
- Aspley Mazda, Aspley21 of 21
- assuredcars36 of 36
- atlascardealer33 of 33
- Australian Automotive Groupnothing on this read
- Australian Car Sales Group109 of 109
- Ausvehicle Sales21 of 21
- Auto Car Wholesalenothing on this read
- Auto Classic, Victoria Parknothing on this read
- Auto Cornernothing on this read
- Auto Credit Cars20 of 20
- Auto Home38 of 38
- Auto Jungle21 of 21
- Auto Market130 of 344
- Auto Sales @ Redcliffenothing on this read
- autobargaincenter68 of 68
- autocarcentre11 of 11
- autoloversaustralia44 of 44
- automallmtgravatt396 of 396
- Autopactnothing on this read
- Autopact Performance24 of 24
Merged into Autopact.
- Autosales Australia21 of 21
- autosellers20 of 20
- Autosports Groupnothing on this read
Not read now: surveyed and withdrawn 2026-08-12: answers HTTP 504 to every request, on two probes hours apart. A server fault rather t…
- Autotrader AU2,965 of 26,709
- autoxchangewa46 of 46
- awesomeautosprestige95 of 95
- B & B Autosnothing on this read
- Ballarat Peugeot12 of 12
- Ballarat Toyota, Ballarat VIC107 of 107
- Ballina Toyota, Ballinanothing on this read
- barossaautogroup21 of 21
- barossachery21 of 21
- barossaford49 of 49
- barossakia21 of 21
- Barry Bourke21 of 21
- Bartons Bayside MG21 of 21
- Bartons Capalaba GWM200 of 268
Merged into Capalaba GWM.
- Bartons Capalaba Hyundai21 of 21
- Bartons Capalaba Nissan21 of 21
- Bartons Capalaba Subaru21 of 21
- Bartons Chery21 of 21
- Bartons GAC Baysidenothing on this read
- Bartons GWM Haval200 of 268
Merged into Capalaba GWM.
- Bartons LDV21 of 21
- Bartons MG21 of 21
- Bartons Mitsubishi21 of 21
- Bartons Motor Group21 of 21
- Bartons New Energy Vehicles21 of 21
- Bartons Peugeot Professional21 of 21
- Bartons Subaru149 of 149
Merged into Bartons Capalaba Subaru.
- Bartons Wynnum GWM200 of 374
Merged into Wynnum GWM.
- Bartons Wynnum Hyundai21 of 21
- Bartons Wynnum Nissan21 of 21
- Bartons Wynnum Renault21 of 21
- Bartons Wynnum Subaru21 of 21
- Batemans Bay MG10 of 10
- Batemans Bay Toyota21 of 21
- Bathurst GWM Haval21 of 21
- Bathurst Holden21 of 21
- Bathurst Hyundai21 of 21
- Bathurst Isuzu UTE12 of 12
- Bathurst Kia12 of 12
- Bathurst Mazda8 of 8
- Bathurst MG69 of 69
- Bathurst Mitsubishi12 of 12
- Bathurst Nissan21 of 21
- Bathurst RAM67 of 67
- Bathurst Subaru21 of 21
- Bathurst Toyota21 of 21
- bathurstmotorgroup173 of 173
- Bayfordnothing on this read
- Bayside Brothers Motorsnothing on this read
- BDK Automotive18 of 18
- Bega Valley Automotive12 of 12
- Bellbowrie Motors21 of 21
- Bendigo Isuzu UTE12 of 12
- Bendigo Kia12 of 12
- Bendigo Mazdanothing on this read
- Bendigo RAM12 of 12
- Bendigo Toyota21 of 21
- bendigofordnothing on this read
- bendigogwmhavalnothing on this read
- bendigonissannothing on this read
- bendigosuzukinothing on this read
- bendigovolkswagennothing on this read
- Berri Hyundai21 of 21
- Berwick BMWnothing on this read
- Berwick Hyundai21 of 21
- Berwick LDV12 of 12
Not read now: verified 2026-08-12 (sweep 7, suburb+marque): robots.txt fetched, inventory path permitted, platform fingerprint confirm…
- Berwick Mazda21 of 21
- Berwick MG21 of 21
- Berwick Renaultnothing on this read
Not read now: verified by probe-candidates: robots.txt fetched, inventory path permitted, platform fingerprint confirmed, a priced veh…
- Berwick Toyota509 of 513
- Berwick Volkswagen12 of 12
- berwickford21 of 21
- Blackburn Kianothing on this read
- blacklocksfordnothing on this read
- Blacktown Chery12 of 12
- Blacktown Hyundai21 of 21
- Blue Chip Auto65 of 65
- BMH Auto Group (Bunbury)21 of 21
- Booran Motors21 of 21
- Braddon Auto Mart43 of 43
- Bremer Ford21 of 21
- Bressington Prestige21 of 21
- Brighton Alfa Romeo6 of 6
Not read now: verified 2026-08-12 (sweep 6, network siblings): robots.txt fetched, inventory path permitted, platform fingerprint conf…
- Brighton Auto21 of 21
- Brighton BMWnothing on this read
- Brighton Ford12 of 12
- Brighton Hyundai21 of 21
- Brighton Jeep21 of 21
- Brighton KGM21 of 21
- Brighton Mazda197 of 197
- Brighton MG21 of 21
- Brighton Mitsubishi21 of 21
- Brighton RAMnothing on this read
Not read now: verified 2026-08-12 (sweep 6, network siblings): robots.txt fetched, inventory path permitted, platform fingerprint conf…
- Brighton SsangYong119 of 119
Merged into Brighton KGM.
- Brighton Toyota21 of 21
- Brisbane BMWnothing on this read
- Brisbane Car Yard21 of 21
- Brisbane Cars21 of 21
- Brisbane City Chery12 of 12
- Brisbane Wholesale Vehicles21 of 21
- Brisbane's Downtown Toyota21 of 21
- Brookvale Mazda12 of 12
- Brookvale Mitsubishinothing on this read
A row is one pass, not the yard’s size: an index pass every two hours reads the top of each yard, and a deep pass twice a day walks it. The dealer’s own page carries its live count.
Surveyed and left alone
Marketplaces that refuse an honest crawler are recorded with their reason and asked again every Monday, exactly as the crawler would ask. A block is never worked around.
- Audi Centre dealer networkOut of scope directly. Probed 2026-08-11: audicentresydney, audicentremelbourne, audicentrebrisbane and audicentredoncaster all answer HTTP 400 to robots.txt and to every inventory path — the server rejects an ordinary request. No circumvention attempted. Their stock is reachable legitimately through dealer:autosportsgroup, which owns several of them.Asked again 12 Oct: HTTP 403 to the honest user agent; still blocked
- carsales.com.auDataDome challenge on all listing fetches (403). robots.txt itself allows clean /cars/ paths for * with Crawl-delay 2, but WAF blocks in practice. Out of scope pending a licensed feed (survey 2026-08-10).Asked again 12 Oct: DataDome challenge (HTTP 403); still blocked
- DriveCloudflare managed challenge site-wide including robots.txt. Out of scope (survey 2026-08-10).Asked again 12 Oct: Cloudflare challenge (HTTP 403); still blocked
- easyauto123robots fully open, no WAF challenge observed (survey 2026-08-10). Extractor not yet built. Probe 2026-08-11: robots allows and the page returns HTTP 200, but /buy/used-cars is client-rendered (Next flight payload, zero ld+json, no make/price/vin keys in HTML) — no server-side stock for our extractors. Out of scope pending an official feed; not worth JS rendering. Re-probed 2026-08-11: inventory paths answer HTTP 404 while returning 180KB–740KB of markup — a soft 404 from a client-rendered app, so there is nothing in the HTML to parse. Not blocked, just not served server-side. Would need its JSON API identified, which is a separate piece of work. | 2026-08-15 sized: inventory page answers 200 and no existing extractor recognises it, and scanHost finds no listing URLs (easyauto123 publishes no usable sitemap; suttons has sitemap.xml but it lists no vehicles). Enabling needs a new extractor AND pagination-based discovery, not a config change. Do not re-probe expecting a quick win. | Re-probed 2026-09-05 for an extractor: the used-car grid is fetched by the page's own JavaScript through a Next.js server action (a POST to the page URL keyed by an action id inside the bundle), not through any public URL; /api/inventory/agg answers only aggregations (2,059 cars, every stock number) and /api/inventory/stats only per-car view counts; the sitemap robots.txt names answers 404; no detail URL shape could be found for a stock number. Replaying the app's internal action protocol is not a public read path, so no extractor was built. Left out of scope.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 553 KB of markup; whether it is in scope is a decision for a person, not this script
- Grays (auctions)surveyed 2026-08-11: robots.txt disallows the vehicle category. Respected — out of scope.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 389 KB of markup; whether it is in scope is a decision for a person, not this script
- Gumtree AUPeakhour WAF 403s everything including robots.txt. Out of scope (survey 2026-08-10).Asked again 12 Oct: HTTP 403 to the honest user agent; still blocked
- Hyundai Australiasurveyed 2026-08-11: robots.txt permits crawling, but the site publishes no used-vehicle inventory page — new-model brochures only.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 119 KB of markup; whether it is in scope is a decision for a person, not this script
- Lexus Australia (national used locator)surveyed 2026-08-11: robots.txt disallows the used-vehicle search path. Respected — out of scope.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 761 KB of markup; whether it is in scope is a decision for a person, not this script
- Lexus dealer networkOut of scope. Probed 2026-08-11: every dealer site tested — Sydney City, Parramatta, Brisbane, Perth — serves robots.txt at 200 but returns a Cloudflare "Just a moment" challenge (403) on its inventory pages. lexus.com.au's own sitemap.xml does the same. Recorded and left alone; no circumvention attempted.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 761 KB of markup; whether it is in scope is a decision for a person, not this script
- Manheim Australia (auctions)surveyed 2026-08-11: returns HTTP 403 to the honest UA on robots.txt and every inventory path. Not circumvented — out of scope.Asked again 12 Oct: HTTP 403 to the honest user agent; still blocked
- MG Motor Australiasurveyed 2026-08-11: robots.txt permits crawling, but the site publishes no used-vehicle inventory page — new-model brochures only.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 354 KB of markup; whether it is in scope is a decision for a person, not this script
- Peter Warren Automotiverobots Allow: /, no challenge observed (survey 2026-08-10). Extractor not yet built. Superseded 2026-08-11: confirmed as a Dealer Studio site and re-seeded as dealer:peterwarren, which is crawlable. | 2026-08-15: duplicate of dealer:peterwarren, same host, which is enabled on dealer-studio with 1,689 live listings. Marked merged so it is not re-seeded as a separate yard.
- Subaru Australia (national used locator)surveyed 2026-08-11: robots.txt disallows the used-vehicle search path. Respected — out of scope.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 335 KB of markup; whether it is in scope is a decision for a person, not this script
- Suttonsrobots fully open (survey 2026-08-10). Extractor not yet built. Re-probed 2026-08-11: inventory paths answer HTTP 404 while returning 180KB–740KB of markup — a soft 404 from a client-rendered app, so there is nothing in the HTML to parse. Not blocked, just not served server-side. Would need its JSON API identified, which is a separate piece of work. | 2026-08-15 sized: inventory page answers 200 and no existing extractor recognises it, and scanHost finds no listing URLs (easyauto123 publishes no usable sitemap; suttons has sitemap.xml but it lists no vehicles). Enabling needs a new extractor AND pagination-based discovery, not a config change. Do not re-probe expecting a quick win. | Re-probed 2026-09-05 for an extractor: /inventory/cars is a shell; the cards are painted in by a POST to /inventory/cars/filter carrying an Elasticsearch query the page builds, and every shape of that request tried from the honest user agent answered HTTP 500 (seven variants, with and without the page's headers). The sitemap lists no vehicles. No public GET path serves the stock, so no extractor was built. Left out of scope.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 936 KB of markup; whether it is in scope is a decision for a person, not this script
- Toyota Australia (national used locator)surveyed 2026-08-11: robots.txt served, but every inventory path returns a bot-detection interstitial. Not circumvented — out of scope.Asked again 12 Oct: answers HTTP 200 to the honest user agent, 394 KB of markup; whether it is in scope is a decision for a person, not this script
Public datasets
- ABS ASGS Ed 3 Postal Areas 2021 (centroids)joined
- ABS regional statistics (POA)joined
- ANCAP safety ratingsjoined
- BITRE Road Vehicles Australiajoined
- FCAI new vehicle sales (topline)joined
- FuelWatch WAjoined
- Green Vehicle Guidejoined
- Australian public holidaysrecorded, not yet joined
- RBA cash rate + ABS CPIjoined
- Vehicle recalls (vehiclerecalls.gov.au)recorded, not yet joined