← Back to artemrivnyi.com
Production Case Study

UA-IE Car Scout: Cross-Border Market Intelligence & Real-Time Tax Clearance Engine

By Artem Rivnyi • Data Engineering & SRE • October 2026 • Reference: ua-ie-car-scout ↗
Status: Production Live
Cache Hit SLA: <240ms
Portals Synced: 6 Marketplaces
Tax Precision: Irish Revenue VRT • 100%
Automated Tests: 172 Passing

Importing a motor vehicle across European borders requires evaluating intricate financial formulas: market price differences, currency exchange fluctuations, customs clearance duties, shipping logistics, and statutory registration taxes (such as Ireland's Vehicle Registration Tax & VAT).

Buyers and commercial dealerships typically lose days manually sifting through disjointed portals across different languages and currencies. UA-IE Car Scout was engineered to solve this through a distributed real-time meta-search engine and tax calculation engine, aggregating listings from 6 major automotive marketplaces across Ukraine and Ireland.

1. Architectural Blueprint

The system is built as a modular monorepo combining a high-performance React frontend with an Express scraper service, resilient Redis cache, and live banking exchange rate sync:

Distributed Multi-Tier Meta-Search Pipeline 6 Portals Synced
Pipeline Telemetry: Standby • Click "Simulate Live Flow" to trace search orchestration
React 18 / Vite SPA Client
User Parameterized Query
Express Ingestion & Redis Cache
TTL: 1h • <240ms Cache Hit
Cheerio Fast HTTP Static Portals

Sub-150ms lightweight extraction for static classifieds (RST.ua, CARS.ua) without browser overhead.

Puppeteer Stealth Pool Cloudflare Protected

Headless Chromium pool with fingerprint rotation and anti-bot evasions (DoneDeal, Auto.RIA).

National Bank FX API & Irish Revenue Tax Engine
VRT + Customs 6.5% + VAT 23%

2. Core Engineering Challenges & Solutions

A. Bypassing Sophisticated Anti-Bot & Cloudflare Defenses

Major classified platforms employ Cloudflare WAF, browser fingerprinting, and dynamic JavaScript hydration. Plain curl or standard Axios requests are blocked immediately with HTTP 403.

To resolve this without expensive commercial proxy services, the backend implements a Dual-Tier Scraping Architecture:

B. Real-Time Financial & Irish Revenue Tax Engine

Raw vehicle purchase price is misleading. The application calculates the true Total Landed Cost in Ireland via an automated statutory calculation pipeline:

Total Landed Cost = Base Vehicle Price (Live FX to EUR)
+ International Freight (€1,400 flat benchmark)
+ EU External Customs Duty (6.5% CIF value)
+ Statutory Irish VAT (23% CIF + Customs)
+ Irish Vehicle Registration Tax (CO2-based VRT)

C. Multi-Portal Listing Deduplication

Sellers frequently cross-post the identical automobile across both general classifieds (e.g. OLX.ua) and specialized automotive hubs (e.g. Auto.RIA). The ingest pipeline normalizes model names, years, mileage tolerances (±3%), and VIN prefixes to consolidate duplicate items into a single high-confidence listing.

3. Architecture Comparison & Benchmarks

Metric / Parameter Manual Workflow Scout Engine (Uncached) Scout Engine (Redis Hit)
Query Time across 6 Sites 15 – 25 minutes 4,800 ms 240 ms
Currency Normalization Manual conversion Automatic (Live NBU) Automatic (Live NBU)
Customs Duty & VAT Calc Spreadsheet estimation Instant Exact Math Instant Exact Math
Automated Test Suite None 172 Automated Tests 100% CI Pass Rate

4. Key Production Lessons

  1. Never Rely on Pure DOM Scraping in Isolation: Websites update selectors without warning. Decoupling parsing logic into dedicated scraper adapters covered by continuous integration tests guarantees that broken selectors are flagged before impacting users.
  2. Aggressive Caching for Volatile External Data: Caching normalized results in Redis with a 1-hour TTL reduced third-party HTTP requests by 74%, protecting the service from IP bans.
  3. Transparent Financial Explanations Build Trust: Showing the exact mathematical breakdown of customs, freight, and VAT converted passive viewers into high-intent vehicle importers.
TECHNICAL DEEP DIVES

Explore More Architecture Case Studies