Data Pipeline Overview
Flow
Mall Website → Sniff (Playwright) → Parse (provider-specific) → Import/Backfill (API)- Sniff — Playwright-based browser interception captures vector data from indoor map provider SDKs
- Parse — Provider-specific parsers convert to IMDF features with geographic coordinates and amenity classification
- Import/Backfill — Push to MallGuide API with idempotent upsert by stable source keys
Parsers
| Parser | Provider | Format | Coords | Malls |
|---|---|---|---|---|
mappedin.py | Mappedin | JSON vertexes + georef + locations | Geographic | 22+ |
abuzz.py | Abuzz Interactive | SVG symbols + buildingData JSON | Normalized | 2 |
jibestream.py | Jibestream | Inline SVG + waypoint spatial join | Normalized | 1 |
visioweb.py | VisioWeb/Visioglobe | Zip bundle + POI polygons | Normalized | 2 |
static_svg.py | Static SVG | Plain SVG files | — | Not implemented |
See Provider Mapping for which mall owners use which provider.