Istanbul · preparing, not predicting
The model was tested on a city it had never seen. Istanbul has no post-earthquake images and no damage labels, so its accuracy there cannot be measured. What can be done now is to have everything else ready: every mapped building, the official scenario estimates per neighbourhood, and a pipeline that turns the first post-event images into a list of buildings to check first.
What a Mw 7.5 earthquake on the Marmara fault would do, building by building and street by street: the scenario →
Each shape is a mahalle. Scenario shows İBB's estimate of very heavily and heavily damaged buildings for a Mw 7.5 night-time earthquake. Old stock is the share of buildings built before 1980 (İBB, 2017). Footprints compares the footprints in the inventory with İBB's count: the image model can only score buildings that have a footprint.
The inventory starts from OpenStreetMap, whose outlines are drawn by people and carry storeys and building types. Where OSM has no building, Microsoft's machine-made footprints fill the gap: 456,023 of them, which brings the median mahalle from 67 % to 97 % of İBB's count. In the Antakya test the same footprints worked as an inventory made before the earthquake.
The same pipeline was run on Antakya as if it were the day after: footprints made in advance (Microsoft's machine-made building footprints, since OpenStreetMap had only 413 buildings there before the earthquake), the released Maxar acquisition of 11 February 2023, and the model and settings unchanged. On the 11,783 labelled buildings it could score, it did as well as the careful evaluation pipeline:
| Same buildings | Macro-F1 | AUROC | Destroyed in top 10 % | ECE |
|---|---|---|---|---|
| Evaluation pipeline | 0.490 | 0.733 | 54% | 0.083 |
| Response pipeline | 0.510 | 0.743 | 52% | 0.053 |
23,397 buildings in 8 minutes on one GPU without alignment, 23 minutes with it. Most of the gain comes from scoring each crop in eight rotations and averaging. Details in the README.
python -m enkaz.respond --inventory data/istanbul/buildings.npz \
--post scene.tif --pre reference.tif \
--checkpoint post_only/best.pt --calibration post_only/eval.json \
--out response/