San Francisco Is Quietly Overhauling How It Hunts Down Duplicate Property Records — Here's How It Stacks Up Against Amsterdam and Seoul

San Francisco's Department of Building Inspection has been working since January 2026 to purge thousands of duplicate property photographs from its permit-tracking system, a technical housekeeping task that has turned into a revealing stress test of the city's capacity to modernize its bureaucracy under pressure. The backlog — built up over more than a decade of inconsistent scanning protocols across offices in the Civic Center complex — has slowed some residential permit reviews by days, a problem that stings in a city trying to accelerate housing production under state-mandated timelines.

The issue matters now because San Francisco is operating under California's Housing Element law, which requires measurable progress on permitting. Every bottleneck in the approval pipeline draws scrutiny from Sacramento. Duplicate images inflate database sizes, confuse automated review tools, and in some cases have caused inspectors to reference outdated site photographs during field visits to neighborhoods like the Outer Sunset and Bayview-Hunters Point, where older housing stock generates the most complex documentation. The San Francisco Planning Department and the Department of Building Inspection share image repositories, and the lack of a unified deduplication protocol between the two agencies has compounded the problem.

What San Francisco Is Actually Doing

The city contracted in March 2026 with a Mission District-based civic-tech firm to run perceptual hashing software against the combined image database, a technique that identifies near-identical photographs without requiring manual review of each file. The effort is being piloted first on records tied to the Eastern Neighborhoods Plan area — roughly bounded by Division Street, Cesar Chavez, and the bay — before a citywide rollout expected in the fourth quarter of 2026. The Planning Department confirmed the pilot in a March budget hearing document, though the contract value has not been made public at the time of writing.

Separately, the San Francisco Public Library's Historian Division, which maintains its own archive of street-level property imagery going back to the 1906 earthquake, completed its own deduplication pass in 2024, reducing its digital storage load by roughly 34 percent, according to figures the library published in its annual report. That precedent is being cited internally as evidence the approach works at scale, though the planning and building databases are orders of magnitude larger and tied to live regulatory workflows rather than a static archive.

How Other Cities Are Handling the Same Problem

Amsterdam's municipal planning office, the Omgevingsloket, completed a full deduplication overhaul of its building permit imagery system in late 2024, integrating the process directly into its intake workflow so that duplicate images are flagged at the point of upload rather than discovered retrospectively. City officials in Amsterdam have described the change in public budget documents as saving an estimated 200 hours of staff review time per month, though that figure applies to Amsterdam's permit volume, which is considerably lower than San Francisco's.

Seoul took a different approach. The city's Urban Regeneration Support Center embedded AI-assisted image tagging into its permitting portal beginning in 2023, meaning inspectors in districts like Mapo and Seongdong can now search by visual similarity rather than relying on alphanumeric file names. The result, described in a 2025 Seoul Metropolitan Government infrastructure report, was a 41 percent reduction in redundant file storage across urban planning records within 18 months. San Francisco planners have cited the Seoul model in at least one internal working-group memo, according to a document obtained through a public records request filed earlier this year.

London's Planning Portal, which serves as the national intake system for England's planning applications, remains a cautionary tale. A deduplication project launched by the Planning Portal in 2021 stalled over data governance disputes between borough councils and the central portal operator, and as of 2025 had not reached completion, based on reporting by UK planning trade publications.

For San Francisco residents, the practical upshot is straightforward: property owners in the Eastern Neighborhoods pilot zone who submit permit applications after September 2026 should expect faster initial review because inspectors will be working from cleaner, deduplicated records. Anyone planning a renovation in Noe Valley, the Mission, or Potrero Hill who has a pending permit application can contact the Department of Building Inspection's public counter at 49 South Van Ness Avenue to ask whether their parcel is already in the cleaned dataset. The broader citywide rollout, if it holds to schedule, would put San Francisco ahead of London but still roughly two years behind Seoul and Amsterdam on this particular slice of planning-system modernization.