How San Francisco's City Hall Got Buried Under Thousands of Duplicate Images — and What It's Doing About It

San Francisco's city government is sitting on a digital mess that has been decades in the making. Across the Department of Technology's servers, the Planning Department's permit archive, and the municipal data portal at data.sfgov.org, duplicate images — scanned permits, agenda photographs, inspection records, street-level shots filed by multiple agencies — have multiplied to the point where city IT managers are now treating the problem as a formal infrastructure emergency.

The issue matters right now because the Mayor's Office of Housing and Community Development is in the middle of an accelerated housing production push, pushing thousands of permit applications through a digitized pipeline that was never designed for this volume. Every redundant file that clogs the system slows processing times, and slow processing times translate directly into delayed construction starts in neighborhoods like SoMa, the Tenderloin, and the Western Addition — exactly the places where the city says it needs new units fastest.

How the Pile Built Up

The root causes go back to at least 2008, when the city began scanning paper records in earnest following a budget mandate from the Board of Supervisors to reduce physical storage costs at the City Hall annex on Van Ness Avenue. Different departments digitized independently and without a shared naming convention. The Planning Department, the Department of Building Inspection on Duboce Avenue, and the Office of the Assessor-Recorder each built their own repositories. When those systems were partially integrated through the SF Digital Services initiative — launched in 2019 — nobody ran a deduplication pass first. Files came in triplicate by default: one copy from the originating agency, one from the receiving platform, one from an automated backup routine that didn't check whether the file already existed.

The tech sector's contraction in 2023 and 2024 made it worse in a counterintuitive way. As companies downsized their San Francisco offices and broke leases from Market Street to the Embarcadero, city assessors and permit offices processed a surge of change-of-use filings — each one requiring attached photographs. A single mid-block SoMa commercial conversion could generate forty or fifty image files, many of them near-identical shots taken from slightly different angles by inspectors who didn't know a colleague had already been to the site.

By early 2026, the Department of Technology estimated — in budget planning documents circulated internally — that redundant digital assets were consuming meaningful portions of allocated cloud storage contracts, with the city paying Microsoft Azure and other vendors for capacity that held no unique information. The exact figures remain internal, but the department flagged the issue in its fiscal year 2025–26 capital plan submitted to the Budget and Legislative Analyst's office.

What the City Is Now Doing

The Department of Technology began a formal duplicate-image-replacement program in January 2026, contracting with a San Francisco–based records management firm to run hash-comparison tools across the city's primary document management system, Accela, which handles building and planning permits citywide. The process involves generating a unique digital fingerprint for every image file, then flagging pairs or clusters that match. A human reviewer — not an automated script — makes the final call on deletion, a safeguard insisted upon by the City Attorney's office to protect chain-of-custody integrity for files that may be needed in litigation.

Progress has been slow. As of June 2026, the program had processed roughly a third of the Planning Department's image archive, according to a progress update presented to the City Operations and Neighborhood Services Committee. The Building Inspection archive and the Assessor-Recorder's holdings have not yet been touched.

For residents dealing with the city's permit system directly — contractors waiting on approvals in the Outer Sunset, small landlords filing ADU paperwork in Noe Valley — the practical advice is to upload images in standardized formats and avoid resubmitting files that are already attached to an open case. The Department of Building Inspection's public counter at 49 South Van Ness Avenue has posted updated file submission guidelines at its front desk since March. Getting the digital foundation right now, before the next wave of housing applications arrives, is what city IT staff are racing to accomplish.