How San Francisco's City Hall Got Buried in Duplicate Digital Images — and What It's Costing Taxpayers

San Francisco's municipal government is sitting on a sprawling mess of duplicate digital images — property records, permit photos, public health documents, infrastructure surveys — scattered across at least a dozen separate departmental servers, with no single office accountable for purging the redundancy. The problem, years in the making, is now forcing a reckoning as storage costs climb and a citywide technology consolidation push under the Department of Technology gathers momentum in 2026.

The issue matters right now because City Hall is simultaneously under pressure to cut operational spending and modernize its data infrastructure. Mayor Daniel Lurie, who took office in January 2026 after defeating London Breed, campaigned in part on reducing bureaucratic waste. Duplicate image storage is a dry-sounding line item, but it represents a systemic failure that touches everything from the Planning Department's permit archives on Van Ness Avenue to the Department of Public Works' photo logs of pothole repairs in the Sunset District.

How the Duplication Happened

The roots go back roughly fifteen years, to the early 2010s, when San Francisco departments individually contracted with outside vendors to digitize paper records. The Planning Department, the Assessor-Recorder's Office at City Hall, and the Department of Building Inspection on Duboce Street each ran separate projects, often using different file formats and naming conventions. Nobody standardized metadata. Nobody built a shared repository. When a permit application touched multiple departments — as most do in San Francisco's layered approval process — the same photograph of a building facade or a land parcel could end up saved three or four separate times across three or four separate systems.

The San Francisco Department of Technology, based on Seventh Street in SoMa, began flagging the redundancy in internal audits starting around 2019, but budget cycles and the disruption of the COVID-19 pandemic pushed any consolidation plan down the priority list. Then came the tech sector's AI hiring boom of 2024 and 2025, which paradoxically made the problem worse: departments racing to feed machine-learning tools with city data uploaded fresh image batches without first deduplicating what already existed.

The San Francisco Budget and Legislative Analyst's Office has examined municipal data storage contracts in past fiscal year reviews, and city officials have publicly acknowledged that cloud storage expenditures across departments grew substantially between fiscal year 2020 and fiscal year 2025. Independent technology governance analysts note that duplicate image files typically account for between 20 and 40 percent of unmanaged municipal storage bloat — a range consistent with what peer cities have found when they audited their own archives. San Francisco's total annual spend on data storage and cloud services across all departments runs into the tens of millions of dollars, according to budget documents the city publishes annually.

The Cleanup Challenge

Fixing the problem is not straightforward. The Assessor-Recorder's Office, which maintains property images going back decades, uses a legacy database system that does not natively talk to the Planning Department's more modern permit portal, called Accela. Cross-referencing duplicates between those two systems alone requires custom scripting work. The Department of Technology has been piloting a citywide Digital Asset Management initiative — part of a broader effort called the SF Digital Services strategy — but as of mid-2026, the pilot remains limited to a handful of participating agencies.

The practical path forward involves three steps that city technology staff have outlined in public presentations to the Government Audit and Oversight Committee at City Hall: first, complete a full inventory of image assets department by department; second, deploy automated deduplication software across shared cloud environments; third, establish a binding citywide policy requiring all departments to check a central repository before uploading new image files. The timeline being discussed internally targets completion of the inventory phase by the end of fiscal year 2026-27.

For residents and small business owners who interact with city permitting — particularly the thousands who file applications through the SF Planning portal or walk into the Department of Building Inspection on Duboce Avenue — the cleanup should eventually mean faster document retrieval and fewer cases where inspectors cannot locate a photo that was uploaded twice under different file names. The immediate benefit will be felt more by city staff than the public, but the downstream savings on storage contracts are the argument city budget hawks are making to keep the project funded through the next budget cycle.