SF's Duplicate Image Problem: What Happens Next and the Key Decisions Ahead

San Francisco's patchwork of municipal databases is sitting on a growing crisis of duplicate digital images — redundant files scattered across city departments that are costing taxpayers in storage fees, slowing down permit approvals, and tangling the records systems that social services workers depend on daily. The question now is who owns the fix, and how fast it happens.

The problem has sharpened this year as the city's Department of Technology pushes a broader data consolidation effort tied to the Mayor's Office of Housing and Community Development's push to accelerate housing production. When planners at the San Francisco Planning Department on Fillmore Street pull up a parcel file, they can encounter five or six versions of the same site photograph, uploaded at different stages of the permitting process by different staff members using different systems. That redundancy doesn't just slow the screen — it creates legal and audit exposure when the wrong version of a document becomes the record of reference.

Where the Bottlenecks Are

The Department of Building Inspection, headquartered at 49 South Van Ness Avenue, uses a legacy permitting platform that does not automatically flag duplicate uploads. Staff there have historically solved the problem manually — a time-intensive workaround that the city's own IT auditors flagged as unsustainable as permit volume climbed. The Planning Department and DBI together processed more than 40,000 permit applications in fiscal year 2024–25, according to figures the city published in its annual performance report. Even a modest rate of duplicate image attachments per file compounds quickly into tens of thousands of redundant records.

Nonprofits working on the frontlines of the homelessness crisis face a parallel version of the same problem. The Department of Homelessness and Supportive Housing, which coordinates services out of its offices near Civic Center, shares client data with more than two dozen provider organizations across the city. Case managers at Tenderloin Housing Clinic and the Mission neighborhood's Dolores Street Community Services have both flagged instances where client photo IDs and intake documents are duplicated across multiple case management platforms, creating compliance risks under federal housing program rules. Incorrect or duplicated records can affect eligibility determinations.

The Moscone Center data center consolidation project, which the Department of Technology has been phasing in since late 2024, was supposed to address some of this. It hasn't moved fast enough. The city's enterprise content management contract — the software layer that governs how documents are stored and retrieved — comes up for renewal in the first quarter of 2027, giving the current administration a narrow window to either renegotiate terms that include automated deduplication tools or rebid the contract entirely.

The Decisions That Can't Wait

Three choices are now sitting on the desks of department heads and the city's Chief Information Officer. First: whether to mandate a citywide image deduplication standard before the contract renewal deadline, or leave each department to set its own rules. Second: whether the cost of implementing machine-learning-assisted deduplication tools — estimated by comparable municipal projects in Chicago and Denver to run between $2 million and $5 million for a city of San Francisco's size — gets funded through the general fund or through a federal grant application. Third: whether the governance model places a single city office in charge of enforcement, or relies on interdepartmental coordination that has historically moved slowly.

The timeline is tight. The Mayor's Office has tied housing production targets to faster permit turnaround — the goal of 82,000 new units over the next eight years depends partly on cutting administrative friction. Duplicate image records sitting in DBI's system are a small but concrete piece of that friction. The Department of Technology is expected to present a recommendation to the city's Committee on Information Technology before the end of August. If that recommendation doesn't come with a clear funding path and a named implementation lead, advocates and department insiders say the window closes and the problem rolls into another fiscal year, unresolved.

For San Franciscans watching the city's broader push to modernize its bureaucracy, this is an instructive case. The technology to fix duplicate image problems exists. The question that will be answered in the next 60 days is whether the city has the administrative will to deploy it before another contract cycle locks in the status quo.