SF's Duplicate Image Problem: What Happens Next and the Key Decisions Ahead

San Francisco's sprawling network of public-facing digital systems — spanning the Department of Public Works, the Planning Department on Spear Street, and dozens of nonprofit service providers in the Tenderloin — is sitting on a growing crisis of duplicate and degraded image files that staff and contractors say is slowing down everything from permit approvals to shelter intake processing. The problem has been building for years. The question now is who fixes it, and how fast.

The issue crystallized this spring when the Planning Department, which processes thousands of project filings annually at its offices near the Embarcadero, flagged that its document management system had accumulated redundant image assets across multiple database layers. Duplicate files weren't just a storage annoyance — they were causing retrieval delays, version-control conflicts, and in some cases pushing outdated renderings back into active permit review queues. The city's Department of Technology has since been brought in to scope a remediation effort.

Why This Moment Is Different

Two factors are pushing this from a background IT headache to a front-burner policy decision. First, Mayor Daniel Lurie's administration inherited a Department of Technology operating budget that city budget documents place under increased scrutiny for the 2026-27 fiscal year, with consolidation of redundant digital services identified as a target area. Second, the AI procurement wave sweeping through San Francisco's tech sector has made image deduplication tools significantly cheaper and faster to deploy than even three years ago — vendors are actively pitching the city.

The Tenderloin Technology Lab on Turk Street, which assists nonprofits with digital operations, has watched the same problem play out at a smaller scale across the community organizations it supports. Several shelter operators and food-access groups in the Civic Center corridor use shared case management platforms where image uploads — client intake photos, site inspection records — pile up without any systematic review. Staff time spent manually sorting duplicates is a real operational cost for organizations already stretched thin.

San Francisco is not alone. New York City's Department of City Planning undertook a similar deduplication audit of its ZOLA land use portal in 2024, reducing its active image asset library by roughly 34 percent after a six-month contractor-led review, according to city budget testimony published that year. San Francisco's Planning Department hasn't released equivalent figures for its own systems, but internal memos reviewed by city council staff suggest the scope is comparable.

The Decisions Ahead

Three choices will define the outcome over the next six to nine months. The first is procurement: whether the Department of Technology issues a competitive RFP for a dedicated deduplication tool or folds the work into an existing contract with one of the city's current enterprise software vendors, likely through the Civic Bridge program at City Hall. The second is governance — specifically, whether individual departments retain control of their own image libraries or whether a centralized digital asset management policy gets enforced citywide. That fight has stalled before.

The third decision is the most consequential for residents: whether community-facing systems, including those used at drop-in centers along Sixth Street and transitional housing sites in the Bayview, get upgraded on the same timeline as municipal back-office systems, or whether they're treated as a lower priority. Advocates working in both neighborhoods say the practical stakes are high — a caseworker uploading a client photo to a system that then creates three duplicate records doesn't just waste server space, it creates real confusion during service handoffs.

The Department of Technology is expected to present a preliminary assessment to the city's Committee on Information Technology before the end of August. If that assessment leads to a formal RFP, procurement alone could take another four to six months — meaning any new system would realistically go live in mid-2027 at the earliest. Organizations along the Sixth Street corridor and in the Civic Center area that want a seat at the table should file public comment before the August hearing. The window to shape the solution is narrow, and it's open right now.