SF City Hall's Duplicate Image Problem: The Key Decisions Ahead

San Francisco's Department of Technology is facing a concrete reckoning over how the city manages, stores, and purges duplicate image files across its network of municipal databases — a problem that has quietly driven up cloud storage costs and complicated public records requests filed under California's Public Records Act. The question now is who decides what gets deleted, and when.

The issue matters right now because the city is mid-cycle on a broader digital infrastructure overhaul that Mayor Daniel Lurie's administration inherited after a period of stop-start IT reform under the previous City Hall. Duplicate image files — ranging from permitting photos stored by the Department of Building Inspection to asset records at the San Francisco Municipal Transportation Agency — have accumulated across systems that were never designed to talk to each other. As the city moves toward consolidated cloud contracts expected to be renegotiated before the end of fiscal year 2027, every gigabyte carries a dollar sign.

The San Francisco Department of Technology operates out of 1 South Van Ness Avenue, the same Civic Center-area building that houses several overlapping data systems. Staff there have flagged that the Planning Department's SFPlanning portal and the Department of Building Inspection's online permit tracker both retain high-resolution image attachments — site photos, architectural drawings, inspection records — that are frequently uploaded in duplicate by contractors and property owners submitting the same files through multiple portals. The San Francisco Public Library's digital collections unit at the Main Branch on Larkin Street faces a related but distinct version of the problem, with digitized archival photographs indexed under multiple catalog entries.

Where the Backlog Lives — and Why Cleaning It Up Is Complicated

Duplicate image data is not a trivial housekeeping issue. City IT analysts have estimated internally — though no figure has been published in any budget document reviewed for this article — that redundant file storage represents a meaningful fraction of the city's annual cloud expenditure, which has grown steadily since the pandemic-era shift away from on-premise servers. The city's approved budget for the Department of Technology for fiscal year 2025-2026 was publicly listed at roughly $130 million, covering a range of services well beyond storage alone.

The core decision ahead is governance: who holds the authority to authorize deletion of duplicate records? Under California law, certain government records — including permit documentation and inspection photographs — carry mandatory retention periods. The State of California's Government Code sets minimum retention schedules, and San Francisco's own City Records Management Program, administered through the City Administrator's Office at City Hall, requires departmental sign-off before any image files are purged. That sign-off process has historically been slow, with backlogs building in the queue at the Office of the City Clerk.

The SFMTA, which manages Muni bus and rail operations and holds thousands of maintenance and incident photos in its asset management system, confirmed in its most recent annual report that it was conducting an internal audit of redundant digital records — but the agency has not published a timeline for completion or a cost estimate for the cleanup.

The Path Forward: Automation, Oversight, and a Tight Timeline

Three decisions will define what happens next. First, the Department of Technology needs to finalize a deduplication policy that is legally defensible under state retention law — a draft is reportedly circulating among department heads but has not been submitted to the Board of Supervisors for review. Second, the city must decide whether to deploy automated deduplication software, which several peer municipalities including Chicago and New York City have piloted, or to handle the review manually, which is slower but easier to audit. Third, any system touching Planning or Building Inspection records will require coordination with the City Attorney's Office, given ongoing litigation that sometimes depends on the preservation of permit imagery.

For residents and contractors who use SFPlanning.org or the city's 311 portal to submit documentation, the practical advice is straightforward: avoid uploading the same image file through multiple submission pathways, and retain your own copies independently. The city has not announced any amnesty or correction window for previously submitted duplicates. The Board of Supervisors' Government Audits and Oversight Committee is the most likely venue for public scrutiny of whatever policy emerges — and its next scheduled meeting is July 14.