SF Officials and Tech Experts Push to Fix City's Duplicate Image Problem Before It Derails Digital Record-Keeping

San Francisco's digital infrastructure has a bloat problem. City departments, transit agencies and planning offices are sitting on massive troves of duplicate image files — redundant photographs, scanned permit documents and surveillance stills that consume server space, slow retrieval times and complicate public records requests. Officials at several agencies are now publicly acknowledging the scale of the issue and calling for coordinated action before it compounds further.

The timing matters. San Francisco is mid-way through a technology overhaul pushed by Mayor Daniel Lurie's administration, which took office in January 2026 after a campaign that leaned heavily on promises of operational efficiency. The city's Department of Technology, headquartered at 1 South Van Ness Avenue, is managing multiple concurrent digitisation contracts, and administrators say duplicate image accumulation is a predictable byproduct of merging legacy systems with newer cloud platforms.

Where the Problem Shows Up

The San Francisco Planning Department's permit image archive, which covers decades of building applications across neighborhoods from the Richmond District to Bayview-Hunters Point, is one of the most cited examples. Permit scans uploaded through older intake systems were frequently re-uploaded when staff migrated to newer platforms, creating multiple versions of the same file without any automated deduplication layer to catch them. The Planning Department processes tens of thousands of permit applications per year, and even a modest rate of duplication across image-heavy files adds up fast in storage costs and retrieval delays.

BART's station surveillance network presents a parallel challenge. The transit agency operates cameras at all 50 stations across its system, including the Civic Center/UN Plaza and 16th Street Mission stops that serve as focal points for the city's ongoing public safety debates. When footage clips are flagged for incident review and then archived, copies can accumulate across multiple internal servers without a single authoritative record. BART's technology staff have described the problem in public board presentations this year as a known operational friction point, though no remediation timeline has been published.

At San Francisco General Hospital — officially Zuckerberg San Francisco General — radiology and clinical imaging departments face a version of this challenge that has direct patient-care implications. Medical image duplication across electronic health record platforms is a recognised industry-wide problem. Nationally, healthcare IT analysts have estimated that duplicate medical records affect roughly 10 percent of patient files at large urban hospitals, though San Francisco General has not published a figure specific to its own systems.

What Experts Are Recommending

Technology policy researchers affiliated with UC San Francisco and civic tech organisations including Code for San Francisco — a volunteer brigade that meets regularly in SoMa — have spent the past several months pushing a common argument: the fix is less about storage hardware and more about governance. Deduplication tools exist and are commercially available, some priced at under $15,000 annually for mid-sized government deployments. The harder problem is deciding which department owns the master copy of a file, who has authority to delete redundant versions, and how that process gets audited.

The city's Chief Data Officer position, which sits within the Department of Technology, is expected to issue updated data management guidelines by the end of the third quarter of 2026. Those guidelines, according to publicly available planning documents, will address image file standards for the first time since 2019. Advocates at the San Francisco Transparency Coalition, a civic accountability group based in the Financial District, have been pressing for those guidelines to include mandatory deduplication audits as a condition of any new technology procurement contract the city signs.

The Fourth of July holiday has most city offices closed today, but the conversations happening around this issue are unlikely to wait long. Budget cycles for the fiscal year beginning July 1 are already locked, meaning any new spending on deduplication tooling would have to come from contingency funds or be folded into existing technology contracts. The Department of Technology is expected to hold a public briefing later this month at its Van Ness headquarters. Residents and small business owners who rely on city permit portals or transit services — and who have dealt with the downstream effects of slow or garbled digital records — are encouraged to submit comments ahead of that session through the city's online public participation portal.