The Daily San Francisco

San Francisco news, every day

News

SF's Digital Records Overhaul: What Officials, Experts and Key Figures Are Saying About the City's Duplicate Image Problem

A quiet but costly data crisis is forcing San Francisco agencies to confront years of redundant digital files clogging public systems — and the fix is anything but simple.

By San Francisco News Desk · Published 4 July 2026, 12:16 pm

3 min read

SF's Digital Records Overhaul: What Officials, Experts and Key Figures Are Saying About the City's Duplicate Image Problem
Photo: James, George Wharton, 1858-1923 / Public domain (Wikimedia Commons)

San Francisco's sprawling network of city agencies is sitting on millions of duplicate digital images — permit photos, planning documents, public health records, infrastructure scans — and officials say cleaning up the mess is now a budget and operational priority for fiscal year 2027. The Department of Technology, headquartered at 1 South Van Ness Avenue, has begun a structured audit of redundant image files stored across at least a dozen city departments, according to public procurement records reviewed this week.

The timing matters. The city is in the middle of a $14.6 billion two-year budget cycle, and Mayor Daniel Lurie's administration has pushed agencies to cut wasteful digital storage costs as part of a broader effort to find savings without gutting frontline services. Cloud storage contracts alone cost the city tens of millions of dollars annually, and duplicated image files — many uploaded multiple times by different staff using different systems — are a significant and largely invisible driver of those costs.

Why Experts Say This Is Harder Than It Looks

Digital records specialists and government technology consultants say the duplicate image problem in large municipalities is almost always worse than initial audits suggest. The issue in San Francisco stems partly from the city's patchwork of legacy systems — some departments still rely on platforms acquired before 2010 — and partly from the absence of a unified file-naming or metadata standard across agencies.

The San Francisco Planning Department, which processes hundreds of conditional use applications and variance requests each year from its offices at 49 South Van Ness, has been flagged internally as one of the heavier contributors to image redundancy, largely because applicants frequently resubmit photo packages when initial uploads fail. The Department of Building Inspection, which handles permit documentation for roughly 40,000 active permits at any given time, faces a similar structural problem.

Technology policy researchers at UC San Francisco's data governance programs have noted that cities which invest in automated deduplication tools — software that identifies and flags identical or near-identical image files before archiving — can reduce cloud storage consumption by 20 to 35 percent within the first 18 months of deployment. San Francisco has not yet publicly committed to a specific vendor contract for that purpose, though the Department of Technology's current RFP process is expected to conclude by September 2026.

Neighbourhood-Level Consequences and What Comes Next

The practical stakes reach into everyday city operations. In the Tenderloin and SoMa corridors, where the Department of Public Health and the Department of Homelessness and Supportive Housing both maintain photo documentation of encampment response and shelter unit inspections, duplicated records have reportedly slowed case processing and complicated audits. The city's Shelter Monitoring Committee, which reviews conditions at facilities including those along Seventh Street and in the Civic Center area, has flagged record retrieval delays as a workflow problem in past quarterly reports.

The Controller's Office, which oversees city financial and operational audits from City Hall at 1 Dr. Carlton B. Goodlett Place, is expected to release a formal efficiency review of digital records management practices before the end of the third quarter of 2026. That review will likely inform whether the Board of Supervisors allocates dedicated funding for a citywide deduplication program in the next budget amendment cycle.

For residents and businesses interacting with city systems — whether applying for a permit in the Richmond District or submitting documentation through SF311 — the near-term experience is unlikely to change immediately. But technology officials say a cleaner backend should eventually translate to faster processing times and fewer instances of lost or misfiled documentation. The Department of Technology has said it plans to publish preliminary audit findings on its public dashboard by October 1, 2026, giving the Board of Supervisors time to act before the holiday budget freeze in December.

Topic:#News

How does this story make you feel?

Spread the word

See something wrong? Suggest a correction.

Have your say

Loading comments…

Sources

About this article

Published by The Daily San Francisco

This article was produced by the The Daily San Francisco editorial desk and covers news in San Francisco. See our editorial standards for how we use AI.

The Daily San Francisco brief

The day's San Francisco news in a 2-minute read, every weekday morning. Free.

By subscribing you agree to receive emails from The Daily San Francisco and accept our Privacy Policy. Unsubscribe anytime.

Daily brief

Enjoyed this? Wake up to San Francisco news every morning.

Free, in your inbox before 7am. Weekdays.

By subscribing you agree to receive emails from The Daily San Francisco and accept our Privacy Policy. Unsubscribe anytime.

More from The Daily San Francisco

More in News

Enjoyed this story? Get tomorrow's briefing free.