San Francisco Officials Address Growing Digital Archive Duplication Problem

San Francisco's municipal digital infrastructure has a redundancy problem. City departments from the Planning Commission to the Department of Public Works have accumulated years of duplicate image files across shared drives, public-facing portals, and internal content management systems — and the effort to clean up that sprawl is finally drawing serious institutional attention heading into the second half of 2026.

The issue matters now because the city is mid-way through a broader digital modernization push tied to the Mayor's Office of Housing and Community Development's expanded online permit portal, which went live in phases beginning in January. Duplicate and mismatched images in permit records have caused processing delays that ripple outward, slowing housing approvals at a moment when San Francisco is under a state-mandated Housing Element obligation to zone for roughly 82,000 new units by 2031.

What the Experts Are Flagging

Digital records specialists and civic-tech advocates have been raising alarms about the scope of the duplication issue for months. The San Francisco-based nonprofit Code for America, which partners with local governments on digital services, has documented the broader pattern of image mismanagement in city-run permitting and licensing databases as part of its ongoing research into government tech debt. Consultants working with the city's Department of Technology — headquartered at 1 South Van Ness Avenue — describe duplicate image replacement as a deceptively labor-intensive task, particularly when legacy systems store files in formats incompatible with modern archival tools.

The crux of the problem, according to presentations made to the city's Committee on Information Technology earlier this year, is that there is no single automated system reconciling image assets across departments. Each agency — from the Recreation and Parks Department, which manages facilities from Golden Gate Park to Moscone Center, to the SF MTA — has historically maintained its own file repositories with different naming conventions and access controls. When staff upload photos of streetscape conditions, construction sites, or public infrastructure for inspection records, duplicates accumulate without any systematic flag or removal process.

Planning Department staff have noted internally, in documents reviewed by city supervisors, that duplicate images in the Accela permit management system have contributed to file-size bloat that slows query times. The department processed more than 14,000 permit applications in fiscal year 2024-25, according to figures cited in the Planning Commission's annual report, and even marginal delays per application compound into meaningful staff-hour losses across a year.

City Hall's Response and Next Steps

The Department of Technology issued a technical directive in March 2026 calling on all major city agencies to audit digital asset libraries and flag redundant files for removal or consolidation by October 1. That directive, obtained through a Sunshine Ordinance public records request, does not come with dedicated new funding — it relies on existing IT staff capacity, a constraint that civic tech observers say is significant given that the city shed roughly 400 IT-adjacent contractor positions during the 2024 budget cuts.

The San Francisco Public Library's digital services team, based at the main branch on Larkin Street at Civic Center, has moved furthest along on the deduplication work, having completed a pilot program in late 2025 using open-source tools to reconcile its historical photo collection. That pilot has become something of a model that the Department of Technology is now recommending other agencies study.

For residents and businesses navigating the city's online permitting or records systems, the practical advice from digital services staff is straightforward: when submitting applications or documents through SF311 or the city's online permit portals, use consistent file-naming and avoid resubmitting identical images under different names. That kind of upstream discipline, officials say, reduces the downstream cleanup burden significantly.

The October deadline gives departments roughly three months to demonstrate compliance. Whether the audit translates into sustained infrastructure investment — or becomes another item on a long to-do list — will likely depend on how aggressively the Board of Supervisors presses the issue when budget season opens again in the spring of 2027.