SF City Agencies Push to Purge Duplicate Images From Public Records—Here's What Officials and Experts Are Saying

San Francisco's Department of Technology is pressing city agencies to clean up years of duplicated digital image files embedded in public-facing databases and permit systems—a problem that, according to city IT staff briefings circulated this spring, has inflated storage costs and slowed permit processing times at the Planning Department on Stevenson Street. The effort, which city administrators have been quietly advancing since January 2026, is now generating pushback and praise in roughly equal measure.

The timing matters. San Francisco is in the middle of a housing production emergency, with Mayor Daniel Lurie's administration under pressure to accelerate permit approvals across the city. Bottlenecks anywhere in the digital infrastructure—including redundant image files that clog document-management queues—translate directly into delays for builders, architects, and neighborhood groups waiting on project decisions. City Hall officials have pointed to the permit portal as one specific chokepoint where duplicate uploads have caused retrieval errors.

What the Experts Are Saying

Urban data specialists and municipal technology consultants who work with Bay Area governments say the problem is common but underappreciated. Duplicate images accumulate when staff at multiple agencies upload the same site photographs, floor plans, or inspection records without a shared deduplication protocol. The San Francisco Controller's Office noted in its Fiscal Year 2025 City Services Auditor report that digital records management remained an area flagged for improvement across several departments, though the report did not specify image duplication as a standalone cost figure.

Technology advisers familiar with the city's infrastructure—including firms that have worked with the SF Digital Services office on Mission Street—say the fix is rarely as simple as running a deduplication script. Legacy systems used by agencies like the Department of Building Inspection and the Recreation and Parks Department store images in formats that don't interoperate cleanly, meaning a replacement or consolidation effort requires manual review alongside any automated tool. One estimate circulating in city IT discussions put the volume of potentially redundant image files in the Planning Department's document system at more than 40,000 records, though that figure has not been independently verified or officially published.

Open-records advocates at the First Amendment Coalition and local journalists who regularly file California Public Records Act requests with the City and County of San Francisco say the duplication problem has a practical consequence beyond storage: when the same image exists under multiple file names or case numbers, search results in the public portal return conflicting or incomplete records. That makes it harder for Tenderloin residents tracking a specific building's permit history, or Castro neighborhood groups monitoring code enforcement, to get a clear picture of what's on file.

The Replacement Debate

The disagreement among city officials centers not on whether to act, but on how. The Department of Technology favors an automated replacement pipeline that would flag duplicates by hash value and archive rather than delete them—preserving chain-of-custody integrity required under California's Government Code. Some department heads, particularly at the SF Fire Department's bureau that manages inspection imagery, have raised concerns about moving too fast and inadvertently breaking links inside active case files.

The City's Chief Data Officer, whose office sits within the Department of Technology at 1 South Van Ness Avenue, has been coordinating interagency working sessions since March 2026. A pilot program involving the Planning Department and the Department of Building Inspection is scheduled to conclude its first phase by September 30, 2026, according to a project timeline shared at a public Digital Services advisory meeting in April.

For residents and developers, the practical advice from city IT liaisons is straightforward: when submitting permit applications through the SF Planning portal, avoid uploading duplicate site images under different file names, as those files enter the same queue that the deduplication audit is currently reviewing and may be flagged for manual hold. The Board of Supervisors' Government Audit and Oversight Committee is expected to receive a progress briefing on the effort before the end of the third quarter. Whether that briefing produces formal legislation or simply an administrative directive will likely depend on what the September pilot data shows.