SF City Agencies Race to Fix Duplicate-Image Problem Plaguing Digital Records This Week

San Francisco's Department of Technology confirmed this week that a system-wide audit of municipal digital asset libraries has uncovered a significant duplicate-image problem stretching across at least four city agencies, with redundant files identified in databases tied to building permits, social services case records, and public-works documentation. The cleanup effort, which began in earnest on June 30, is the most comprehensive review of the city's image-file infrastructure since the 2022 migration to the Salesforce-based SF311 platform.

The timing matters. City Hall has been pushing hard to accelerate permit approvals — particularly for housing — after Mayor Daniel Lurie signed an executive directive in May ordering the Planning Department on Kearny Street to cut average permit-processing times. Clogged digital workflows, where inspectors and clerks must manually sort through duplicate images attached to the same property address, have been quietly adding days to reviews that residents and developers say are already too slow. The Tenderloin and SoMa, two neighborhoods with the highest density of active permit applications per block, have seen the most friction.

What the Audit Found This Week

The Department of Technology's Digital Services team, based at 1 Dr. Carlton B. Goodlett Place in Civic Center, began flagging the scope of the problem publicly on July 1 through a note posted to the city's DataSF open-data portal. The audit — still ongoing as of Saturday — had by Thursday identified more than 40,000 image files across shared city drives that were exact or near-exact duplicates, consuming an estimated 2.1 terabytes of storage on servers maintained under a contract with a third-party cloud vendor. That figure comes from the DataSF update itself, which was reviewed for this story.

The San Francisco Planning Department and the Department of Building Inspection, whose offices sit on Van Ness Avenue, are the two agencies most directly affected. Both rely on image uploads — site photos, architectural drawings, condition documentation — as part of standard permit workflows. When duplicate images accumulate under the same case number, automated routing systems flag the submission for manual review, adding what city technology staff have described in internal documentation as an average delay of 1.3 business days per affected application. That internal figure appeared in a slide deck circulated at a June 25 interdepartmental meeting, a copy of which was obtained by The Daily San Francisco.

For context, the city processed roughly 28,000 over-the-counter and full-plan-check permit applications in fiscal year 2025, according to the Department of Building Inspection's annual report. Even a fraction of those slowed by duplicate-image flags represents a meaningful drag on the housing production pipeline that the Lurie administration has made a centerpiece of its first-year agenda.

Cleanup Timeline and What Comes Next

The Department of Technology has engaged Civic Bridge, a pro-bono partnership program that pairs city agencies with private-sector technology firms, to accelerate deduplication. A team with expertise in automated image-hashing — a process that assigns unique identifiers to files to detect redundancy — began work at the city's digital infrastructure hub on Beale Street on Wednesday. The goal is to run automated deduplication scripts across the affected databases by July 18, after which staff from Planning and DBI will conduct a manual verification pass on flagged edge cases.

Residents and contractors with active permit applications at properties in the Mission, Tenderloin, or SoMa can check the status of their submissions through the SF Permit Center's online portal. City technology staff have advised applicants not to resubmit image attachments during the cleanup window, as doing so risks generating additional duplicates and further delaying rather than expediting review.

The broader lesson city officials are drawing is procedural: the duplicate problem accumulated over years because different departments used incompatible naming conventions when uploading files, and no agency had a standing mandate to audit image libraries on a regular cycle. A proposal to establish a quarterly data-hygiene review requirement is expected to go before the city's Committee on Information Technology in August.