SF City Agencies Push to Overhaul How Duplicate Images Are Flagged and Removed From Public Records

San Francisco's Department of Technology kicked off a citywide audit this week targeting duplicate image files embedded in public-facing databases, a housekeeping effort that has grown into something far more consequential as AI-scanning tools surface problems that manual reviews missed for years. The push, which accelerated in the days leading up to the Fourth of July holiday, touches permit systems, planning records, and social services case files managed by agencies from the Tenderloin to Civic Center.

The timing is not accidental. The city has been migrating legacy document management systems onto a cloud-based platform since early 2025, and the migration surfaced thousands of misfiled or duplicated image assets — scanned permits, inspection photos, and housing condition records — that were consuming server space and, in some cases, misdirecting staff pulling files for active cases. For departments like the Department of Building Inspection, whose offices sit at 49 South Van Ness Avenue, a duplicated image attached to the wrong permit record is not a minor clerical annoyance. It can stall a housing project by weeks.

What Happened This Week

On Tuesday, July 1, the Department of Technology circulated an internal bulletin — obtained and described by sources familiar with its contents, though not for direct quotation — outlining a phased replacement protocol for confirmed duplicate images across six participating agencies. The protocol assigns each flagged file a unique hash identifier, cross-references it against the originating document, and routes it to a human reviewer before deletion. Agencies have until July 31 to complete Phase One, which covers permit and inspection imagery dating back to 2018.

The San Francisco Planning Department, which processes thousands of discretionary review applications annually from neighborhoods including the Mission District, Noe Valley, and the Richmond, confirmed it is participating in the audit. The department's online portal — used by developers, architects, and residents to track project status — has periodically displayed mismatched project photos, a problem that staff have been aware of since at least late 2024. The duplicate-image replacement effort is intended to address that directly, though a full resolution of the portal display errors is not expected until the third quarter of 2026.

The Human Services Agency, which runs programs out of offices on Otis Street in SoMa, is also part of the review. Case management software used by HSA staff relies on scanned intake documents, and duplicate image files in that system have the potential to surface outdated or misidentified records during eligibility screenings — a higher-stakes problem than a mismatched permit photo.

The Broader Stakes for a City in Transition

San Francisco's municipal IT infrastructure is carrying the weight of years of deferred maintenance. The city's 2025-2026 budget allocated funds for technology modernization across multiple departments, a line item that was debated extensively at City Hall during the spring budget cycle. Advocates for housing production, including groups that track permitting timelines in neighborhoods like the Sunset and Bayview-Hunters Point, have long pointed to administrative bottlenecks — not just policy — as a drag on the city's ability to approve and build new units quickly.

The duplicate-image problem is a narrow slice of that larger administrative challenge, but it illustrates how foundational data hygiene has downstream consequences. A 2024 report from the Controller's Office found that data quality issues in city permitting systems contributed to processing delays averaging several days per application, adding up across the roughly 6,000 building permit applications the city receives each month.

For residents and developers monitoring active projects, the practical advice from city staff this week is straightforward: if a permit record on the SF Planning or DBI portal shows an image that appears mismatched or outdated, submitting a correction request through the official portal feedback form will flag it for the current review cycle. The Department of Technology says Phase One corrections will be reflected in public-facing systems by early August. Phase Two, covering social services and health department records, is scheduled to begin in September 2026.