SF City Hall's Duplicate Image Problem: The Key Decisions Coming This Fall

San Francisco's Department of Technology is sitting on a growing problem that few residents know about but every city department feels: thousands of duplicate digital images clogging municipal databases, slowing permit processing at the Department of Building Inspection on 49 South Van Ness Avenue and creating audit headaches for the City Assessor-Recorder's office. The question of how to fix it—and who pays—will land on agency directors' desks no later than September, according to the department's published 2026 fiscal calendar.

The issue has sharpened because of timing. San Francisco is mid-transition on two major platform migrations: the Planning Department's move to a new permit management system, and the Assessor-Recorder's parallel digitization of property documents stretching back decades. Both efforts are surfacing the same structural flaw—legacy scanning workflows that never deduplicated images before ingestion, leaving multiple identical files under different record numbers. What was a manageable nuisance two years ago has compounded into a genuine data integrity issue as both platforms go live.

What the Backlog Looks Like on the Ground

The practical consequences are visible at street level. Staff at the Planning Department's counter at 49 South Van Ness report longer retrieval times when pulling permit histories for projects in high-churn neighborhoods like the Mission and SoMa, where building permit volumes are among the highest in the city. The Assessor-Recorder's office, headquartered at City Hall on Polk Street, faces a separate but related crunch: duplicate parcel images attached to property transfer documents can trigger false flags in title searches, a problem that title companies working on the city's roughly 8,000 annual residential sales have flagged in correspondence with the office.

The Department of Technology has narrowed the remediation choices to three. The first is a manual audit contract, which internal estimates place in the range of several hundred thousand dollars and would take 18 to 24 months to complete. The second is a vendor-supplied AI deduplication tool—several firms pitched the city at a Civic Bridge session in April—which promises faster throughput but requires a data-sharing agreement that the City Attorney's office has not yet cleared. The third option is a hybrid: automated flagging followed by human review, which preserves oversight but extends the timeline and splits the budget between two budget lines.

The Decisions That Will Shape the Outcome

Three institutional choices will determine which path the city takes. First, the Board of Supervisors' Government Audit and Oversight Committee, which last convened on this topic in a May hearing at City Hall's Room 250, must decide whether to authorize emergency procurement authority for any vendor contract above the standard $10 million threshold—a procedural step that could compress the timeline by months. Second, the City Attorney's office needs to resolve the data-sharing legal question before any AI vendor can begin work; that review has been pending since the April Civic Bridge session. Third, the Department of Technology must publish its own recommendation to the Mayor's Office before the September budget reconciliation window closes, or the entire remediation gets pushed to the 2027-28 fiscal cycle.

Advocates for the manual audit route argue that outsourcing image classification to an AI tool—however well-vetted—introduces new liability when those classifications feed into property records that underpin real estate transactions and building permits. Advocates for the automated approach point to the backlog's growth rate: if the duplication problem is compounding annually, a 24-month manual process may finish cleaning 2024's records just as 2026's duplicates pile up.

For residents and developers watching projects move through the Planning Department pipeline on Van Ness, the practical upshot is straightforward: the slower the city moves on a remediation decision, the longer permit histories will carry data anomalies, and the higher the risk that a title search or permit audit returns conflicting image records. The September budget window is the last realistic on-ramp before the new fiscal year locks spending. City Hall watchers say the Government Audit and Oversight Committee's next scheduled hearing, tentatively set for late August, is the most likely venue where the competing options will be weighed in public.