SF's Digital Records Push Hits a Wall: What Officials, Experts and Key Figures Are Saying About the City's Duplicate Image Problem

San Francisco's effort to modernize its public records system has run into an unglamorous but costly obstacle: thousands of duplicate scanned images cluttering the city's document repositories, slowing searches, inflating storage costs and, in at least one documented case, causing a planning permit to be filed under the wrong parcel address in the Mission District. City archivists confirmed the duplication problem is concentrated in records digitized between 2019 and 2023, a period when multiple city departments were scanning independently without a shared deduplication protocol.

The timing matters. Mayor Daniel Lurie's administration entered City Hall in January 2026 pledging faster permitting as a cornerstone of its housing production push, and the Department of Building Inspection has been under pressure to cut the average permit wait time below 30 business days. Redundant image files embedded in the city's Accela permitting platform — the software used by DBI and the Planning Department — are contributing to slower database queries, according to a March 2026 internal review obtained by The Daily San Francisco through a Sunshine Ordinance request.

What City Officials and Open-Government Advocates Are Saying

The City Administrator's Office has acknowledged the scope of the problem without releasing precise figures. A spokesperson for the office pointed to a remediation contract awarded in April 2026 to a vendor under the city's existing IT master services agreement, with work expected to conclude by October 2026. The contract value has not been made public. The San Francisco Civil Grand Jury flagged digital records mismanagement in its June 2025 annual report, noting that the city lacked a unified image-deduplication standard across its 53 departments — a gap the jury said exposed the city to both legal risk and unnecessary expenditure.

The San Francisco Public Library's History Center on Larkin Street, which manages a separate digitization program for historical documents, says it adopted an automated hash-matching deduplication system in 2021 and has not experienced comparable problems. Librarians there have informally briefed DBI staff on their approach, though no formal knowledge-sharing agreement is in place. OpenSF, a civic-tech nonprofit that tracks city data quality from its SoMa office on Folsom Street, published a white paper in May 2026 estimating that duplicate images account for roughly 12 percent of storage load in the city's shared cloud environment — a figure the City Administrator's office has neither confirmed nor disputed.

Tech Sector Voices Weigh In as Permitting Backlog Grows

Several AI and data-engineering firms clustered in the Mid-Market corridor have quietly expressed interest in helping the city automate duplicate detection, according to meeting agendas from the Mayor's Office of Housing and Community Development posted in June. No contracts have been awarded. The broader tech community's involvement carries political sensitivity: after two years of high-profile layoffs, the industry's rebound around AI tools has made city officials cautious about the optics of handing government data work to private sector players without competitive bidding.

Urban planning consultants who work regularly with the Planning Department's offices on Cesar Chavez Street say the practical consequence is felt most sharply in housing projects. Developers seeking approvals for in-law units and multifamily buildings in the Outer Sunset and Excelsior neighborhoods have reported pulling duplicate or mismatched site photographs from the city's online records portal — errors that require staff correction and add days to already-stretched timelines. The median time to receive a site permit for an accessory dwelling unit in San Francisco stood at 48 business days as of the first quarter of 2026, according to DBI's own quarterly dashboard.

City officials say the October 2026 remediation deadline is firm and that a new image-intake protocol requiring hash verification at the point of upload will go live alongside the cleanup. Residents and developers tracking permit applications can flag suspected duplicate records through DBI's online portal or by visiting the department's public counter at 49 South Van Ness Avenue. Open-government groups are urging the city to release the full vendor contract and a post-remediation audit by year-end so the scope of the problem — and the cost of fixing it — becomes part of the public record.