SF's Digital Records Push Hits a Snag: Officials and Experts Weigh In on the City's Duplicate Image Problem

San Francisco's ambitious effort to move its planning and building permit records entirely online has run into a bureaucratic wrinkle that city officials and digital archivists say they underestimated: tens of thousands of duplicate scanned images clogging the municipal database, inflating storage costs and making document searches unreliable. The problem has become a flashpoint in ongoing debates about government efficiency at a moment when the city is under pressure to approve housing faster and streamline permitting at 49 South Van Ness Avenue, the Planning Department's main office.

The timing matters. Mayor Daniel Lurie's administration has made housing production a centerpiece of its first months in office, and slow permitting has long been identified as a structural obstacle. A city audit completed in spring 2026 found that the Department of Building Inspection processed some permit applications that required staff to manually sift through redundant document uploads before approvals could move forward. Duplicate image files — created when staff scan the same page multiple times, or when legacy systems import records from older platforms without deduplication checks — are compounding delays that already frustrate applicants across the city.

What Officials and Experts Are Saying

Technology policy researchers who have examined similar digitization efforts in cities including Chicago and New York say San Francisco's situation is not unusual for a government transitioning away from paper-based workflows, but that the failure to build automated deduplication into the system from the outset is a costly oversight. The San Francisco Controller's Office has flagged digital infrastructure as an area needing investment in its most recent citywide performance report, though it has not published a specific dollar figure tied to the duplicate-image problem.

At the San Francisco Public Library's Government Information Center on Larkin Street, staff who help residents access city records say the confusion created by duplicate files is a frequent complaint. Researchers pulling permit histories for properties in the Mission District or the Sunset have encountered the same scan appearing under different file names, making it difficult to confirm whether a document is an original or a copy without calling the issuing department directly.

Digital governance advocates connected to the San Francisco Apartment Association have been pressing the Department of Building Inspection to adopt a cleaner intake protocol since at least early 2025. The core ask is straightforward: require all uploaded documents to pass through a hash-based deduplication check before they enter the active database. Several California counties, including Santa Clara, have implemented similar filters as part of their own records modernization programs.

Storage Costs and the Path Forward

Cloud storage is not free. City technology staff have described the duplicate-image accumulation as a contributor to rising infrastructure expenses, though precise figures have not been made public. For context, industry benchmarks suggest that a single uncompressed high-resolution scan of a standard permit drawing can run between 8 and 25 megabytes; multiply that by thousands of redundant copies across decades of records and the storage burden becomes measurable in terabytes.

The San Francisco Department of Technology, which manages citywide IT contracts, is expected to issue updated guidelines for departmental document management before the end of the third quarter of 2026. Those guidelines are anticipated to include mandatory deduplication standards, though nothing has been formally published as of July 4.

For residents and contractors navigating the system now, the practical advice from building permit expediters working in neighborhoods like Hayes Valley and the Tenderloin is consistent: submit documents as clearly labeled, single-page PDFs where possible, and follow up with DBI staff by phone at 49 South Van Ness to confirm receipt and avoid the resubmission loops that duplicate detection failures tend to generate. The city has also pointed users toward its SF311 portal as a first point of contact for reporting document processing errors. A cleaner system, officials suggest, is coming — but the paperwork pile-up will take time to sort.