SF City Agencies Push to Fix Duplicate-Image Problem Plaguing Digital Public Records

San Francisco's push to modernize its digital infrastructure hit a practical snag this week when multiple city departments acknowledged the scope of a persistent duplicate-image problem that has slowed permit processing, inflated storage costs, and muddied public-facing databases citywide. The issue — redundant digital images attached to public records, property files, and transit documentation — has drawn attention from the city's Department of Technology as well as outside vendors contracted to support the SF Planning Department's permit portal.

The timing matters. The city is in the middle of a court-enforced housing production ramp-up under state housing law, and the SF Planning Department on Bryant Street has been under pressure to cut permit-approval backlogs. Duplicate images clogging the department's document management system — where the same site photograph or elevation drawing gets uploaded multiple times — have been identified internally as one factor slowing automated routing of permit applications through the queue. Every redundant file that has to be resolved by a staff member is time not spent approving a unit of housing.

What Happened This Week

On July 1, the city's Department of Technology published an updated procurement notice on the SF City Partner portal seeking vendors experienced in large-scale digital asset deduplication for municipal records systems. The notice listed the target systems as the Planning Department's Accela permit platform and SFMTA's internal document archive, which covers everything from Muni rail maintenance logs on the Central Subway corridor to paratransit scheduling images. A response deadline was set for July 18.

Separately, SFMTA confirmed this week that it had begun an internal audit of media files stored on its SharePoint-based system, a project that staff at the agency's South Van Ness Avenue headquarters had been pushing since at least early 2025. The audit is focused on infrastructure inspection photos, many of which were duplicated when SFMTA migrated legacy data during the Central Subway opening period. No vendor has been selected yet, and no cost figure has been made public.

At City Hall, the Controller's Office has flagged digital storage inefficiency as a line-item concern in its most recent citywide technology review. Cloud storage costs for San Francisco's municipal systems have risen alongside the broader migration away from on-premise servers — a shift accelerated after the pandemic. Industry benchmarks from the public sector suggest that unmanaged duplicate records can account for between 20 and 40 percent of a government agency's total document storage volume, though the city has not published its own audit figure.

Why Local Advocates Are Watching

The duplicate-image cleanup effort has drawn attention from civic-tech advocates at groups like Code for San Francisco, the volunteer brigade based out of coworking space in SoMa that has long pushed for cleaner open data infrastructure. Members have noted that the city's DataSF portal — which publishes planning, zoning, and permit records for public use — has also been affected. Searches for specific parcels in neighborhoods like the Outer Sunset or Excelsior have at times returned multiple identical document thumbnails, making it harder for residents and developers to verify what's on file.

San Francisco's housing emergency declaration, renewed earlier this year, puts the city on a legally binding timeline to approve a target of roughly 82,000 new units by 2031 under its Regional Housing Needs Allocation from the state. Any administrative drag — including records bottlenecks caused by duplicated files — gives state housing officials grounds to scrutinize the city's compliance pace. The Planning Department has been trying to hire additional permit technicians and automate more of the intake process, but automated systems fail or flag errors when they encounter redundant attachments in the same application record.

Residents and developers with active permit applications on file with SF Planning are advised to log into the city's online permit portal and verify that their submitted documents appear as single, clean attachments rather than repeated uploads. The Department of Technology has a public help line at its Seventh Street office for residents who encounter errors. The vendor selection process for the broader deduplication project is expected to conclude by late August, with any remediation work likely running through the end of the calendar year.