City Agencies and Local Nonprofits Push to Solve the Duplicate-Image Problem Plaguing SF's Housing and Homelessness Databases

San Francisco's Department of Homelessness and Supportive Housing and the Planning Department both spent time this week wrestling with a problem that sounds mundane until you see its effects: thousands of duplicate images clogging the city's case-management and permitting databases, slowing down decisions about shelter beds, housing permits, and building inspections at a moment when the city can least afford the delays.

The issue surfaced publicly on Tuesday, July 1, when the Planning Department's online portal for building permit applications went down for roughly four hours during peak morning submission time. City IT staff traced the outage in part to redundant image files in the backend database — the same photograph of a property facade or floor plan uploaded multiple times under slightly different file names, creating storage and retrieval conflicts that cascaded into a full system timeout.

Why This Week Was a Turning Point

The portal outage came at a particularly bad moment. The city is under a state-mandated deadline to approve or deny a backlog of roughly 1,400 housing permit applications by the end of August, a pressure that grew out of Sacramento's Housing Accountability Act enforcement mechanisms. Any day of system downtime pushes that deadline closer to impossible. Staff at the Permit Center on 49 South Van Ness Avenue, which handles walk-in filers in addition to online submissions, reported a lobby backup of about 60 people when the portal restored service that afternoon.

The Department of Homelessness and Supportive Housing faces a parallel version of the same headache. Its Coordinated Entry system, which matches unhoused individuals to shelter beds and supportive housing units across the city, stores intake photos and identification documents. Over time, duplicate image uploads — often created when caseworkers re-scan documents during follow-up appointments — have bloated the system and, in at least some cases, caused the software to flag individuals as having multiple open cases, potentially freezing their placement in the queue. The department has not publicly released a figure for how many records are affected, and a spokesperson did not respond to a request for comment by press time.

On Wednesday, the Mayor's Office of Housing and Community Development convened a working session at City Hall, Room 421, with representatives from the Planning Department, DBI (Department of Building Inspection), and HSH. The meeting was listed on the city's public calendar. The goal, according to the agenda posted online, was to align on a shared de-duplication protocol before each department pursues its own vendor solution — a fragmented approach that burned money during a similar data-cleanup effort in 2022, which cost the city an estimated $1.2 million without fully resolving the underlying workflow problem, according to a Controller's Office audit released that year.

What the Tech Sector Brings to the Table

San Francisco's still-active tech community, particularly the cluster of AI startups operating out of the Mission District and SoMa, has been circling this problem. Several companies specializing in automated image-deduplication tools have contacted city procurement offices in recent months, according to the public bid solicitation log on the Controller's website. At least three formal requests for information were posted before June 30, suggesting a formal RFP could follow before the end of the fiscal quarter.

The irony is hard to miss. The same AI boom that has refilled office towers along Market Street and drawn venture capital back to the city after two years of tech-sector layoffs has produced off-the-shelf tools that could, in theory, scan and deduplicate a municipal photo database in days rather than months. Whether the city's procurement process moves fast enough to take advantage of them is a separate question entirely.

For residents waiting on permits in neighborhoods like the Outer Sunset and Excelsior, where many of the backlogged applications involve accessory dwelling unit construction, the practical advice for now is to check the 49 South Van Ness portal status page before submitting large image files, keep file sizes under 10 megabytes, and call 628-652-3200 to confirm receipt rather than re-uploading documents that appear to have stalled. The Planning Department posted those guidelines on its website Thursday morning. The next interdepartmental working session is scheduled for July 14.