'My History Just Disappeared': SF Residents Speak Out on Duplicate Image Removal from City Archives

Dozens of San Francisco residents have spent the past several weeks discovering that photographs submitted to city-run digital repositories have been quietly deleted — flagged as duplicates by automated software and removed without notice. The losses range from neighborhood planning submissions in the Tenderloin to community mural documentation filed with the San Francisco Arts Commission, and they are hitting longtime residents and nonprofit workers especially hard.

The problem surfaced publicly in late June when staff at the Tenderloin Museum on Turk Street noticed that a batch of oral-history photographs submitted to the city's Community Heritage Archive program in March had vanished from the public-facing portal. Administrators at the museum, which has spent years preserving the history of one of San Francisco's most vulnerable neighborhoods, discovered the images had been tagged as duplicates of lower-resolution versions already in the system and automatically purged during a database consolidation process.

For the people those photographs represent, the loss is not abstract. Longtime Tenderloin residents and workers at organizations along Leavenworth Street and Ellis Street describe submitting images specifically because they feared losing them — and now those copies, often the only high-resolution versions, are gone.

A Problem Rooted in Speed and Automation

The consolidation is part of a broader city effort, launched in January 2026 under the Department of Technology's Digital Services Modernization Initiative, to reduce redundant data storage across more than 40 municipal databases. City officials have said the effort is designed to cut storage costs and streamline public access. The deduplication algorithm, however, was not configured to distinguish between files with identical names or metadata but different content — a flaw that allowed high-quality originals to be deleted when older, lower-resolution versions were already on file.

The San Francisco Public Library's SF History Center at Larkin Street, which maintains its own archive separate from the city's consolidated system, was not affected. But community organizations that submitted materials through the city's online portal — including neighborhood planning groups in the Mission District and the Western Addition — are reporting similar gaps.

SF Heritage, the preservation nonprofit based on Sutter Street, has been fielding calls from member organizations since mid-June. Staff there have documented at least 14 separate cases in which submitted image sets appear to have been partially or wholly removed. For some groups, the affected files included documentation of murals, storefronts, and community events that predate the smartphone era and had no digital backup elsewhere.

What Residents and Groups Are Doing Now

The practical situation is difficult. The city's Department of Technology confirmed in a brief statement posted to its website on June 27 that a deduplication process had been completed across the Community Heritage Archive system, and that a review process was underway. It did not specify how many files were affected, how many had been permanently deleted versus placed in a recoverable archive, or what timeline residents could expect for resolution.

Nonprofit technology advisers are recommending that any organization or individual who submitted photographs to the portal before June 1, 2026, log in immediately to verify their holdings. Groups that still have local copies of their original files should preserve them and document the discrepancy before filing a recovery request through the Department of Technology's service portal, which accepts submissions at sf.gov/departments/city-administrator/digital-services.

The episode is drawing renewed attention to the city's broader challenge of modernizing aging digital infrastructure without adequate community input. San Francisco's 2025-26 budget allocated roughly $4.2 million to the Digital Services Modernization Initiative across two fiscal years — a figure critics say was insufficient to fund the human review work that automated deduplication requires to protect irreplaceable materials.

For now, the Tenderloin Museum and several other affected organizations are cross-referencing physical records and personal hard drives to piece together what was lost. Some of it cannot be recovered. July 4 falls on a Saturday this year, giving many residents a long weekend — but for the people working the phones and searching backup drives in offices along Turk Street, there is little to celebrate.