L.A. Leads Cities in Purging Duplicate Images from Public Records — But the Gap Is Closing

Los Angeles city archivists and IT administrators have quietly completed the first full audit of the municipal image database since 2023, removing more than 340,000 duplicate photographs and scanned documents from systems managed by the Bureau of Engineering and the Department of City Planning. The cleanup, which wrapped in late June, frees roughly 18 terabytes of server space that officials say will be redirected toward 2028 Olympic infrastructure planning files and wildfire-mapping overlays for the San Gabriel Valley corridor.

The timing matters. With the city running parallel data pipelines for Karen Bass's Inside Safe homelessness initiative — which photographs encampment sites before and after interventions — and the ongoing rebuild of permit-management software at the Figueroa Street Planning headquarters, redundant image files have been quietly inflating storage costs and slowing database queries for field workers in places like Skid Row and Boyle Heights. Duplicate images aren't a glamorous problem, but in a city managing hundreds of thousands of active permits and case files, they carry real operational weight.

How L.A. Compares to Other Major Cities

Los Angeles began deploying hash-based deduplication software — technology that assigns a unique fingerprint to every image and flags copies — across city departments in fiscal year 2023-24, making it one of the earlier adopters among large North American municipalities. Chicago's Department of Innovation and Technology rolled out a comparable system in late 2024, focused initially on police body-camera footage archives. New York City's Department of Records and Information Services has an ongoing digitisation contract but has not publicly completed a citywide image deduplication sweep as of this writing.

Internationally, London's Government Digital Service has published guidance on image deduplication for borough councils since 2022, and several London boroughs including Hackney and Southwark have implemented automated tools. São Paulo's municipal government, working under a digital transformation program launched in 2023, has focused primarily on civil registry documents rather than planning or infrastructure imagery. Seoul's Smart City Division, by contrast, has integrated deduplication directly into its urban data platform, reportedly cutting redundant geospatial imagery by more than 60 percent across district offices — a benchmark that Los Angeles officials have cited in internal planning documents reviewed by The Daily Los Angeles.

What sets Los Angeles apart, at least for now, is the breadth of the sweep. The city's Geographic Information Systems division at the Edward R. Roybal Federal Building area, along with contractors working out of the El Monte data center, ran the deduplication process across seven separate departmental repositories simultaneously. Most comparable cities have tackled one department at a time. The Bureau of Engineering alone held more than 90,000 flagged duplicates related to street-reconstruction photography from the Vision Zero program on corridors including Vermont Avenue and Cesar Chavez Boulevard.

What Comes Next for the City's Data Infrastructure

The practical upshot for Angelenos is incremental but real. Planning department staff processing permit applications in neighborhoods like Silver Lake and Highland Park should see faster image-retrieval times when pulling inspection records. The city's 311 system, which logs photographs attached to service requests, is the next target — officials have set a September 2026 deadline for running deduplication across that archive, which has grown substantially since the system was expanded during the pandemic.

The broader push also connects to Olympic preparation. The LA28 organizing committee has an information-sharing agreement with several city departments, and bloated image databases complicate the data handoffs required to coordinate venue permitting, transportation planning, and security documentation. The International Olympic Committee's technical standards require host cities to maintain clean, queryable records systems, and data auditors are scheduled to assess L.A.'s compliance in the first quarter of 2027.

For residents, the most direct takeaway is that the city is asking departments to establish image-submission standards before files enter the system rather than cleaning up afterward. The Department of Building and Safety has begun requiring standardized file naming and resolution specifications for all contractor-submitted inspection photographs as of May 1, 2026 — a policy shift that, if it holds, should reduce the deduplication burden considerably when the next audit cycle comes around in 2028.