REFLEX Data Pipeline & REFLEXplorer

1 September 2022 Web App
Actively developed

The software backbone of the REFLEX project: a document-AI and NLP pipeline turning 140 years of scanned Swiss commercial registry into structured, geocoded data, and a web platform to explore it

Overview

The REFLEX project sets out to reconstruct 140 years of Swiss business activity from the Swiss Official Gazette of Commerce, a daily publication that has recorded business events — foundings, relocations, incorporations, acquisitions, bankruptcies, trademark registrations — since 1883. The source material is an archive of around 600GB of scanned documents, in which every fact of interest sits in semi-structured multilingual text.

Two pieces of software carry that work. The REFLEX Data Pipeline converts the scanned archive into structured, queryable data. REFLEXplorer is the web platform that makes the result usable by the economists, lawyers, and political scientists in the consortium.

The Data Pipeline

The pipeline is a chain of document-AI and NLP stages, each of which has to cope with a corpus whose layout and language change over more than a century of publications.

The document-AI end handles the scans: identifying which pages carry the material of interest, like the commercial registry entries, and then locating the region of a page corresponding to a single registration event, and extracting the text of that event. The NLP end turns those texts into facts, drawing on the usual components of a modern pipeline — tokenization and lemmatization, named entity recognition, coreference resolution, dependency parsing — with large language models plugged in where they help.

On top of extraction sits the harder problem of reconstruction: matching firms and people across events separated by decades to build coherent entity histories, geolocalizing firms from the addresses recorded in their events, and inferring demographic attributes from names. The output is a dataset of Swiss economic history that exists in no other form.

REFLEXplorer

REFLEXplorer exposes the extracted data as a searchable platform rather than a data dump. Its purpose is to serve the qualitative side of the research alongside the statistical one: finding a firm and following its history, tracing the people attached to it, and moving between the structured records and the scanned pages they were extracted from.

The platform is built on a GraphQL API over the pipeline’s PostgreSQL store, with Keycloak handling identity and access and MinIO serving the document archive behind the extracted records.

Status

Both are under active development. The project runs to 2027, and the pipeline continues to be extended to properly reconstruct company histories and networks of companies and people. At the moment, the platform is intended for internal use and it has been released only to the people from the consortium.

Publications

27 August 2025 Paper
9087 words · 46 minutes

Mining a Century of Swiss Trademark Data

This paper presents an approach for extracting trademark registration events from the Swiss Official Gazette of Commerce (SOGC), an official daily journal published by the Swiss Confederation since January 1883. Until 2001, the data is only available as scanned documents, which constitute the target dataset of this study. Our approach is composed of a chain of three steps based on state-of-the-art deep learning techniques. We leverage image classification to identify pages containing trademarks (macro segmentation); we apply object detection to identify the portion of the page corresponding to a registration event (micro segmentation); last, we perform information extraction using a document AI technique. We obtain a dataset of ca. 500,000 trademark registration events, extracted from a corpus of 430,000 pages. Each step of our workflow has relatively high accuracy: the macro and micro segmentation steps show precision and recall greater than 95% on a manually constructed dataset. The dataset offers a unique historical perspective on trademark registrations in Switzerland that is not available from any other source. Showcasing what can be achieved with the extracted information, we provide answers to a set of preliminary economics questions.

Mining a Century of Swiss Trademark Data
14 March 2024 Developer Talk

NLP Ă  la Suisse

Voxxed Days ZĂĽrich 2024