· Fabian Schreuder · Data Science Projects  · 4 min read

From Food Labels to Reusable Ingredient Data

How our team built a traceable reference corpus and tested a human-in-the-loop workflow for linking Dutch food ingredients to FoodOn and ChEBI.

How our team built a traceable reference corpus and tested a human-in-the-loop workflow for linking Dutch food ingredients to FoodOn and ChEBI.

Food and nutrition research often combines data about products, nutrients, consumption, contaminants, and sustainability. To join those datasets reliably, they need to refer to the same ingredient in the same way. Product labels make that harder than it sounds: ingredient names vary, compounds contain sub-ingredients, E-numbers stand in for additive names, and processing details can change what a label means.

For the Auto-NICE project at RIVM, our team built a reference dataset and tested an automated workflow for linking Dutch ingredient declarations to shared concepts. FoodOn provides identifiers for food materials, while ChEBI is used for chemical substances. The goal was to make these decisions consistent and traceable, and to learn where automation helps and where a curator still needs to step in.

Building a Reference People Can Review

Working with Jens Ruhof and Tadeusz Price, I helped create a reference corpus of 192 product–ingredient occurrences from 81 meat and fish alternative products. An occurrence is a particular ingredient in a particular product, so repeated ingredients keep their product context. The corpus preserves the original label, its normalized form, compound context, annotator decisions, expert adjudication, and provenance.

We classified the entries into six groups: compound sub-ingredients, food additives, fortificants, commodity ingredients, industrially modified ingredients, and flavouring substances. These groups capture different linking challenges, from familiar ingredients such as flour to more specialized ingredients such as isolates and flavourings. Difficult food-domain decisions were reviewed by a nutrition expert, and the original votes were retained so later users can see how each reference decision was reached.

From a Dutch Label to a Candidate Concept

The workflow treats ingredient interpretation and ontology linking as a sequence of reviewable steps:

  1. Standardize the label. The workflow cleans ingredient text while keeping the parent compound and product context, which help define what each ingredient occurrence means.
  2. Resolve stable terms directly. E-numbers and expert-curated mappings use deterministic lookups where possible.
  3. Search for concepts. For other ingredients, Qwen3 embeddings and a FAISS index retrieve candidate FoodOn concepts from the standardized query.
  4. Select or abstain. A language model reviews the candidate labels, definitions, and ontology context, then chooses an option or makes no choice. It cannot recover a correct concept that was missing from the candidate list.

Keeping search separate from selection is useful for understanding errors. If the right identifier never appears among the options, asking a second model to reconsider the same list will not solve the problem. The workflow also retains the evidence behind each decision so a curator can review, correct, or reject a proposed mapping.

What the Evaluation Showed

The full automated test used saved system outputs for 159 non-E-number occurrences. A comparison with at least one original annotator choice was possible for 144. Search included an identifier chosen by an annotator for 100 of those 144 rows (69.4%). When search had included a human choice, the final system choice agreed with an original annotator in 65 of 100 cases (65.0%). These are agreement measures, not independently verified accuracy scores: annotators sometimes disagreed, and some decisions were later adjudicated.

The system proposed an identifier for 114 of the 159 rows (71.7%). That measures how often it returned an answer, not whether the answer was correct. On the 93-case benchmark of deliberately difficult, expert-resolved examples—79 of which also appear in the full test—28 mappings (30.1%) exactly matched the reference. In 43 of the 65 errors, the correct identifier was missing from the search results; in the other 22, it was available but the system selected another option.

The difficult cases also show why an automated warning should not be treated as proof that FoodOn is missing a concept. Expert review found an acceptable standardized concept for 54 cases, classified 31 as search gaps and six as granularity mismatches, and identified one class-versus-attribute issue and one likely ontology gap. The broader automated test flagged 34 possible gaps; those flags are a review queue, not confirmed ontology deficiencies. Many apparent ontology problems can begin earlier, with how a label is normalized or which candidates are retrieved.

A Curation Assistant, Not an Automatic Mapping Service

The strongest contribution of Auto-NICE is a reusable reference corpus, explicit annotation rules, and a benchmark that makes future changes easier to assess. The prototype can prepare candidate mappings and highlight cases for review, but its results do not support unattended acceptance. Ingredient standardization and candidate search are the first areas to improve; the report recommends measuring those stages directly before investing in another reasoning model.

The current work addresses ingredient identity. It does not estimate ingredient quantities or population exposure, and its products were selected to develop rules for complex labels rather than to represent every food category. Those remain important next steps. For now, Auto-NICE provides a traceable way to turn inconsistent label text into structured decisions that food-data curators can examine and improve.

Back to Blog

Related Posts

View All Posts »
When Should AI Ask About Your Meal?

When Should AI Ask About Your Meal?

For my MSc thesis, I built Snap and Say, a food logging app that uses photos, voice, and selective follow-up questions to balance nutritional detail with ease of use for older adults.