[Im4ca-wp1.beta] IM4CA WP1 Romania campaign data and metadata format for ICOS Carbon Portal

Fri Apr 24 15:05:35 CEST 2026

Hello everyone, 

thanks a lot to those who already sent me their details for data submission to the Carbon Portal and examples of already existing data! The others, please send me needed files and information at the beginnig of the next week, as I wish to send those information to ICOS CP on Tuesday. 

Best, 
Sara 

From: "Sara.Defratyka" <sara.defratyka at lsce.ipsl.fr> 
To: "im4ca-wp1 beta" <im4ca-wp1.beta at listserver.vu.nl> 
Sent: Thursday, 16 April, 2026 12:28:42 
Subject: Re: [Im4ca-wp1.beta] IM4CA WP1 Romania campaign data and metadata format for ICOS Carbon Portal 

Hello everyone, 

based on the last week meeting with ICOS Carbon Portal, regarding data submission for Milestone 1.1 "First EU campaigns datasets", could I ask EACH TEAM to send me details of person who will be invovled from your side for preparation and data submission of data for ICOS Carbon Portal ? Adding those peopel to the system takes some time so it's good to work on it now. I will need: 
- name, 
- emial adress, 
- Orchid number. 

Also, could I ask each team involved in Romania camaping to send me one example of your "ready to publish data" from previous camapings using the same instrument and methodology as you are planning to use during Romania campaing? I will send it further to the person from ICOS CP so they check it and suggest in which direction we should go to make it acceptable for ICOS CP. 

Additionally to the example of data description reports, which I sent some time ago, I'm sending also examples of accepted dataseries on ICOS CP . Please check them and discuss internally within your teams how (and if) your data can be adapted to example format. 

Please come back to me with those information and data until next Thursday, 23.04. 

Best, 
Sara 

From: "Sara.Defratyka" <sara.defratyka at lsce.ipsl.fr> 
To: "im4ca-wp1 beta" <im4ca-wp1.beta at listserver.vu.nl> 
Sent: Monday, 23 March, 2026 10:26:33 
Subject: Re: IM4CA WP1 Romania campaign data and metadata format for ICOS Carbon Portal 

Dear all, 

I'm coming back to the topic of metadata and data, which I started couple of weeks ago. Thanks a lot to Dylan from UU and Stefan from INOE who already volounteer! I think we still need at least one person from aircraft measurement for more effective work. 

In the meantime, could I ask EACH TEAM to fill the list of used instrument durign the camaping, until end of this week 27th of March ? I also added two additioanl columns there (1. in-situ/remote sensor and 2. type of instrument output data), for better preparation of data and metadata format. So, even teams who already filled the form should come back to it and add those details. The spreadsheet is here 
[ https://vu.data.surf.nl/f/222416134 | https://vu.data.surf.nl/f/222416134 ] 

Within the smaller working group, we will have a meeting in the first half of April with Maggie from ICOS CP, to discuss the topic in details. So far I got some more information which everyone should get familiar with and you can find them below. Let me know if you have any questions/concerns and we will discuss it with Maggie. 

Best, 
Sara 

- can submited data be in csv format, in zip package if necessary 

In principle, the data you send in can be in any format, as we usually treat non-ICOS-standard data files as zip archives. The only cases where we demand certain file formats (and variable names etc.) are whenever the data should be previewable at the Carbon Portal – that is only supported for a few very specific types of data files. Burt let’s discuss this more! 

-can we submit 0 level data ( e.,g raw non-calibrated) and if needed submited calibrated updated data later? If we submit updated data, will they get the same reference number and link as initially submited data? 

In general, project data should be Level 2 (fully quality controlled) or Level 3 (elaborated products, such as model outputs) for us to host it. For IM4CA, this is what is mentioned in the project Data Management Plan. Indeed, the Carbon Portal typically does not curate and manage “raw” (Level 0) data that come from non-ICOS sources. But if project data has undergone at least automated basic quality control (as well as temporal aggregation, if applicable) to reach Level 1, and is considered by you to be ready to be shared publicly , we can consider to help you. 

Regarding versions, each object that we upload will be uniquely identified by a basic Handle persistent identifier based on its checksum. If an object is updated, we keep the original version but marl it as being superseded (“deprecated”) by the update. Some datasets will also be assigned a DOI number. For those, we decide on a case-by-case basis whether to reuse the original DOI or assign a new one. QAgain , let’s discuss this in more detail. 

- during campaing we will visit a lot of sites, using a lot of different techniques. What are your recommendation about data harmonizing and submission? Should we submit one file of data per instrument per day? Or maybe divide it based on visited sources? What harmonization approach should we take for data measurement by different instruments which are analysed togheter (e.g., CH4 instrument, GPS and anemomenter )? 

Here there is no “one size fits all” approach; as long as the approach is well documented there is room for many different solutions – also within a campaign, as the various types of observations and instrumentation must be considered separately. My thinking is that there should be a focus on what any end users of the data would want, and decide the strategy and structure based on that. 

- what is recomend denotation for flagging data? Should flagged data stay in the submitted dataset? 

For Level 1 and Level 2 data, it is always preferable to include Flag values. 

- Should names of variables be consinstent between different instrument? I assume sometimes it cannot be possible to achieve 

That is not necessary, but variable and/or column names inside data files should as a rule be at least indicative of what they contain. (Avoid “variable1”, “variable2” or using e.g. “ch4” to mean different things in different types of data (i.e. flux in one file and mole fraction in another). Again, this should be clearly described in the accompanying documentation! 

- Can different data sets be submitted in separate time by different people (e.g., data colelction per involved institution)? 

Yes, sure. We have to discuss the procedures here, and divide responsibilities wisely. But since I would propose that daily L0 data are not sent to the Carbon Portal but rather be stored in your Research Drive, the would leave a smaller number of L1 and L2 objects – and if there aren’t too many of these, I can take care of the actual uploads as long as you provide the necessary metadata. Let’s talk more about this as well! 

From: "Sara.Defratyka" <sara.defratyka at lsce.ipsl.fr> 
To: "im4ca-wp1 beta" <im4ca-wp1.beta at listserver.vu.nl> 
Sent: Wednesday, 11 March, 2026 13:35:21 
Subject: IM4CA WP1 Romania campaign data and metadata format for ICOS Carbon Portal 

Dear all, 

As you may know, Milestone 1.1 (First EU Campaigns Datasets Published) is due one month after the Romania campaign . To facilitate progress on this task, I propose that we start working on the data and metadata format now, with the goal of finalizing the template before the campaign. This should help streamline the data submission process to the ICOS Carbon Portal (ICOS CP) after the campaign. 

I have already contacted ICOS CP and obtained two example reports as good practice references. You can find these attached, along with the IM4CA Data Management Plan and Deliverable 1.1 , which can serve as a starting point for data description in Milestone 1.1 . These documents are also available on the shared drive of WP1 in the "Milestones" folder. 

The aim is to create a template that is as user-friendly as possible for us while ensuring it meets ICOS CP’s requirements. To begin, I propose forming a small working group with one representative per measurement technique (car, drone, aircraft, stationary EM27, stationary CRDS). Over time, we may need to expand the group—for example, to include one representative per institution —but we’ll assess this as we progress. 

Once we make significant progress within this small group (with support from ICOS CP ), I will update the rest of WP1 to keep everyone informed while minimizing unnecessary emails and meetings. 

If you are interested in joining this working group, please reply to this email. I understand that everyone is very busy, so I will keep the workload on this part of the Romania campaign as light as possible. 

Best, 

Sara 

-- 
Dr Sara Defratyka 
orcid.org/0000-0002-9488-4518 
LSCE - UVSQ 
Bât 714 P1115 
Orme des Merisiers 
91191 Gif-sur-Yvette 

[Text File:ATT00001] 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://listserver.vu.nl/pipermail/im4ca-wp1.beta/attachments/20260424/ea74bf5c/attachment-0001.html>