Accepted on 12 Oct 2021
Submitted on 17 Jul 2020
The Data Management Plan (DMP) was introduced to document and publish both data management practices and policies that are applied to data throughout its lifecycle. This implies describing the techniques, methods and policies on how data is to be created, collected, documented, processed, accessed, preserved, disseminated as well as the roles and responsibilities of associated actors (Michener, 2015).
The premise behind the concept of a machine-actionable DMP (maDMP) is that information contained within a DMP can be enacted both by humans and automated systems, thus addressing some of the limitations associated with traditional DMP documents. To that effect, data management workflows should integrate maDMPs and data management policies should take into account not only human agents but also machines. maDMPs should support both human and machine-processable representations so they act as an interchange format for dissemination and public access of the maDMP (Simms et al., 2017). In order to provide a machine-actionable representation of a maDMP, it becomes necessary to establish a standardised representation of the maDMP. The Research Data Alliance (RDA)1 DMP Common Standards (DCS) working group (Miksa, Cardoso, and Borbinha, 2018; Miksa, Neish, et al., 2018; Miksa, Walk, and Neish, 2019) developed an application profile making it easier to express information from traditional DMP documents in a machine-actionable way. The DCS maDMP application profile allows for automatic exchange, integration, and validation of information provided in DMP documents. Thus, facilitating the exchange of information between systems acting on behalf of stakeholders involved in the research life cycle, such as researchers, funding bodies, repository managers, ICT providers, librarians, etc.
This paper reports on a hackathon organised by the DCS working group, which had as main motivation to promote the adoption of the maDMP concept by the research community, and, in particular, the usage of the DCS application profile for interchange of maDMPs. To that effect four main areas were identified: (1) serialisation, to encourage community development of serialisations of the DCS application profile; (2) integration of DMP tools, to promote the compliance or usage of the DCS application profile in the existing DMP tools used by the community; (3) further integration, aimed at the integration of the DCS application profile with existing data management tools and workflows; and (4) funder templates mapping, where existing DMP modules and representations were to be aligned with the concepts in the DCS application profile.
By focusing on these four areas, the hackathon aimed at achieving three primary objectives: (1) to broaden the community focused on maDMPs, (2) to expand the support for maDMPs, and (3) to expose the growing endorsement on the adoption of the DCS application profile in a wide range of settings, enabling exchange of DMP specific information in a machine-actionable way. In order to achieve these objectives, participants were encouraged to both submit topics and form hacking teams. After the hackathon activities were finished, participants were asked to report their results, by compiling individual topic reports.
The main aim of this paper is to familiarise readers with the recent developments in the field of maDMPS, by summarising and providing pointers to results, projects, and prototypes developed during the hackathon. The paper provides also context on how the results from the hackathon were produced to allow the readers to better interpret the achieved results in view of constraints, e.g. distributed nature of collaboration, many participants not being originally involved in the recommendation development, limited time to produce results, etc.
The remainder of the paper is organised as follows. Section 2 describes the maDMP hackathon by providing a characterisation of both the organisation of the hackathon and its participants. Section 3 details the submitted topics and provides a short summary of objectives and results per topic. Section 4 reports on the experiences from organising and participating in a virtual online hackathon and importance of maDMPs for Open Science. Finally, Section 5 describes the conclusions drawn from the hackathon as well as points that can be tackled in the future.
With the idea of broadening the maDMP community, improving the current DCS application profile and promoting its adoption, a hackathon was organised from the 27th to the 29th of May 2020. A hackathon is a programming-oriented event where participants gather together to collaboratively work at an intensive pace towards possible solutions to some particular challenges (Briscoe, 2014; Garcia et al., 2020; Stoltzfus et al., 2017). Such solutions are created by interdisciplinary teams including, for instance, domain experts, designers and developers. In additions to open source projects, either at a prototype or production level, hackathons also boost medium to long term collaborations, with hacking teams typically continuing to work on the proposed solutions as well as follow up solutions, past the original timeline of the event (Briscoe, 2014; Garcia et al., 2020). Following RDA common practices, the maDMP Hackathon was announced via mailing lists and advertised via Twitter. The registration was open to everybody from newcomers to experts, with participants being given a period of five weeks to both register and submit topics to be addressed during the hackathon.
In order to comply with the open access principles, information regarding topics, teams and activities was made publicly available on GitHub.2
The hackathon followed a self-organising spirit, with participants being free to propose topics and establish teams, which all participants were open to join. The teams had time to propose topics before the start of the event in a collaborative spreadsheet. The hackathon was opened by the the kick-off meeting in which participants discussed the previously collected topics and had a chance to better understand the scope of work proposed for each of them. Based on that they were able to join selected groups.
During the hacking days, participants used Slack, a communication platform for teams, so people within and across teams could easily discuss their ideas. Every team usually held several video meetings – depending on their preferred working mode. Everyday there was an open video meeting for all teams in which every team reported on their progress and thus everyone had a chance to ask questions and provide feedback.
The hackathon was concluded by the wrap-up meeting to present and discuss results produced by each group. The results of each team are published individually on zenodo and are referenced in this paper. The video with a recording of the “Grand Finale” in which every group discusses the outcomes is also available on GitHub.
In total there were 89 participants that registered to attend the hackathon. Participants were associated with institutions from 21 distinct countries, see Figure 1. In terms of gender, see Figure 2, there were 53.9% male and 46.1% female participants (corresponding to 48 men and 41 women), a 7.8% difference between genders. Concerning participant engagement in teams, as can be seen in Figure 5, 60.7% of registered participants opted to join a team, with only 39.3% of registered participants opting not to join (corresponding to 54 joiners to 35 non joiners). Team members represented institutions from 14 different countries, see Figure 3. In terms of gender, see Figure 4, there were 56.4% male and 43.6% female participants (corresponding to 31 men and 24 women), a 12.8% difference between genders. In regard to community engagement, the 66.3% of registered participants (59 participants) were not members of the DCS working group, whilst 33.7% (30 participants) were registered members of the DCS working group, as seen in Figure 6.
Institution nationality of registered participants.
Gender distribution of registered participants.
Institution nationality of team members.
The gender distribution of team members.
Registered participants engagement with teams.
DCS community members in the maDMP hackathon.
There were a total of 12 topics addressed in this hackathon. Topics were distributed according to the four main areas of application, that were identified based on the overall motivation for the hackathon, (see Table 1). The areas of application were: (1) serialisation; (2) integration of DMP tools; (3) further integration; and (4) funder templates mapping.
Table 1
Overview of team topics.
| FOCUS AREA | TEAM | TOPIC |
|---|---|---|
| Serialisation | The Unaturals | New version of the DMP Common Standard Ontology (DCSO) |
| Integration of DMP tools | DSW | Data Stewardship Wizard Import and Export, FAIR Implementation Profiles |
| The Datatypists | Add data types and design support for datasets to make EasyDMP more compatible with the DCS application profile | |
| DMP Exchange | Exchange DMPs between DMP Tools using the DCS application profile | |
| RDMO | maDMP export from RDMO | |
| DMP Ninjas | Import and Export maDMPs from the Argos/OpenDMP tool | |
| Further integration | maDMP Link | Integration of Converis CRIS/RIMS with DMPRoadmap, and establishing maDMP export/import from Figshare |
| InsTmaDMP | Aligning research data management workflows and the DCS application profile | |
| Something | Integration of the DCS application profile in project data management workflows | |
| DMP InvenioRDM | Integrate InvenioRDM with the DCS application profile | |
| Funder template mapping | TigTag | Mapping of the DCS application profile to funder DMP templates |
| Fancycatmeme | Integrating maDMPs in the Linked Data Pipeline as part of Research Data Connectome | |
By definition, the DCS application profile was always intended to have multiple serialisations. In this hackathon, participants were encouraged to submit topics that would tackle the creation of new or upgrade existing serialisations. There was only one topic submitted that aligned with the serialisation area of focus. The objective of the Unaturals team was the creation of a new version of the DMP Common Standard Ontology (DCSO) (Cardoso, Ekaputra, et al., 2020). The DCSO is an existing serialisation of the DCS application profile that is expressed in RDF/XML. During the hackathon the team achieved the following results: (1) reorganisation of the existing DCSO by separating the core elements from complementary concepts such as countries or languages; (2) integration of concepts from third-party ontologies into the DCSO; and (3) establishing a set of basic Shape Expressions (ShEx)3 constraints for the DCSO, which can potentially be used to check the conformance of DCSO represented DMP documents, with the DCS application profile specification.
The integration of DMP tools area is motivated by the need of promoting compliance and usage of the DCS application profile throughout the DMP tools in use by the research community. Five teams submitted topics that matched this focus area, and overall, these topics tackled 6 DMP tools.
The Data Stewardship Wizard (DSW)4 is a DMP tool that guides researchers into creating their DMP documents. The objective of the DSW team was to equip the DSW with the ability to use the DCS application profile as an interchange format. This implied having the ability to both import and export maDMPs that were compliant with the DCS application profile. The objective was achieved, with the latest version of the DSW now being able to import JSON maDMPs and export maDMPs both in JSON, DCSO and in a human readable version (Suchánek et al., 2020).
EasyDMP5 is a DMP creation tool supporting simple and nested question types, organised in a linear structure. On the other hand the DCS application profile has simple and nested data types, in a tree structure. The objective of the Datatypists team was to represent any missing DCS application profile concepts as as question type in EasyDMP, and ponder how to encode the DCS application profile nested tree structures, such as the dataset type. The result of this topic was a revised design of the EasyDMP approach to represent the concepts, further detailed in the topic results report (Moa, Hasan, and Philipson, 2020).
The DMP Exchange included developers from the following DMP tools: DSW, EasyDMP, DMPOnline, DMPtool and Haplo.678 The objective of the team was to determine if the DCS application profile serialised in JSON could be used as an interchange format in various DMP tools, to do so, mappings across their internal DMP models were established, and the tools were equipped with the ability to both import and export maDMPs. Team members were able to update or create a mechanisms that allowed maDMPs to be exported by the participating DMP tools. However the objective of allowing for the import of maDMPs by the DMP tools was not totally achieved, as that requirement was only fulfilled by one of the tools (i.e. Data Stewardship Wizard). An extended description of results of this topic are presented in its results report (Faure et al., 2020).
The Research Data Management Organiser (RDMO)9 is an open source tool that helps institutions and researchers with planning and executing data management activities. It uses an internal vocabulary called “domain” to map and abstract the user’s input into questionnaires together with any other relevant information. The objective of the RDMO team was to map RDMO’s domain to the DCS application profile and then build an export functionality. The team was able to map most of the RDMO’s domain to the DCS application profile, and establish a prototype of the export functionality (Klar et al., 2020).
The OpenDMP software10 is a data management planning tool that was created by a consortium comprising OpenAIRE11 and EUDAT CDI.12 The OpenDMP tool has been implemented by two DMP tools, Argos13 and EasyDMP. The team focused on Argos, and had two objectives: (1) to implement an import and export function that would allow the usage of DCS application profile compliant maDMPs as an interchange format; and (2) to establish mappings between OpenAIRE Research Graph model (Manghi et al., 2019) and the DCS application profile. A description of results of this topic can be found in its results report (Tziotzios et al., 2020).
The further integration area was intended to cover topics whose objective was to integrate the DCS application profile into existing data management frameworks and workflows. Four teams submitted topics that matched this focus area.
The objective of the maDMP Link team was to enable both DMP Roadmap14 and Figshare15 to use the DCS application profile as an interchange format for maDMPs. The team was able to develop a prototype for Figshare, that allowed to both import and export maDMPs serialised in JSON (Zimmer et al., 2020).
The InsTmaDMP team aimed at analysing research data management (RDM) worfklows from four distinct research institutions. They opted to focus their analysis on the DMP creation processes of these workflows. The objective was to analyse the resulting DMP documents and identify any changes that would be necessary (i.e. addition, removal or editing of DMP concepts) to create DCS application profile compatible maDMPs. The result was a list of recommendations for changes in the analysed RDM workflows. A full detailed description of the results of this topic can be found in its report report (Karimova et al., 2020).
The Something team set themselves to analyse the data management workflows from the Climate Community in the EOSC-Nordic project,16 and establish mappings between DCS application profile and existing data management concepts. The objective was to be able to represent the data management workflows with DCS application profile compliant maDMPs. The team was unable to completely map the analysed workflows to the DCS application profile, and as such they considered creating an extension to the DCS application profile. The full results are available in the team’s results report (Hasan, Fouilloux, and Jacquemot, 2020).
The objective of the DMP InvenioRDM team was to establish mappings between the InvenioRDM17 data model and the DCS application profile. The team was able to map the DCS application concepts in the InvenioRDM data model, and developed a prototype that allowed for maDMP serialisations to be imported into InvenioRDM. The team results can be found in the results report (Wali et al., 2020).
The funding templates mapping area covered topics that aimed at establishing mappings between the DCS application profile and DMP representation models from institutions, funding bodies or other stakeholders in the community. There were a total of two teams that submitted topics matching this focus area.
The objective of the Tigtag team was to establish mappings between the DCS application profile to several of the DMP templates most commonly used by funding bodies. As DMP templates are typically a list of questions, the proceeded to analyse each individual question and map them to one or multiple matching fields in the DCS application profile. The result of this process was the proposal of an funder-extension to the DCS application profile that added a set of concepts that are required to completely map all of the analysed DMP templates, but are not present in the DCS application profile. The results are further detailed in the results report (Cardoso, Jones, et al., 2020).
The Fancycatmeme team had the objective of automating quality-control metrics in the Linked Data Pipeline18 for the Research Data Connectome.19 To accomplish this objective, the team first analysed a series of existing DMP documents and proceeded to create DCS application profile compliant maDMPs. Secondly, they provided a series or recommendations on how to approach the path to maDMPs for research institutions, funding bodies and other stakeholders in the ecosystem. The team results can be found in the results report (Rettig et al., 2020).
Our discussion revolves around two main topics: experiences from organising and participating in a virtual online hackathon and importance of maDMPs for Open Science.
Hackathons, aka CodeFests or Programming Sprints, are becoming more and more common within the scientific community, varying from a couple of days to a whole week. Depending on the length and number of people, logistics might differ. However, there are some common elements such as: defining goals, ensure a balanced and representative participation, use effective communication channels, promote a respectful environment, encourage team-building and self-organisation and include retrospective sessions (Garcia et al., 2020). Given the high degree of interaction, hackathons are commonly organised in face-to-face fashion. However, due to the COVID-19 pandemic in 2020, the maDMP hackathon, as most of the scientific events running at that time, was organised as a virtual online meeting.
One of the main challenges was keeping a high level of participant interaction. Organisers lead the common activities, namely pitching and wrap-up meetings, and made sure these were announced in advance by sending constant reminders and posting announcements in Slack. Repeating information multiple times to ensure that it reaches the target audience is a common practice, particularly in virtual events. Emoticons, animated GIFs and other eye-catching elements play an important role in virtual communication, as they convey emotions beyond the text. Organisers relied on team leaders for internal communication with participants joining their effort. Online meeting rooms and Slack were continuously used. As this was a two-day hackathon, keeping focus was not a main issue, participants were committed to (mostly) clear their agendas for two days so the could actively participate on their selected projects.
Finally, a post-hackathon survey was shared with participants. In total 13 participants provided answers to the survey, providing an overall positive feedback. It is relevant to highlight the participant responses on four of the survey questions: (1) On the overall assessment of the event, the majority (69.23%, 9 participants) of survey responses rated the event as being either “very good”; (2) On its organisation, the majority (61.54%, 8 participants) of survey responses rated the event’s organisation as “very organised”; (3) On its length, the majority (76.92%, 10 participants) of survey responses rated the event’s duration as “about right”; and (4) on the likelihood of participating in similar future events, the majority (61.54%, 7 participants) of survey responses described the likelihood of participating in a similar event as “extremely likely”.
Open Science advocates for open access to research objects (e.g. data, software, workflows, DMPs); however, open access on its own is not enough to ensure reproducibility and advance science, two of the aims of Open Science (Ali-Khan et al., 2018). Effective open data access requires researchers producing data to accompany their data with a DMP as it covers the whole data cycle, from collection to archival, and includes guidance on how to use this data in the future. As it happens with any other research object, DMPs should include enough metadata for them to support the FAIR principles (Wilkinson et al., 2016). Given the amount of steps covered by DMPs and the metadata involved (e.g. techniques, methods, policies), maDMPs become as a natural evolution for DMPs.
maDMPs make it easier to continuously and systematically monitor a DMP from start to end. Furthermore, the DCS application profile provides information for researchers to include the necessary metadata to make maDMPs FAIR. Whenever a funding agency demands an update on a project it is funding, maDMPs enable researchers to quickly produce a view up-to-date, with less manual effort that it would be needed on traditional DMPs. A limitation here is the variety of templates used by funding agencies, a topic that was tackled by two of the hackathon participant teams. These efforts can be extended to other funding agencies across different research domains, making maDMPs an ideal companion offering a better support to FAIR principles and Open Science.
The DCS working group entered the maintenance mode. It periodically reviews the recommendation and makes new releases based on the community feedback collected, only if needed. The group, being an active community of maDMP users, helps in promoting the adoption of its recommendations. In this particular case, the adoption of the DCS application profile, and its serialisations as an interchange format for maDMPs. The maDMP Hackathon was therefore an important event to carry out this overarching goal. The hackathon was expected to achieve three primary objectives:
Overall the hackathon can be considered a successful event. Participants provided results pertaining to all of the identified objectives. It is important to point out that the objectives can all be considered open problems, where there is always the potential to strive for better results. As such, the RDA DCS working group will continue to support its adoption by the community. Participants in the post-hackathon feedback have already expressed their willingness to participate in future hackathons or similar events that would promote the integration of the DCS application profile with of other DMP tools or systems.
This work would not be possible without contributions from the RDA DCS working group members and the participants in the maDMP Hackathon. This research was also carried out in the context of the Austrian COMET K1 program and publicly funded by the Austrian Research Promotion Agency (FFG) and the Vienna Business Agency (WAW). Additionally this research was also supported by national funds through Fundação para a Ciência e a Tecnologia (FCT) with reference UID/CEC/50021/2013, by project PRECISE, Accelerating progress toward the new era of precision medicine, 2016–2019 (LISBOA-01-0145-FEDER-016394), and by BioData.pt – Infraestrutura Portuguesa de Dados Biológicos ref 22231/01/SAICT/2016, funded by Portugal 2020.
The authors have no competing interests to declare.
Ali-Khan, SE, et al. 2018. “Defining Success in Open Science”. In: MNI open research, 2: 2. ISSN: 2515-5059. URL: https://europepmc.org/articles/PMC5852639. DOI: https://doi.org/10.12688/mniopenres.12780.1
Briscoe, G. 2014. “Digital innovation: The hackathon phenomenon”.
Cardoso, J, Ekaputra, FJ, et al. 2020. New version of the DMP Common Standard Ontology. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944464
Cardoso, J, Garcia Castro, LJ, et al. 2020. “Towards semantic representation of machineactionable Data Management Plans”. In: DaMaLOS – First Workshop on Data and Research Objects Management for Linked Open Science: Co-located at the International Semantic Web Conference ISWC 2020. PUBLISSO. DOI: https://doi.org/10.4126/FRL01-006423289
Cardoso, J, Jones, S, et al. 2020. Mapping of maDMPs to Funder Templates. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944458
Faure, B, et al. 2020. Exchange DMPs between DMP Tools using the RDA Common Standard. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944308
Garcia, L, et al. 2020. “Ten simple rules to run a successful BioHackathon”. In: PLOS Computational Biology, 16(5). Publisher: Public Library of Science, e1007808. ISSN: 1553-7358. URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007808 (visited on 05/08/2020). DOI: https://doi.org/10.1371/journal.pcbi.1007808
Hasan, A, Fouilloux, A and Jacquemot, C. 2020. Integrating maDMP with the data management process. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944434
Karimova, Y, et al. 2020. Research Data Management Workflows and maDMPs. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944468
Klar, J, et al. 2020. maDMP export from RDMO. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944448
Manghi, P, et al. 2019. The OpenAIRE Research Graph Data Model. Version 1.3. DOI: https://doi.org/10.5281/zenodo.2643199
Michener, WK. 2015. Ten simple rules for creating a good data management plan. In: PLoS computationalbiology, 11(10): e1004525. DOI: https://doi.org/10.1371/journal.pcbi.1004525
Miksa, T, Cardoso, J and Borbinha, JL. 2018. Framing the scope of the common data model for machine-actionable Data Management Plans. In: IEEE International Conference on Big Data, Big Data 2018, Seattle, WA, USA, December 10–13, 2018, Abe, N, et al. (eds.), 2733–2742. IEEE. DOI: https://doi.org/10.1109/BigData.2018.8622618
Miksa, T, Neish, P, et al. 2018. “Defining requirements for machine-actionable data management plans”. In: Proceedings of the 15th International Conference on Digital Preservation, iPRES 2018, Boston, MA, USA, September 24–28, 2018, McGovern, N and Whiteside, A (eds.). URL: https://hdl.handle.net/11353/10.923628.
Miksa, T, Walk, P and Neish, P. 2019. RDA DMP Common Standard for Machine-actionable Data Management Plans. DOI: https://doi.org/10.15497/rda00039
Moa, H, Hasan, A and Philipson, J. 2020. EasyDMP and RDA DMP Common Standard. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944275
Rettig, L, et al. 2020. maDMPs in Linked Data Pipeline as part of Research Data Connectome. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944456
Simms, S, et al. 2017. “Machine-actionable data management plans (maDMPs)”. In: Research Ideas and Outcomes, 3: e13086. DOI: https://doi.org/10.3897/rio.3.e13086
Stoltzfus, A, et al. 2017. “Community and Code: Nine Lessons from Nine NESCent Hackathons”. In: F1000Research, 6: 786. ISSN: 2046-1402. URL: https://f1000research.com/articles/6-786/v1 (visited on 07/06/2020). DOI: https://doi.org/10.12688/f1000research.11429.1
Suchánek, M, et al. 2020. Data Stewardship Wizard Import and Export and FAIR Implementation Profiles. Version 1.0.1. DOI: https://doi.org/10.5281/zenodo.3944189
Tziotzios, D, et al. 2020. Import and Export of maDMPs from Argos/OpenDMP. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944314
Wali, M, et al. 2020. InvenioRDM and maDMPs integration. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944442
Wilkinson, MD, et al. 2016. “The FAIR Guiding Principles for scientific data management and stewardship”. In: Scientific data, 3.
Zimmer, N, et al. 2020. Integrating a Converis CRIS/RIMS with DMPRoadmap and Export/Import maDMP from Figshare. Version 1.0.0. DOI: https://doi.org/10.5281/zenodo.3944381