Skip to Main content Skip to Navigation
Poster communications

Reproducing Deep Learning experiments: common challenges and recommendations for improvement

Abstract : One of the challenges in Machine Learning research is to ensure that the presented and published results are sound and reliable. Reproducibility is an important step to promote open and accessible research, thereby allowing the scientific community to quickly integrate new findings and convert ideas to practice. We already went through the path of darkness: We proposed a set of recommendations ('fixes') to overcome these reproducibility challenges that a researcher may encounter in order to improve Reproducibility and Replicability (R&R) and reduce the likelihood of wasted effort. These strategies can be used as "swiss army knife" to move from DL to more general areas as they are organized as (i) the quality of the dataset (and associated metadata), (ii) the Deep Learning method, (iii) the implementation, and the infrastructure used. We identified the main challenges and constraints from these papers and presented them accordingly. Finally, with the lessons learned in the previous step, we propose a set of mitigation strategies to overcome the main reproducibility challenges and help researchers achieve their goals.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03719090
Contributor : Romain David Connect in order to contact the contributor
Submitted on : Sunday, July 10, 2022 - 7:35:40 PM
Last modification on : Friday, August 5, 2022 - 3:02:19 PM

File

Reproducing Deep Learning expe...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Jeaneth Machicao, Ali Ben Abbes, Leandro Meneguzzi, Pedro Corrêa, Alison Specht, et al.. Reproducing Deep Learning experiments: common challenges and recommendations for improvement. RDA 19th Plenary Meeting, Part Of International Data Week (RDA Plenary 19th), Jun 2022, Seoul, South Korea. 2022, ⟨10.5281/zenodo.6587694⟩. ⟨hal-03719090⟩

Share

Metrics

Record views

64

Files downloads

5