Spark: unit, integration and end-to-end tests
In this article Gustavo Martin, Senior Data Engineer, explains the way Spark tests are run at Adevinta Spain. Hopefully, it will be useful for other big data developers seeking for ways to improve the quality of their code and at the same time their CI pipelines. Article in our dev.to account. Read here.