Monitoring Continuous Integration Practices in Industry: A Case Study

<p><span>In our previous studies&nbsp;</span><span>have demonstrated&nbsp;</span><span>that only executing automatic builds and checking test coverage&nbsp;</span><span>have been considered to measure the level of Continuous Integra</span><span>tion maturity in several projects. In this paper we seek for under</span><span>stand the the benefits and challenges of monitoring CI practices in&nbsp;</span><span>day-to-day software development.</span><span> </span><span>We aim to evaluate the&nbsp;</span><span>impact of monitoring seven CI practices in a real-world scenario on&nbsp;</span><span>three public organizations in Brazil.</span><span> </span><span>We first developed a&nbsp;</span><span>CI practices monitoring suite tool and conducted a multiple-case&nbsp;</span><span>study applying a mixed-methods strategy, combining surveys, in</span><span>terviews, log data, and mining data from CI services.</span><span> </span><span>We&nbsp;</span><span>verified organization&rsquo; interest in monitoring CI practices. Moni</span><span>toring provided an overview of the organization&rsquo;s CI status, not&nbsp;</span><span>covered by other tools, motivated constant improvement in these&nbsp;</span><span>practices, a perception of software quality, improve the communica</span><span>tion and and it is easy to adopt.</span><span> </span><span>Conclusions:</span><span> </span><span>We recommend that&nbsp;</span><span>companies adopt monitoring of CI practices and that CI services&nbsp;</span><span>integrate this monitoring into their dashboards.</span></p>