https://jira.akraino.org This file is an XML representation of an issue en-us 9.4.5 940005 11-04-2023 https://jira.akraino.org/browse/VAL-101 Validation <p>OS build fail on arm when trying to fetch vuls database.</p> <p>The build failed at the command : for i in $(seq 2002 "$(date +"%Y")"); do go-cve-dictionary fetchnvd -http-proxy=${HTTP_PROXY} -dbpath /opt/akraino/validation/tests/os/vuls/cve.sqlite3 -years "$i"; done <br/> With error : make<span class="error">&#91;1&#93;</span>: *** <span class="error">&#91;.build&#93;</span> Error 137</p> VAL-101

OS build fail on arm

Bug Medium Done Done Cristina Pauna Daniel Stoica Tue, 10 Mar 2020 09:46:19 +0000 Mon, 13 Apr 2020 13:08:29 +0000 Mon, 13 Apr 2020 13:07:14 +0000 0 4 <p>Docker build seems to be stable on arm64 now <span class="error">&#91;1&#93;</span>, after implementing the above caching mechanism proposed + moving the docker build jobs from `aarch64_dev` to `aarch64_build` jenkins slaves (to eliminate the overlapping of IEC fuel/compass deploy/testing jobs with the validation docker build job, which used to cause issues due to deploy jobs restarting the Docker service on the host).</p> <p><span class="error">&#91;1&#93;</span> <a href="https://jenkins.akraino.org/view/validation/job/validation-docker-build-arm64-master/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.akraino.org/view/validation/job/validation-docker-build-arm64-master/</a></p> <p>The error in this ticket does not seem to be caused by an incomplete PATH, but rather out-of-memory spurious failures during database fetch/update using `go-cve-dictionary fetchnvd`.</p> <p>To bypass the issue (considering a ~50% reproduction rate of the issue during manual testing with a ~1h test iteration duration, debugging and rootcausing this is non-trivial), we chose to leverage the fact that all affected builds are scheduled on static Jenkins slaves, so we can cache the databases locally on the build server between container builds, reducing the fetch size considerably and thus avoiding OOM issues.</p> <p>I proposed a patch for implementing this persistent cache and will manually initialize the DB cache on the `aarch64_dev` jenkins slaves.</p> <p>Hi Juha, you are correct, this should not be closed yet. The build passed on its own a couple of days after the Jira was opened, and I thought it's fixed. But looking at the jobs, this seems to be an intermittent error. It might have to do something with the servers we build the images on, not with the code itself. We'll continue to investigate what's going on.</p> <p><a href="https://jira.akraino.org/secure/ViewProfile.jspa?name=cristinapauna" class="user-hover" rel="cristinapauna">cristinapauna</a> The patch referred has not been merged; is this corrected somewhere else or correction not needed at all?</p> <p><a href="https://gerrit.akraino.org/r/c/validation/+/2294" class="external-link" target="_blank" rel="nofollow noopener">https://gerrit.akraino.org/r/c/validation/+/2294</a></p> Development Rank 0|i003l0: