<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
<html lang="en">
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
<title>
GitLab
</title>
<style>img {
max-width: 100%; height: auto;
}
</style>
</head>
<body>
<div class="content">
<div></div>
<p dir="auto">This issue is for discussion on how to improve the speed of the test suite.</p>
<p dir="auto">The following test have been made on a Ryzen 2600 3.4 GHz with <code>/usr/bin/unbuffer /bin/bash -o pipefail -c "make check -j1"|ts</code>.</p>
<p dir="auto"><strong>List of slow tests</strong></p>
<table dir="auto">
<thead>
<tr>
<th>Name</th>
<th>Duration</th>
<th>Reason</th>
</tr>
</thead>
<tbody>
<tr>
<td>tls13/key_update</td>
<td>15s</td>
<td></td>
</tr>
<tr>
<td>dtls-rehandshake-anon</td>
<td>61s</td>
<td>Sleep 60</td>
</tr>
<tr>
<td>mini-record</td>
<td>6s</td>
<td></td>
</tr>
<tr>
<td>record-retvals</td>
<td>5s</td>
<td></td>
</tr>
<tr>
<td>dtls-rehandshake-cert</td>
<td>61s</td>
<td>Sleep 60</td>
</tr>
<tr>
<td>mini-dtls-hello-verify-48</td>
<td>30s</td>
<td></td>
</tr>
<tr>
<td>rng-sigint</td>
<td>5s</td>
<td></td>
</tr>
<tr>
<td>rng-op-nonce</td>
<td>8s</td>
<td></td>
</tr>
<tr>
<td>rng-op-random</td>
<td>8s</td>
<td></td>
</tr>
<tr>
<td>rng-op-key</td>
<td>8s</td>
<td></td>
</tr>
<tr>
<td>dtls/dtls</td>
<td>75s</td>
<td></td>
</tr>
<tr>
<td>starttls-smtp.sh</td>
<td>43s</td>
<td></td>
</tr>
<tr>
<td>starttls-pop3.sh</td>
<td>41s</td>
<td></td>
</tr>
<tr>
<td>starttls-sieve.sh</td>
<td>5s</td>
<td></td>
</tr>
<tr>
<td>ocsp-tests/ocsp-tls-connection</td>
<td>5s</td>
<td></td>
</tr>
<tr>
<td>ocsp-tests/ocsp-must-staple-connection</td>
<td>14s</td>
<td></td>
</tr>
<tr>
<td>testpkcs11.sh</td>
<td>9s</td>
<td></td>
</tr>
<tr>
<td>cert-tests/provable-dh</td>
<td>8s</td>
<td></td>
</tr>
<tr>
<td>cert-tests/provable-privkey-dsa2048</td>
<td>7s</td>
<td></td>
</tr>
<tr>
<td>cert-tests/provable-dh-default</td>
<td>5s</td>
<td></td>
</tr>
<tr>
<td>cert-tests/dsa</td>
<td>5s</td>
<td></td>
</tr>
<tr>
<td>slow/test-hash-large.sh</td>
<td>38s</td>
<td></td>
</tr>
<tr>
<td>suite/chain.sh</td>
<td>12s</td>
<td></td>
</tr>
<tr>
<td>suite/testcompat-openssl.sh</td>
<td>50s</td>
<td></td>
</tr>
<tr>
<td>suite/testrandom.sh</td>
<td>16s</td>
<td></td>
</tr>
<tr>
<td>suite/tls-fuzzer/tls-fuzzer-nocert.sh</td>
<td>109s</td>
<td></td>
</tr>
<tr>
<td>suite/tls-fuzzer/tls-fuzzer-nocert-tls13.sh</td>
<td>127s</td>
<td></td>
</tr>
<tr>
<td>suite/testcompat-tls13-openssl.sh</td>
<td>39s</td>
<td></td>
</tr>
<tr>
<td>suite/testdane.sh</td>
<td>15s</td>
<td></td>
</tr>
<tr>
<td>suite/prime-check</td>
<td>7s</td>
<td></td>
</tr>
</tbody>
</table>
<p dir="auto">Maybe that list helps to separate tests into directories/groups that could by run in parallel on different runners, decreasing the total time of our CI. We could use either configure flags or <code>make check -C ...</code> to chose the groups to test.</p>
<p dir="auto">There also might be some tests with optimization potential. At least there are some tests idling / waiting without much CPU consumption.</p>
</div>
<div class="footer" style="margin-top: 10px;">
<p style="font-size: small; color: #777777;">
—
<br>
Reply to this email directly or <a href="https://gitlab.com/gnutls/gnutls/issues/674">view it on GitLab</a>.
<br>
You're receiving this email because of your account on gitlab.com.
If you'd like to receive fewer emails, you can
<a href="https://gitlab.com/sent_notifications/8abaf32bb0e45f849e1a071e238f4fe8/unsubscribe">unsubscribe</a>
from this thread or
adjust your notification settings.
<script type="application/ld+json">{"@context":"http://schema.org","@type":"EmailMessage","action":{"@type":"ViewAction","name":"View Issue","url":"https://gitlab.com/gnutls/gnutls/issues/674"}}</script>
</p>
</div>
</body>
</html>