RSA sign/verify and hash generation functions

[Murray S. Kucherawy]

> -----Original Message-----
> From: Nikos Mavrogiannopoulos [mailto:n.mavrogiannopoulos at gmail.com] On Behalf Of Nikos Mavrogiannopoulos
> Sent: Wednesday, December 08, 2010 2:25 PM
> To: Murray S. Kucherawy
> Cc: help-gnutls at gnu.org
> Subject: Re: RSA sign/verify and hash generation functions
> 
> Which signing method do you use with openssl? In gnutls we support only
> PKCS #1 1.5 signatures (that one required by TLS).

Ah, maybe that's the problem.  The RSA_sign() man page from OpenSSL says:

       RSA_sign() signs the message digest m of size m_len using the private
       key rsa as specified in PKCS #1 v2.0. It stores the signature in sigret
       and the signature size in siglen. sigret must point to RSA_size(rsa)
       bytes of memory.

So maybe this is a dead end for me, at least for now.