Hi dcanthony,
How much stack are you giving wolfSSL? A very common source of crashes/issues is insufficient stack, wolfSSL generally needs about 20-30KB of stack. As you are on an embedded system I would also recommend defining WOLFSSL_SMALL_STACK.
You may also be running into issues with entropy from your RNG or your RNG in general. Are you confident your RNG is functioning correctly?
You are correct that you'll usually need additional defines for your RNG, I am not seeing a seed generation function for your platform's RNG so you will need to define your own.
I recommend basing your user_settings.h off of our template here: https://github.com/wolfSSL/wolfssl/blob … template.h
You will want to define your own seed generation function with CUSTOM_RAND_GENERATE: https://github.com/wolfSSL/wolfssl/blob … ate.h#L424
Since you're able to see debug logging, if possible I would recommend upgrading to 5.7.2 and defining WOLFSSL_DEBUG_TRACE_ERROR_CODES in addition to DEBUG_WOLFSSL, this will print error and line numbers in our debug logs. This feature was added in 5.7.2 so you would need to upgrade for it.
It looks like you have an active support contract with us, can you follow up on this by emailing us at support [AT] wolfssl [DOT] com? Please provide debug logs and your user_settings.h as well.
Thanks,
Kareem