Thank you , I think that fixed it. But I am stuck with another issue. I am running the server example and the client is running on an embedded device. I start the connection with ping request from client to which host responds correctly. The real issue comes up when client sends a TCP packet to which server doesn't respond back and I can see the TCP Retransmission packets being sent to the server.

To narrow down the issue, I ran a dummy server by opening a socket on my host machine listening at the same IP and port. In this case, I can see the client getting the response back of TCP request so I am assuming Firewall might not be the issue here.