MySQL client does not use the port parameter

It will happen if you use localhost as the server address. The client will then use the Unix sockets. Use 127.0.0.1 instead. This issue is common when using SSL tunnels.