Unable to connect to SQL Server 2012 Express using osql or other 3rd party client

I installed SQL Server 2012 Express, and is able to successfully connect using SQL Server Management Studio and create databases.

Screenshots:

However, when I try to connect to through the osql client, I get the following error:

I also notice that there are no protocols listed inside the SQL Server Network Interfaces section of SQL Server Configuration Manager, though the SQL Native Client 11.0 section do have the protocols. Not sure, if this behaviour has anything to do with the issue seen: