Worker_connections are not enough
This usually happens when Nginx is creating more connections than allowed in the configuration files. Which is quite simple just increase the number of connections allowed for the workers. Keep in mind these settings depends on your hardware size and the number of users you are serving. In our case we used to do fine with a value below 1000 but with the recent increase in traffic we had to bump this number up.