How many requests can a router handle?
I made a script to scan a file which contains a portion of ipv4 addresses (about 50 million), it attempts to connect to the website using OpenSSL and extract a small piece of it and writes it into a file. To save some of the details, it uses multiprocessing to run about 150 workers to connect to different sites at the same time, and each connection takes under a second.
My CPU can handle much more workers, so the script is not CPU bounded by any means. The script caps at the 1/5 of my maximum bandwidth at home and not even a 1/30 of the maximum speed at the university labs (I have special permission to run this), even if I bump up the workers to about 300, 400, 500, etc. It is also definitely not I/O bounded, because it keeps it in a list in memory and writes it out at the end. I believe it is due to the router not being handle so many requests at the same time
Can the router be overloaded with request, even if bandwidth is not an issue. I'm more surprised that the university network cannot handle these requests.
What can I do to solve it? Or any other insights?
Ответ на ваш вопрос заключается в том, что это сильно зависит от маршрутизатора. Маршрутизаторы бизнес-класса обычно оцениваются не только по полосе пропускания, но и по PPS (пакетам в секунду), обычно это семизначный диапазон.
Например, Ubiquiti Security Gateway Pro 4 рассчитан на 2,4 миллиона пакетов в секунду.
https://dl.ubnt.com/datasheets/unifi/UniFi_Security_Gateway_DS.pdf на странице 4