Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Every 2-3 months we had to execute a python script that takes 1s on all our data (500k rows), to make it faster we execute it in parallel on multiple droplets ~10 that we set up only for this pipeline and shut down once it’s done.

Wait, a whole distributed computing sub-system to make a 1s process faster?

> I got their final message right after arriving in Portugal.

Did he initiate the script from a IP address outside France?

Though that might explain why DO's fraud detection was triggered, it doesn't excuse their actions. Send an email first, jeez.



> Wait, a whole distributed computing sub-system to make a 1s process faster?

I think OP means 1s per row, so 138 hours.


Maybe he meant 1s per row? i.e. 500k seconds or 139 hours.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: