Awesome thread, we use Quartz for Jobs, there's this tool i came across my colleague shared it and it's cool Flyway, am gradually sticking more to Java, I built a crawler that steals songs from NotJustOK and TooExclusive but its based on crawler4j and it was kinda straight-forward , though had issues getting Maven to build executable jars.
https://github.com/dojoVader/MusicWebCrawler/tree/dev/src/main/java

pcguru1:
Awesome thread, we use Quartz for Jobs, there's this tool i came across my colleague shared it and it's cool Flyway, am gradually sticking more to Java, I built a crawler that steals songs from NotJustOK and TooExclusive but its based on crawler4j and it was kinda straight-forward , though had issues getting Maven to build executable jars.
https://github.com/dojoVader/MusicWebCrawler/tree/dev/src/main/java

I like this your booty stealing crawler idea. I myself am building on for a start up idea of mine. Jsoup is my choice library for the crawling. It crawls for text/images though.

CodeTemplar:
I like this your booty stealing crawler idea. I myself am building on for a start up idea of mine. Jsoup is my choice library for the crawling. It crawls for text/images though.

true JSoup came to mind, but I wanted performance i felt RegEXP would do the job and no need for the overhead, as am already loading into the InputStream multiple times, I haven't profiled it but am sure there's gonna be some memory increase.

Hope its not too late in 2019 to upgrades one's php skills and learn Java.

mcqwerty:
Hope its not too late in 2019 to upgrades one's php skills and learn Java.

No, it's not too late.

kunletoks:


No, it's not too late.

Thanks