₦airaland Forum

I’m building a video downloader website and I’m looking for the best architecture to run a downloader module like yt-dlp on a Python stack. Does anyone have suggestions, especially people who have built TikTok, YouTube, or other video downloader sites, in any stack?

Wcrux:
I’m building a video downloader website and I’m looking for the best architecture to run a downloader module like yt-dlp on a Python stack. Does anyone have suggestions, especially people who have built TikTok, YouTube, or other video downloader sites, in any stack?

Surely you will have a mix of Python, JavaScript and html5

Hahahaha

I built one with python...... You will have issues with:

1. IP (Expensive)
2. Google Authentication
3. Bot Verification


You will spend heavy on Custom IP, all this Data center IP has being filtered out by Google.

Make sure you have standby engineer to fix bug cos everyday Google blocks IP and change things, some video may be available for your country and not on another country etc.


The best is if you are using it locally and privately but if it's for public consumption, you will face these 3 problems


You will buy alot of IP for IP rotation and download rate limit

Wcrux:
I’m building a video downloader website and I’m looking for the best architecture to run a downloader module like yt-dlp on a Python stack. Does anyone have suggestions, especially people who have built TikTok, YouTube, or other video downloader sites, in any stack?

Are you building a free public downloader that anyone can use, or a private downloader for a limited number of users?

Just like the user above me stated, IPs from your server will be blocked. Even if you create separate workers, or different stack, you’ll face it still.

jDownloader already does this
tough market you want to enter bro

fnep2smooth:
Hahahaha

I built one with python...... You will have issues with:

1. IP (Expensive)
2. Google Authentication
3. Bot Verification


You will spend heavy on Custom IP, all this Data center IP has being filtered out by Google.

Make sure you have standby engineer to fix bug cos everyday Google blocks IP and change things, some video may be available for your country and not on another country etc.


The best is if you are using it locally and privately but if it's for public consumption, you will face these 3 problems


You will buy alot of IP for IP rotation and download rate limit

donsheddy1:
Are you building a free public downloader that anyone can use, or a private downloader for a limited number of users?

Just like the user above me stated, IPs from your server will be blocked. Even if you create separate workers, or different stack, you’ll face it still.

True, Google/YouTube is much stricter with their anti-scraping techniques. I can easily run an X (Twitter) or TikTok downloader with a static residential IP for about $5 a month, and I won’t run into any big issues. I’m building one for all social media platforms, and I’m thinking of dropping support for YouTube because it’s too expensive to run.

YouTube keeps implementing new anti-scraping measures every day, from JS runtime checks to PO tokens now.

I have built a python converter for this. It takes the link and provides the mp3 version. I can share the source code if you want.

Honestly, the biggest headache you'll run into won't even be the stack itself, but keeping up with the constant backend updates yt-dlp needs every time Google tweaks their player scripts. If you're opening it up to the public, definitely decouple your download workers using a message queue like Celery and Redis so your web server doesn't hang when multiple heavy requests hit at once.