Douyin_TikTok_Download_API: High-Performance Scraper for Social Media Videos

Introduction

Douyin_TikTok_Download_API is a high-performance, asynchronous data crawling tool designed for popular social media platforms like Douyin, TikTok, and Bilibili. This project offers a comprehensive solution for extracting video, user, and comment data, supporting API calls, online batch parsing, and downloading content without watermarks. Built primarily with Python, it leverages FastAPI for its API, PyWebIO for the web interface, and HTTPX for efficient asynchronous requests, making it a robust and versatile tool for developers and data enthusiasts.

Installation

The simplest way to deploy Douyin_TikTok_Download_API is by using Docker, ensuring environment consistency and quick setup.

First, pull the latest Docker image:

docker pull evil0ctal/douyin_tiktok_download_api:latest

Next, run the Docker container. This command will start the container in the background and map port 80 of your host to port 80 of the container:

docker run -d --name douyin_tiktok_api -p 80:80 evil0ctal/douyin_tiktok_download_api

You can verify the container is running using docker ps. Once active, you can access the application via http://localhost or your server's IP address. For advanced configurations, such as setting cookies for risk control, you may need to modify the config.yaml files located in the /crawlers/douyin/web/config.yaml and /crawlers/tiktok/web/config.yaml paths within your deployment.

Examples

The project provides a Python parsing library for easy integration into your own projects.

Install the parsing library:

pip install douyin-tiktok-scraper

Here's a simple example of how to use the hybrid_parsing function:

import asyncio
from douyin_tiktok_scraper.scraper import Scraper

api = Scraper()

async def hybrid_parsing(url: str) -> dict:
    # Hybrid parsing (Douyin/TikTok URL)
    result = await api.hybrid_parsing(url)
    print(f"The hybrid parsing result:\n {result}")
    return result

asyncio.run(hybrid_parsing(url=input("Paste Douyin/TikTok/Bilibili share URL here: ")))

The tool supports various submission formats, including:

• Douyin sharing password (e.g., 7.43 pda:/ ... https://v.douyin.com/L5pbfdP/ ...)
• Douyin short URL (e.g., https://v.douyin.com/L4FJNR3/)
• Douyin normal URL (e.g., https://www.douyin.com/video/6914948781100338440)
• TikTok short URL (e.g., https://www.tiktok.com/t/ZTR9nDNWq/)
• TikTok normal URL (e.g., https://www.tiktok.com/@evil0ctal/video/7156033831819037994)
• Batch URLs, allowing multiple links in one submission.

Why Use It

Douyin_TikTok_Download_API stands out for its comprehensive features and ease of use:

• No-Watermark Downloads: Easily download videos and photo albums from supported platforms without watermarks.
• Rich API Interface: Access a wide range of data, including video details, user profiles, liked works, comments, live stream data, and more, for Douyin, TikTok, and Bilibili.
• Online Batch Parsing: Process multiple URLs simultaneously through its intuitive web interface.
• iOS Shortcut Integration: Seamlessly integrate with iOS shortcut commands for in-app, watermark-free downloads.
• High Performance: Designed for speed and efficiency, utilizing asynchronous operations to handle data crawling.
• Open Source: The project is free and open source, allowing for community contributions and self-hosting.

Links

• GitHub Repository: https://github.com/Evil0ctal/Douyin_TikTok_Download_API
• Demo Web APP: https://douyin.wtf/
• API Documentation: https://douyin.wtf/docs
• PyPI Package: https://pypi.org/project/douyin-tiktok-scraper/