Network and proxies
Proxies are how you change where your traffic appears to come from, and how it looks on the wire. Getting them right (and understanding how they get caught) means knowing what actually happens at each layer of a request. This section is the background; for setting a proxy in Pydoll, see the Proxies guide.
Start here
- Network fundamentals: the layers a request passes through, from TCP to TLS to HTTP, and which layer a proxy can reach.
Proxy types
- HTTP/HTTPS proxies: the forward proxy and the CONNECT tunnel, what each can see, and how MITM interception changes the TLS fingerprint.
- SOCKS proxies: the transport-layer handshake, SOCKS4 vs SOCKS5, remote DNS, and Chrome's SOCKS5 auth limitation.
Detection and mechanics
- Proxy detection: the signals that give a proxy away, from IP reputation to header and fingerprint mismatches.
- Building a proxy server: a minimal HTTP and SOCKS5 proxy in Python, to see how forwarding actually works.
- Legal and ethical use: terms of service, privacy, and responsible scraping.
Related
- Proxies: the practical guide to configuring proxies in Pydoll.
- Network fingerprinting: what the network layer reveals about a client.