How to forward headers?
You might need to forward specific headers to the website that you want to scrape.
In order to forward headers, you must set forward_headers to true and then pass your custom headers.
You must then prefix the headers to forward to the website with "Spb-" (for ScraPingBee).
This prefix will be trimmed by ScrapingBee and headers will be forwarded to the target web page.
Example :
If you want to send the header Accept-Language: En-US, add the header: Spb-Accept-Language: En-US and the parameter forward_headers=true to the request sent to the ScrapingBee API.
Code examples and more details available on the full documentation.
In order to forward headers, you must set forward_headers to true and then pass your custom headers.
You must then prefix the headers to forward to the website with "Spb-" (for ScraPingBee).
This prefix will be trimmed by ScrapingBee and headers will be forwarded to the target web page.
Example :
If you want to send the header Accept-Language: En-US, add the header: Spb-Accept-Language: En-US and the parameter forward_headers=true to the request sent to the ScrapingBee API.
Code examples and more details available on the full documentation.
Updated on: 21/09/2021
Thank you!