How to download usage data?
Our Logs & Analytics page has made it easy to see the logs! Just select the time range and you can see all the logs during that period.
From your ScrapingBee Dashboard, click on Logs & Analytics.
By default, you will be able to see the logs for the last 15 minutes.
If you want to select a different duration, just click on it and select the appropriate time period.
For those, who only want to see the logs for a specific site, you can use the domain search box!
If you are a team leader, you can see a dropdown next to the domain search box. It will allow you to select a team member and view their logs.
The logs are divided into 2 sections called Domains and Logs. You can click the Download CSV button (Download whole team's domain/logs data in case you are a team owner) next to each section to download the respective type of data. And once you done that, within 5 minutes, you will get a link via email to download it. The download link will be valid for 7 days, post that, the file will be deleted.
The downloaded data will contain all the columns shown in the Logs & Analytics page.
Apart from this, you should be able to see an email column in the downloaded data. If you are a team leader, the downloaded data will show you all of your team's usage data irrespective of the team member you select.
Getting Logs
From your ScrapingBee Dashboard, click on Logs & Analytics.
By default, you will be able to see the logs for the last 15 minutes.
If you want to select a different duration, just click on it and select the appropriate time period.
For those, who only want to see the logs for a specific site, you can use the domain search box!
If you are a team leader, you can see a dropdown next to the domain search box. It will allow you to select a team member and view their logs.
The logs are divided into 2 sections called Domains and Logs. You can click the Download CSV button (Download whole team's domain/logs data in case you are a team owner) next to each section to download the respective type of data. And once you done that, within 5 minutes, you will get a link via email to download it. The download link will be valid for 7 days, post that, the file will be deleted.
The downloaded data will contain all the columns shown in the Logs & Analytics page.
Domains
| Column Name | Description |
|---|---|
| Domain | The domain name of the request link, if you are using Google API, each search query will be treated as a different domain |
| Date | Date on which the request was sent |
| API | Type of API was used, HTML or Google |
| 2xx | Number of requests resulted in a 2xx status code |
| 4xx | Number of requests resulted in a 4xx status code |
| 5xx | Number of requests resulted in a 5xx status code |
| Total requests | Total number of requests, this will be a sum of 2xx, 4xx, and 5xx requests |
| Total Cost | Sum of API credits. This should be the sum of requests that resulted in a 200, 404 and 410 status codes |
Logs
| Column Name | Description |
|---|---|
| Status | The domain name of the request link, if you are using Google API, each search query will be treated as a different domain |
| Time | Date and time on which the request was sent |
| API | Type of API was used, HTML or Google |
| Verb | Type of HTTP method used |
| Url | Request link |
| Duration | Time taken by the request to return a response |
| Cost | Number of API credits consumed for a request that resulted in 200, 404, and 410 status codes, For other status codes, it should be 0. |
Apart from this, you should be able to see an email column in the downloaded data. If you are a team leader, the downloaded data will show you all of your team's usage data irrespective of the team member you select.
Updated on: 23/04/2024
Thank you!