As noted above, Blueprint processes search engine bot data only, so you can exclude all customer data before uploading the log files. Our instructions provide details of writing a script that parses out only the data we need before uploading. That alone should make the files significantly smaller. In addition, you can set your script to upload the logs at any interval you’d like. Rather than uploading an entire week’s worth at once, you can upload daily or several times a day. You can also compress the files before uploading them.
Posted in: Blueprint - Server Log Analysis
