阿里云cdn 日志收集脚本

3
380 views

A+

阿里云的cdn在网页端是有热点分析效果不错，但是对于分散的url比如一个目录的一组图片是无法简单从热点中发现的。需要从日志里想办法分析

思路

curl 'https://cdn.console.aliyun.com/console/v2/data/describeCdnDomainLogs.json?domainName=yun.janesi.com&logDay=2018-09-28' -H 'accept-encoding: gzip, deflate, br' -H 'accept-language: zh-CN,zh;q=0.9' -H 'user-agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36' -H 'accept: */*' -H 'referer: https://cdn.console.aliyun.com/' -H 'authority: cdn.console.aliyun.com' -H 'cookie'

cat ../list.json |jq .data.DomainLogModel.DomainLogDetails.DomainLogDetail[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23].\"LogPath\"|awk -F '"' '{print $2}'|sed -r 's#(.*)yun.janesi.com_(.*).gz(.*)# wget -O yun.janesi.com_\2.gz \"\1yun.janesi.com_\2.gz\3\" #g'>down.sh

1	cat ../list.json \|jq .data.DomainLogModel.DomainLogDetails.DomainLogDetail[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23].\"LogPath\"\|awk -F '"' '{print $2}'\|sed -r 's#(.)yun.janesi.com_(.).gz(.*)# wget -O yun.janesi.com_\2.gz \"\1yun.janesi.com_\2.gz\3\" #g'>down.sh