首頁(yè) 猿問在線等！利用日志分析數(shù)據(jù)狀態(tài)怎么實(shí)現(xiàn)

在線等！利用日志分析數(shù)據(jù)狀態(tài)怎么實(shí)現(xiàn)

JavaScript

陪伴而非守候 2019-06-18 10:06:35

使用PHP寫了一個(gè)同步ES和Redis的服務(wù)腳本,每分鐘不定時(shí)會(huì)收到很多http請(qǐng)求,有點(diǎn)擔(dān)心會(huì)失敗,打算做一個(gè)補(bǔ)跑的腳本,目前是想通過awk分析nginx日志檢索大于某個(gè)時(shí)間非200狀態(tài)的數(shù)據(jù)進(jìn)行從新發(fā)送,但是Awk不怎么會(huì)用，只是完成了一部分。。想要的結(jié)果：通過定時(shí)任務(wù)15分鐘運(yùn)行一次,然后查詢大十五分鐘前非200狀態(tài)的數(shù)據(jù),但是現(xiàn)在是用grep指定時(shí)間做不到這種效果(現(xiàn)在自己寫的可以做到指定分鐘內(nèi),感覺1分鐘運(yùn)行一次,數(shù)據(jù)太大會(huì)死循環(huán))，研究了半天也沒個(gè)結(jié)果,有沒有大佬可否幫忙在個(gè)基礎(chǔ)上改進(jìn)一下Nginx日志格式"06/May/2019:03:03:00+0000""GET/HTTP/1.1""41""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""500""500""0.021""0.021""[20953311,21829304,22006993]""06/May/2019:03:07:11+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""500""500""0.058""0.058""[20953311,21829304,22006993]""06/May/2019:03:15:47+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""500""500""0.055""0.055""[20953311,21829304,22006993]""06/May/2019:03:16:44+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""200""200""0.051""0.051""[20953311,21829304,22006993]""06/May/2019:03:40:26+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""200""200""0.057""0.057""[22769461]""06/May/2019:03:41:11+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""500""500""0.058""0.058""[20953311,21829304,22006993]""06/May/2019:03:41:47+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""500""500""0.055""0.055""[20953311,21829304,22006993]""06/May/2019:03:42:44+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""200""200""0.051""0.051""[20953311,21829304,22006993]""06/May/2019:03:43:26+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""200""200""0.057""0.057""[22769461]"目前自己研究出來的AWK命令catfile.log|grep"06/May/2019:03:16"|awk-F"[\"\"]"'{if($18!=200){print$26}}'

查看完整描述

2 回答

炎炎設(shè)計(jì)

TA貢獻(xiàn)1808條經(jīng)驗(yàn) 獲得超4個(gè)贊

awk-F"/"'{print$3$0}'a.txt|awk-F""'{print$1,$0}'|awk'$1>"2019:03:15:47"&&$16!="\"200\""{print$16}'每次awk后都需要保存整行內(nèi)容到下一個(gè)管道命令，你可以試試看。你的文檔最后展示的結(jié)果是下面這個(gè)樣子，你再處理一下就好了。2019:03:41:112019:03:41:11+0000""POST"06/May/2019:03:41:11+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""500""500""0.058""0.058""[20953311,21829304,22006993]"2019:03:41:472019:03:41:47+0000""POST"06/May/2019:03:41:47+0000""POST/HTTP/1.1""20""-""curl/7.29.0""10.1.7.31""-""127.0.0.1:9000""500""500""0.055""0.055""[20953311,21829304,22006993]"

反對(duì) 回復(fù) 2019-06-18