è¿ç»Žå·¥çšåžå DevOps å¢é
æå»ºç»äžçæ¥å¿æ¶éç³»ç»æ¶ïŒéèŠä»å€äžªåºçšæå¡åšæ¶éæ¥å¿å¹¶èœ¬åå° Elasticsearch çååšã
Fluentd æ¯äžäžªåŒæºçæ°æ®æ¶éåšïŒçšäºç»äžæ¥å¿å±ãè¿åŒ Fluentd æç»Žå¯ŒåŸæš¡æ¿æ¶µçäº 119 䞪èç¹ïŒè¯Šç»ä»ç»äº Parser PluginsãInputãOutputãFormatter PluginsãFilterãBuffer Plugins çæ žå¿ç»ä»¶ãäŸåŠïŒInput éšåå çœ®äº 12 䞪æä»¶ïŒå æ¬ forwardïŒé»è®€ç«¯å£ 24224ïŒå tailïŒçšäºæä»¶æ¥å¿å€çïŒãOutput éšååºåäº Non-buffered å Buffered ç±»åïŒå ¶äž Buffered ç±»åéè¿ queue å chunk 管çäºä»¶ãæš¡æ¿è¿å¯¹æ¯äº syslogãlogstash å Apache Flume çå·¥å ·ãè¿åŒ Fluentd æš¡æ¿æ¯åŠä¹ æ¥å¿æ¶éæ¶æçå®çšåèã
å©çšèŠçŽæå»ºç»äžçæ¥å¿æ¶éç³»ç»æ¶ïŒéèŠä»å€äžªåºçšæå¡åšæ¶éæ¥å¿å¹¶èœ¬åå° Elasticsearch çååšã
åæ Nginx æ Apache è®¿é®æ¥å¿æ¶ïŒéèŠè§£æç¹å®æ ŒåŒå¹¶è¿æ»€åºé误äºä»¶ã
对æ¯äžåæ¥å¿æ¶éå·¥å ·ïŒåŠ Fluentd vs LogstashïŒçæ¶æåéçšåºæ¯ïŒä»¥äŸ¿éåã
åš Xmind äžæåŒæš¡æ¿å¹¶æµè§æŽäœæ¶æïŒéç¹æ¥ç Input 忝以äºè§£åŠäœé 眮 tail æ forward çèŸå ¥æä»¶åæ°ã
ç»å Filter åæ¯è®Ÿçœ®æ°æ®è¿æ»€è§åïŒå¹¶åš Output åæ¯äžæ ¹æ®éæ±è°æŽ Buffered ç±»åçéåäžå管çåæ°ã
åèæš¡æ¿äžå ³äºäžåæä»¶ååç±»å·¥å ·ç对æ¯åæïŒå®æèªå®ä¹ä¿®æ¹åå°å ¶å¯ŒåºäžºåŸçæ PDF äŸå¢éåäœäœ¿çšã
æš¡æ¿èŠçäº Fluentd çæ žå¿ç»ä»¶ïŒParser PluginsãInputïŒ12 䞪å 眮æä»¶ïŒãOutputïŒNon-buffered å Buffered ç±»åïŒãFormatter PluginsãFilterãBuffer PluginsïŒä»¥åäžå ¶ä»å·¥å ·ïŒsyslogãlogstashãApache FlumeïŒç对æ¯ã
æåŒæš¡æ¿åïŒåè Input éšåéæ©éåçæä»¶ïŒåŠ tail å€çæä»¶æ¥å¿ïŒïŒé 眮 tag å pathïŒåš Output éšåéæ©ç®æ ïŒåŠ elasticsearchïŒïŒè®Ÿçœ® buffer åæ°ïŒäœ¿çš Filter è¿è¡äºä»¶è¿æ»€ã
Buffered ç±»åéè¿ç»Žæ€ queue å chunk æ¥çŒåäºä»¶ïŒæ¯æ flush_interval æ§å¶å·æ°éŽéïŒéåç产ç¯å¢ïŒèœæé«ååéåå¯é æ§ã
æ¯äžª Event ç± tagïŒåš Input äžæ è®°ïŒãtimeïŒUnix æ¶éŽæ³ïŒå recordïŒJSON æ°æ®ïŒäžéšåç»æïŒåš engine äžäŸæ¬¡ç»è¿ 6 䞪æ¥éª€å€çã
æš¡æ¿å¯¹æ¯äº syslogãlogstash å Apache FlumeïŒæåºå®ä»¬éœçšäºå¯¹æ¥æ°æ®æºäžç®æ ïŒäœ Fluentd æä»¶æŽèœ»éïŒé 眮æŽçµæŽ»ïŒäžåçæ¯æ JSON å MessagePack æ ŒåŒã
ããªãã®ãã€ã³ãããã ãã³ãã¬ãŒããäžçäžã®ã¯ãªãšã€ã¿ãŒãšå ±æããŠãäœåããåå ¥ãåŸãŸãããã