本文是elasticsearch官方文檔logstash的翻譯，你也可查看原文

注：Logstash意思是日志存儲，下文中對本詞使用英文。

Paste_Image.png

Logstash 介紹

Logstash is an open source data collection engine with real-time pipelining capabilities(功能). Logstash can dynamically unify(統一) data from disparate(不同的) sources and normalize the data into destinations(目的地) of your choice. Cleanse(凈化) and democratize(大眾化) all your data for diverse(不同的) advanced downstream(下游) analytics and visualization(形象化) use cases.

Logstash 是開源的具有實時輸入數據能力的數據收集引擎。Logstash可以把來自不同的源的數據動態的寫入你選擇的目的地并對輸入的數據進行規范化。根據需求進行分析和展示。

While Logstash originally(最初) drove innovation(創新) in log collection, its capabilities extend well beyond(超越) that use case. Any type of event can be enriched and transformed(轉變) with a broad(寬的) array of input, filter, and output plugins, with many native codecs further(更好地) simplifying(簡化) the ingestion(吸收) process. Logstash accelerates(加速) your insights(洞察力) by harnessing(利用) a greater volume and variety(多樣) of data.

Logstash升級版本的時候，老版本對新版本的兼容新很好。事件的類型是一組input、filter、和output插件，所以可以很方便擴展，可以使用本地編碼更好簡化吸收日志的過程。

The Power of Logstash

The ingestion workhorse for Elasticsearch and more

Horizontally(水平) scalable(可擴展的) data processing pipeline with strong Elasticsearch and Kibana synergy(協同)

通過Elasticearch和kibana進行協同，實現數據處理的水平擴展

Pluggable pipeline architecture

Mix, match, and orchestrate different inputs, filters, and outputs to play in pipeline harmony

插件化管飽結構

混合,匹配和協調不同的 inputs, filters, and outputs讓管道和諧而不發生沖突。

Community-extensible and developer-friendly plugin ecosystem

Over 200 plugins available, plus the flexibility of creating and contributing your own

社區可擴展和開發者友好的插件生態系統

超過200個插件可以使用，你也可以很快速創建和貢獻你的插件

Paste_Image.png

Logstash Loves Data

Collect more, so you can know more. Logstash welcomes data of all shapes and sizes.

搜集更多,這樣你就可以知道更多。Logstash可以存儲各種各樣的數據。

Logs and Metrics

Where it all started.

Handle all types of logging data

Easily ingest(攝取) a multitude(大批的) of web logs like Apache, and application logs like log4j for Java

Capture many other log formats like syslog, Windows event logs, networking and firewall logs, and more

Enjoy complementary(補充的) secure log forwarding capabilities with Filebeat

Collect metrics from Ganglia, collectd, NetFlow, JMX, and many other infrastructure(基礎設施) and application platforms over TCP and UDP

日志和度量

這是一切開始的地方。

處理很多類型的日志

那些可以容易獲取的Apache之類的web日志，應用日志如java的log4J

其他的格式化的日志如syslog,Windows event logs,網絡和防火墻日志等等

Filebeat轉發來的安全日志。

Ganglia, collectd, NetFlow, JMX, 和一些其他的(基礎設施) and 基于 TCP and UDP的應用平臺

The Web

Unlock the World Wide Web.

Transform HTTP requests into events (blog)

Consume(消耗) from web service firehoses(消防帶) like Twitter for social sentiment(情感) analysis

Webhook(網絡連接) support for GitHub, HipChat, JIRA, and countless(無數的) other applications

Enables many Watcher alerting use cases

Create events by polling(投票) HTTP endpoints on demand (blog)

Universally(普遍) capture health, performance, metrics, and other types of data from web application interfaces

Perfect for scenarios where the control of polling is preferred over receiving

解鎖萬維網。

Http事件

Data Stores and Streams

Discover more value from the data you already own.

Better understand your data from any relational database or NoSQL store with a JDBC interface (blog)

Unify(統一) diverse(不同的) data streams from messaging queues like Apache Kafka (blog), RabbitMQ, Amazon SQS, and ZeroMQ

數據存儲和數據流

Sensors and IoT

Explore an expansive breadth of other data.

In this age of technological advancement, the massive IoT world unleashes endless use cases through capturing and harnessing data from connected sensors.

Logstash is the common event collection backbone for ingestion of data shipped from mobile devices to intelligent homes, connected vehicles, healthcare sensors, and many other industry specific applications.

Watch as Logstash, in conjunction with the broader ELK stack, centralizes and enriches sensor data to gain deeper knowledge regarding a residential home.

Easily Enrich Everything

The better the data, the better the knowledge. Clean and transform your data during ingestion to gain near real-time insights immediately at index or output time. Logstash comes out-of-box with many aggregations and mutations along with pattern matching, geo mapping, and dynamic lookup capabilities.

Grok is the bread and butter of Logstash filters and is used ubiquitously to derive structure out of unstructured data. Enjoy a wealth of integrated patterns aimed to help quickly resolve web, systems, networking, and other types of event formats.

Expand your horizons by deciphering geo coordinates from IP addresses, normalizing datecomplexity, simplifying key-value pairs and CSV data, anonymizing sensitive information, and further enriching your data with local lookups or Elasticsearch queries.

Codecs are often used to ease the processing of common event structures like JSON and multilineevents.

Choose Your Stash

Route your data where it matters most. Unlock various downstream analytical and operational use cases by storing, analyzing, and taking action on your data.

Analysis

Elasticsearch

Data stores such as MongoDB and Riak

總結

以上是生活随笔為你收集整理的date时区 es logstash_es-日志存储-Logstash 介绍的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。