Chapter 13. Ingest

In this chapter, we will cover the following recipes:

  • Pipeline definition
  • Put an ingest pipeline
  • Get an ingest pipeline
  • Delete an ingest pipeline
  • Simulate a pipeline
  • Built-in processors
  • The grok processor
  • Using the ingest attachment plugin
  • Using the ingest GeoIP plugin

Introduction

Elasticsearch 5.x introduces a set of powerful functionalities, targeting the problems that arise during ingestion of documents via the ingest node.

An Elasticsearch node can be master, data, or ingest.

The idea to split the ingest component from the others, is to create a more stable cluster due to problems that can arise during pre-processing documents.

To create a more stable cluster, the ingest nodes should be isolated by the master or data nodes, in the event ...

Get Elasticsearch 5.x Cookbook - Third Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.