Log Pipeline Workflows

Log Pipeline Workflows

Upcoming Classes

No classes have been scheduled, but you can always Request a Quote.


You can get your log data into Elasticsearch exactly how you want it, regardless of your ecosystem’s complexity. This instructor-led course provides a solid understanding of ingest node pipeline operations and error handling.
Note: This course is a module of the Logging specialization.


You’ll learn how to loop array values through the foreach processor, shuffle fields through the rename and remove processors, and set field values with hard-coded or dynamic values through the set processor. You will also learn how to handle failure on the processor level as well as on the pipeline level. After completing this course, you will be able develop your own powerful log pipelines.

Topics Covered

  • Introduction to Log Pipelines
  • Shuffling Fields with the rename/remove Processor
  • Looping with the foreach Processor
  • Assigning values with the set Processor
  • Error Handling with the fail Processor
Download Course Outline


2-3 hours


3 hours


Software Developers and Engineers, Data Architects, System Administrators, DevOps


We recommend you have taken Elasticsearch Engineer I and Elasticsearch Engineer II or possess equivalent knowledge. Engineer I and Engineer II teach the concepts that are the foundation upon which all specializations are built.

Setup Requirements

  • Stable internet connection
  • Mac, Linux, or Windows
  • Latest version of Chrome or Firefox (Safari is not 100% supported)
  • Due to virtual classroom JavaScript requirements, we recommend that you disable any ad-blockers and restart your browser before class.

Additional Notes

Virtual Classroom Information
This instructor-led course is only taught in a virtual classroom environment. We encourage participants to set up their systems prior to logging into the training environment the first day of the class. We also encourage being logged into the virtual classroom 15 minutes prior to the start of class each day.

Training Specializations

This course is a module of the Logging specialization. Find out how our focused Training Specializations can help you with your use case.

General Training Information
Have training questions? Review our FAQ or email us.