What I learnt from teaching ELK stack in a Workshop?

Today, I trained a mixed group of students about doing real time bigdata analysis in 4ccon, Chennai.



As the Bigdata is one of the trending words on the IT field, got around 40 participants.

The participants are from Electrical, CSE departments and few working professionals.

Though we asked everyone to bring the laptop with ELK stack preinstalled, many spot registered participants, did not get the laptop or installed anything.

Thats fine. I had one full day. We can do the installations in one hour.

There were many unexpected issues.

1. Windows laptops

I never thought that people will come with windows laptops. I did not know that ELK stack can run in windows, till I see the windows laptops.

I left windows some 10 years ago. Dont know the basic stuff to do on it. Fortunately, Mr. Sivarama selvan, from NIC, got the packages for windows and demonstrated the following

1. Installing Java
2. Setting the JAVA_HOME and path
3. Invoking logstash with a sample configuration file

Without him, I would felt hopeless. Thanks a lot sir.

2. Poor Internet

Though the college provided WiFI to all the rooms, we got very poor connectivity. Connection speed was too low. The ubuntu and redhat users lost their patients to get installed these packages from repositories.

After some time, I asked them to login to my laptop and explore the commands and use my elasticsearch and kibana to connect from chrome plugins (Elasticsearch tool box, postman). As the wifi was poor, they had to wait for a long time to check even small stuff.

3. Windows Users behaviors

Our mixed stilled participants found very tough to work with the Command Prompt in windows. Many saw it for the first time. So, traversing through various directories itself very tough. Had to teach the very basic commands like cd, dir etc. Never thought that I will be teaching MS Dos commands in the ELK workshop.

We provided Zip files for logstash, elasticsearch and kibana with sample configuration files in another zip file for logstash, Elasticsearch.

The icon for Zip file and a folder seems similar in Windows. On double clicking any zip file, it opens just like a folder. People started to double clicked the Zip file and edited the config files. When they tried to access those files from command prompt, they can not reach those files. It took much time for me to find the issue and trained them on how to extract zip files. 😦

4. Editing Files

Some opened the sample logstash config file in notepad. It showed everything in a single line. Changing some values were tough.

Some opened in MS word and save as docx files.

Some found difficulties on finding a file path to give in this sample config file.

5. curl for windows

As curl is the main tool to interact with elasticsearch, dont know how people can practise in windows without curl. Found curl for windows. Again, downloading with poor Internet, teaching how to install and how to use in command prompt was tough for me. So, missed this part. Asked people to use chrome plugins like sense, elasticseach toolbox. With these plugins, people can index only few data. They cant do bulk import of data.

6. ELK versions

Someone installed a mixed versions of ELK stack. it did not worked as I displayed on my laptop. After a deep troubleshooting session, found the version issue and installed the latest version as on my laptop.

Finally, got some handson learning.

With more than 50% of time, spent of fixing these issues, managed to explain the ELK stack. Demonstrated how to read a CSV file using logstash. Displayed the data in screen and sent to elasticsearch. Then, explained Elasticsearch. Demonstrated indexing data, importing bulk data, search, and delete. Then, explored kibana. Asked them to create visualizations and dashboards. They did it with huge interest.
Then, demonstrated how we can get data from twitter stream and analyse in kibana.

Participants are happy to get some handson with the ELK stack.

Used the following links.

Config files, sample data = https://github.com/tshrinivasan/elk-training




sample config files.


Here are my learnings:

1. Never expect internet connection.

Find a solution to setup a quick local intranet. Always go with a Wifi router. So that all VNC, SSH, web servers, file transfer can be easy and fast.

Get some portable packages for GNU/Linux too.

Always be prepared to run the workshop without internet.

2. Learn few Windows stuff and have software for windows too.

It is not good to ignore the windows users. When they come forward to learn something, we have to be prepared to teach them too.

Have a copy of ELK Zip files, curl, putty, VNC, Java setup files, Notepad++ editor, Firefox/Chrome browser etc.

3. Prepare documentation and share to participants

Prepare a how to install/setup/example document and share with all. With this document, people can explore further once they go home. If possible, create video tutorials and share online and offline.

4. Software versions

Make sure the software you use on laptop and participants using are same. ELK stak is changing a lot on every release.

5. Know the audience

Mostly, we get mixed skilled audience. I assumed that they had the basic computer skills like extracting files, understanding file path and using command line. When they lack on this, we have to start training them on the basics.

This is my first training on ELK for public. Learnt tons of stuff on my preparation hours and on workshop. Thanks for the participants. With their patience and interest on learning, the day was successful. Thanks for 4ccon volunteers for the wonderful event.


Python Trainers wanted

JAGSOFT SOLUTIONS at velachery is looking for a Full time or Part time
Python Trainer.

Interested people can send their details to Jagsoftsolutions@gmail.com

No. 28/1, Nagendra Nagar,
Opp. Phoenix Market City,
Velachery Main Road,
Velachery, Chennai – 600 042.

9884920666 / 9884930666

See more at: http://jagsoftsolutions.com/

EmbedX – Embedded Systems Workshop using Arduino (Chennai)10th of December

Are you looking to Learn Embedded Systems in Chennai, Madurai or Coimbatore?

Get Trained Hands-On in Projects with our 2 days hands-on Workshop EmbedX

EmbedX is a 2 day introductory training course / workshop that demystifies and simplifies embedded systems and gets you programming microcontrollers and building projects on your own. The Workshop is designed around Arduino.

What is Arduino?

Arduino is a open-source prototyping platform that simplifies the process of getting to build projects on your own. With an increasing number of users, its becoming the platform of choice for students to get started with embedded systems. Its so simple to get things going that you would be up and doing your projects in no time.

Current Schedule

Saturday 10th December 2011, at Chennai
To register: http://www.simplelabs.co.in/events/signup?eventid=40

Duration: 2 Days

Fees for 1 Person in a team: 2783/-[Inclusive of Applicable Taxes + 1 Takeaway Kit]
Fees for 2 Persons in a team: 3886/-[Inclusive of Applicable Taxes + 1 Takeaway Kit]
Fees for 3 Persons in a team: 4889/-[Inclusive of Applicable Taxes + 1 Takeaway Kit]

Kit Contents
InduinoX [Arduino Atmega168 Clone Board], USB A-B Cable, IR Remote, 9V Battery, Battery Snapper, LCD Shield & 16x 2 LCD display

What does the Fee Cover?
The fee covers training costs and kit cost only. The fee does not include food, accommodation or local transport.
Course Contents – An overview of the Sessions


  • Introduction to Embedded Systems
  • Introduction to Microcontrollers & the Arduino Platform / Software Installation
  • InduinoX Board Overview
  • Getting your Hands Dirty With Programming – Simple Programs
  • Working with Digital I/O’s & Serial Communication
  • Building a Simple Project – LED Binary Counter
  • Working with Analog Outputs – Controlling RGB LEDS
  • Working with Analog Inputs – Sensors – LDR [Light Sensing]
  • Working with a LCD Display
  • Building a Simple Project – Automatic Lighting Level Controller


  • Working with Simple Wireless Communications – Working of IR Remote Controls
  • Intermediate Project – Interfacing an IR Remote to control – Controlling the Binary Counter
  • Advanced Project – Controlling the RGB LED’s Colors with the IR Remote Control
  • Fine Tuning the Project
  • Q &A Session

Simple Labs
First Floor
#40/140 Kanchi Natarajan Salai,
Ashok Nagar,
Chennai – 600 083
GPS Co-Ordinates
Check us on Google Maps
LAT – 13.029411 / LONG – 80.206219

Landline: +91 – 44 – 2371 2636
Mobile: +91 – 96771 80990


Simple Labs Facebook Page

Source: http://www.simplelabs.co.in/content/embedx-embedded-systems-workshop-using-arduino