As per Cloudera, Ambari is a completely open source management platform for provisioning, managing, monitoring, and securing Apache Hadoop clusters. Apache Ambari takes the guesswork out of operating Hadoop. But one issue which every user encounters while working on Ambari is it doesn’t provide job level alerts. So, while working in a Prod Hadoop cluster some jobs may run more than the expected time or request for resources more than the threshold. If there are numerous jobs, then it becomes challenging to find the specific job which is causing the resource crunch. User may have to go through each job to identify the root cause.

This issue can be addressed with the use of custom code and call the rest API’s provided by Yarn. Below is the sample simple code makes use of yarn-rest api to get the job details. You can further customize your code to get the resources allocated and other details.

#yarn #cloudera #cloud-computing #alerts #hadoop #cloud