Yarn-AM-资源不足异常
Application is added to the scheduler and is not yet activated. Queue's AM resource limit exceeded. Details : AM Partition = 3ssystem; AM Resource Request = <memory:4096, vCores:1>; Queue Resource Limit for AM = <memory:6144, vCores:3>; User AM Resource Limit of the queue = <memory:6144, vCores:3>; Queue AM Resource Usage = <memory:4096, vCores:1>;
That your drivers have exceeded max memory configured in Max Application Master Resources. You can either increase max memory for AM or decrease driver memory in your jobs.
- 解决方案1:调整yarn.scheduler.capacity.maximum-am-resource-percent
<property>
<!-- Maximum resources to allocate to application masters
If this is too high application masters can crowd out actual work -->
<name>yarn.scheduler.capacity.maximum-am-resource-percent</name>
<value>0.6</value>
</property>
- 解决方案2:decrease driver memory in your jobs.