Monday, November 28, 2016

Spark deployment error and solution

error : Application application_1 failed 2 times due to AM Container for appattempt_2 exited with exitCode: 15

Spark submit command I used :
./bin/spark-submit  --class com.saitech.stockmain --master yarn --deploy-mode cluster \
     --driver-memory 1g \
    --executor-memory 1g \
    --executor-cores 2 \
/home/gobisubramani/jar/StockApp-0.0.1-SNAPSHOT.jar

in the main method
  val sparkConf = new SparkConf()
   .setMaster("yarn")
        .setAppName("my stock app")
       

In the main method also I have mentioned my Master, I just removed it . Now I am not getting that error.

  val sparkConf = new SparkConf().setAppName("my stock app")

    However I would recommand to take logs to analyse the issue


Note: I'll update this blog as soon as I come across any deployment issue 

No comments:

Post a Comment