'2019/09/26'에 해당되는 글 1건

  1. 2019.09.26 YARN에 배포된 Spark 애플리케이션의 Application ID 얻기



How to get applicationId of Spark application deployed to YARN in ...


https://spark.apache.org/docs/2.3.0/api/java/org/apache/spark/SparkContext.html


applicationId

public String applicationId()
A unique identifier for the Spark application. Its format depends on the scheduler implementation. (i.e. in case of local spark app something like 'local-1433865536131' in case of YARN something like 'application_1433865536131_34483' in case of MESOS something like 'driver-20170926223339-0001' )




val appId = spark.sparkContext.applicationId


Posted by 김용환 '김용환'

댓글을 달아 주세요