Logback + Spark 2.2.0

Previous Topic Next Topic
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Logback + Spark 2.2.0

Sara Galindo Martínez


I am currently working on a Scala project which has defined a logback.xml file in order to write the logs generated by the application in a specific file and console. I am packaging the project using Maven and executing it using spark-submit, however the output log file is not generated. Is there any kind of configuration parameter to be considered in this case? Is there any difference between creating the jar using sbt assembly and mvn package? I have followed different approaches that I have found on the Internet such as https://stackoverflow.com/questions/42126107/separating-application-logs-in-logback-from-spark-logs-in-log4j/45480145#45480145, but none of them worked. Any suggestion about what is happening?

Thanks in advance,

Sara Galindo.

DISCLAIMER: Aquest missatge pot contenir informació confidencial. Si vostè no n'és el destinatari, si us plau, esborri'l i faci'ns-ho saber immediatament a la següent adreça: [hidden email] Si el destinatari d'aquest missatge no consent la utilització del correu electrònic via Internet i la gravació de missatges, li preguem que ens ho comuniqui immediatament.

DISCLAIMER: Este mensaje puede contener información confidencial. Si usted no es el destinatario del mensaje, por favor bórrelo y notifíquenoslo inmediatamente a la siguiente dirección: [hidden email] Si el destinatario de este mensaje no consintiera la utilización del correo electrónico vía Internet y la grabación de los mensajes, rogamos lo ponga en nuestro conocimiento de forma inmediata.

DISCLAIMER: Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message you should destroy this message, and notify us immediately to the following address: [hidden email]. If the addressee of this message does not consent to the use of Internet e-mail and message recording, please notify us immediately.