val s3a = new org.apache.hadoop.fs.s3a.S3AFileSystem
val s3aName = s3a.getClass.getName
val rdd = sc.parallelize(Seq("one", "two", "three", "four"))
println("rdd is: " + rdd.collect())
Although, I am able to write rdd on s3 with AES256 encryption but failing
Does spark/hadoop have a different value for KMS key encryption instead of
"SSE-KMS" or it doesn't support SSE-KMS encryption on AWS S3?
I found in the official document of hadoop that it only supports AES256 as
<property> <name>fs.s3n.server-side-encryption-algorithm</name> <value></value> <description>Specify a server-side encryption algorithm for S3.
The default is NULL, and the only other currently allowable value is
Can anyone please suggest what I am missing here or doing wrong?
My environment details as follow: