Spark Structured Streaming handles compressed files

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Spark Structured Streaming handles compressed files

Lian Jiang
We have jsonl files each of which is compressed as gz file. Is it possible to make SSS to handle such files? Appreciate any help!
Reply | Threaded
Open this post in threaded view
|

Re: Spark Structured Streaming handles compressed files

Lian Jiang
Any clue? Thanks.

On Wed, Oct 31, 2018 at 8:29 PM Lian Jiang <[hidden email]> wrote:
We have jsonl files each of which is compressed as gz file. Is it possible to make SSS to handle such files? Appreciate any help!