Reading multiple files in Spark / which pattern to use

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Reading multiple files in Spark / which pattern to use

Marco Mistroni
hi all
 i have mutliple files stored in S3 in the following pattern

YYYY-MM-DD-securities.txt

I want to read multiple files at the same time..
I am attempting to use this pattern, for example

2016-01*securities.txt,2016-02*securities.txt,2016-03*securities.txt

But it does not seem to work....
Could anyone help out?

kind regards
 marco