I am building a data source so I can convert a custom source to dataframe.
I have been going over examples such as JDBC and noticed that JDBC does the following:
and whenever a new record is added:
however, incRecordsRead is spark private.
I was wondering: how can I get standard metrics through a data source?