​It will be good if we can discuss what task you want to accomplish based on that we can suggest you best practices what other partners are following to access large amount of data. You can write your comments in below.