Answer by cfregly · May 29, 2015 at 12:14 AM
Currently, there is no concrete Data Source Developer API guide. This will likely be coming in Spark 1.5 once the API is more stable.
In the meantime, you can review the following links:
Answer by anicolaspp · Feb 19, 2016 at 12:53 AM
@cfreglyI did this integration as a demo for a blog post few weeks ago. Even when my custom data source is super simple, the basics are the same. https://medium.com/@anicolaspp/extending-our-spark-sql-query-engine-5f4a088de986#.hy1n75ep5
Is Amazon AWS Redshift supported? 3 Answers
DynamoDB Data Source expected timeline 3 Answers