HN2new | past | comments | ask | show | jobs | submitlogin

Will the DataFrame API work with Spark Streaming?


There are some ways you can integrate the two. E.g. Streaming allows you to apply arbitrary RDD transformations, and thus you can pass a physical plan generated by DataFrame into streaming.

We will work on better integration in the future too.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: