Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

mkuthan/example-spark

Open more actions menu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
33 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spark, Spark Streaming and Spark SQL unit testing strategies

Build Status Coverage Status

Features

  • ClockWrapper for efficient clock management in Spark Streaming jobs.
  • Base traits for testing Spark, Spark Streaming and Spark SQL to eliminate boilerplate code.
  • Sample applications to show how to make your code testable.
  • All tests can be run or debugged directly from IDE, or using SBT.
  • All test fixtures are prepared as in-memory data structures.
  • SBT is configured to avoid problems with multiple Spark contexts in the same JVM SPARK-2243.
  • SBT is configured to prepare project assembly for deployment on the cluster.

References

About

Spark, Spark Streaming and Spark SQL unit testing strategies

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages

Morty Proxy This is a proxified and sanitized view of the page, visit original site.