Skip to content

How to use spark testing base in spark java application. Feel free to make changes.

Notifications You must be signed in to change notification settings

rahulray11/Spark-Java-Application

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🚀 Spark-Java-Application

Welcome to the Spark Java Application repository! This project is designed as a learning resource for developers looking to understand Spark Testing in Java, with a focus on unit testing and mocking real-time data sources. Perfect for beginners and seasoned developers alike, this project tackles the common challenge of testing private methods in Spark applications.


🛠️ Key Features

  • Spark Testing Base Integration: Learn how to seamlessly set up and write unit tests for your Spark applications.
  • Testing Private Methods: Gain insights on how to handle and test private methods within your Java classes.
  • Real-time Data Mocking: Explore how to use Mockito to simulate real-time data from sources like Snowflake, Cassandra, and SQL.

🌟 Why This Project?

As a beginner in Spark, I encountered issues while setting up tests, especially when it came to testing private methods. This repository was created to help developers facing similar challenges. If you’re also learning or have expertise in this area, feel free to explore, modify, and contribute!


⚠️ Error Encountered

I'm currently facing an issue with calling private methods in test classes using Spark Testing Base. If you're familiar with Spark and unit testing best practices, your insights or contributions would be highly appreciated!


🎯 Goals

This project is intended to:

  1. Help developers understand the basics of Spark Testing Base.
  2. Demonstrate mocking techniques for testing real-time data in Spark applications.
  3. Provide examples on how to test private methods in Spark Java applications.

Contributions and feedback are always welcome! Feel free to open issues or pull requests if you have suggestions or improvements. Let's make Spark testing simpler for everyone! 🎉

Releases

No releases published

Packages

No packages published

Languages