About the role
**Role:** Scala/Spark Developer Big Data **Location:** Whippany, Nj **Domain:** Banking / Trading Financial Services **Job Description** - Design and develop scalable data-processing applications using Scala and Apache Spark. - Build, maintain, and optimize large-scale data/ETL pipelines. - Work extensively with Hadoop ecosystem technologies, including Hive and Impala. - Develop complex SQL queries and data transformations. - Use Python for data processing, scripting, and automation. - Analyze performance bottlenecks and optimize Spark jobs for scalability and performance. - Perform data validation, troubleshooting, and production support. - Work with large volumes of structured and semi-structured financial data. - Collaborate with architects, analysts, and business teams to implement data solutions. **Required Skills:** **Spark, Scala, Hadoop (Hive/Impala), SQL, Python.** **Nice to Have:** Kafka, Airflow, Cloud platforms, CI/CD, Data Lake technologies. **Preferred:** Banking/Financial Services experience, particularly **Trading, Capital Markets, Tax, Risk, or Regulatory data** .
