Scala & Apache Spark Developer

We offer projects with a modern tech stack, flexible schedule and professional team. Open management and a friendly environment are part of our culture.

At CIGen we partner with both startups and experienced enterprises to help them achieve their business goals through software solutions. We are a Microsoft Gold partner.

Our company is driven by the core values that are professionalism, trust, and mutual respect.

We believe that the only way to achieve long-term business success is to build long-term trusted relationships with clients, employees, and partners.

Hence, the quality of our services is crucial!

Currently, we are looking to add a Scala & Apache Spark Developer to our team.

This position is full-time and could be fully remote.

Responsibilities:

• Designing, creating, and maintaining Spark/Scala-based applications
• Create Spark/Scala jobs for data transformation and aggregation
• Design data processing pipelines
• Participating in all architectural development tasks related to the application
• Writing an efficient code in accordance with the project requirements
• Collaborating with cross-functional teams & stakeholders

Requirements:

• At least 4+ years of commercial experience with Scala, Apache Spark & Big Data technologies
• Significant experience with big data ETL pipeline development with Spark and related technologies
• Solid understanding of performance tuning concepts for Apache Spark jobs and handling large data volumes data from various sources/formats
• Good experience with Scala testing frameworks & tools (ScalaTest, ScalaCheck, ScalaMock)
• Spark query tuning and performance optimization
• Experience with .NET/C#
• Experience with Azure Databricks
• Experience with SQL
• Strong analytical capabilities
• Comfortable with cloud systems and Azure Big Data services
• English: Upper intermediate. Good enough to take a technical interview and work in an English-speaking environment comfortably.

Would be a plus:

• Experience with Microservices Architecture
• Experience with Microsoft Azure
• Experience with ClickHouse
• Experience with Hadoop, HDFS, MapReduce
• Knowledge of Python
• English Advanced

About the project:

Its an outsource project for our long-time client from the USA. The product is a powerful and complex marketing software platform that blends data, technology, and analytics to drive accelerated results. It includes implementation of Big data and Machine learning technologies.

Current stage: some systems are under ongoing development, and some are just starting up.

Technology stack: ASP.NET Core, Entity Framework Core, React, Azure Databricks, Apache Spark.

We offer:

• An opportunity to be a part of an English-speaking multinational environment where you can share your expertise and gain new knowledge from colleagues from different countries
• An opportunity to work remotely or from our comfortable office in Lviv, Ukraine (equipped with EcoFlow & Starlink)
• Paid vacations, sick leaves, and national holidays
• Flexible working hours to support your work-life balance
• Interesting and challenging projects
• Endless possibilities for your professional growth and continuous support from management
• Transparent and open communications and processes

  
  Cozy, friendly, and fun atmosphere

  ...and much more!

  
  We look forward to hearing from you!