The role

As a Data Engineering Manager, you will play a key role in designing, implementing, and managing robust data pipelines and infrastructure that power our data-driven initiatives.

This role is responsible for: 

• Leading and mentoring a team of data engineers, fostering a collaborative and high-performing culture.

• Designing, developing, and maintaining low-latency data pipelines using Apache Spark and Scala, while ensuring data accuracy, reliability, and efficiency.

• Implementing and optimizing Spark structured streaming to process real-time data and support timely business insights.

• Optimizing SQL queries and design data structures in data lakes and warehouses to improve overall performance and query efficiency.

• Fostering cost-consciousness and creative problem-solving in the team to optimize cloud-based solutions and reduce operational expenses.

• Utilizing your expertise in AWS cloud services and technologies to architect and build robust data solutions on the cloud platform.

• Leading the successful delivery of non-trivial data products and services, ensuring high-quality standards across all aspects of development and deployment.

• Collaborating with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to understand data requirements and deliver data solutions aligned with business goals.

• Staying updated with the latest industry trends and best practices, sharing knowledge and encouraging the team to continuously improve their skills.

• Fostering a passion for data engineering and our company's mission, instilling a culture of quality, open communication, and continuous learning.

You bring

• Expert Career (10+ Years)

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

• Proven experience in designing and implementing low-latency data pipelines using Spark structured streaming.

• Solid understanding of optimizing SQL queries and experience with data lake and data warehouse design.

• Proficiency in AWS cloud services and technologies, with a track record of building scalable solutions on the cloud platform.

• Prior experience managing and leading a team of data engineers or related roles.

• Demonstrated ability to build and deliver non-trivial data products and services.

• A passion for technology and data, with a strong emphasis on quality and continuous improvement.

• Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.

• A desire to keep growing your skills, and an ability to learn quickly. We hire for slope, not just y-intercept.