Are you a seasoned Data Engineering professional with a passion for leading innovative projects and driving data-driven solutions? Intelligent Debt Management (IDM) Group, South Africa’s foremost debt management company, is looking for a Data Engineering Lead to join our dynamic Digital Technology team in Cape Town.
Data Engineering Lead Job Overview
- Position: Data Engineering Lead
- Company: Intelligent Debt Management (IDM) Group
- Location: Cape Town, Western Cape
- Employment Type: Permanent
- Posted On: 02 August 2024
- Closing Date: 31 August 2024
About Intelligent Debt Management
Intelligent Debt Management (IDM) Group is South Africa’s leading debt management company, renowned for its award-winning services. IDM has consistently provided innovative solutions to help South Africans manage their debt effectively. As part of our continuous growth, we are seeking a talented Data Engineering Lead to join our dynamic team.
Data Engineering Lead Job Description
The Data Engineering Lead will be responsible for the design and implementation of data engineering projects on both on-premise and cloud-based platforms. This role involves leading a team, working closely with various stakeholders, and ensuring the integrity and security of data processes.
Key Responsibilities
- Leadership: Lead the design and implementation of scalable data solutions on the Microsoft Azure cloud platform, including Azure Databricks.
- Data Pipeline Management: Develop, maintain, and optimize robust data pipelines for data ingestion, processing, and transformation to support analytics, machine learning, and other data-driven services.
- Data Security: Ensure data security, quality, and integrity across all pipelines and related processes.
- Collaboration: Work closely with the Head of Data and enterprise architecture to align data engineering vision with systems architecture and data strategy.
- Stakeholder Engagement: Collaborate with data product owners, analysts, data scientists, and business stakeholders to understand data requirements and implement effective data workflows.
- Team Support: Assist in data initiatives and support technical teams, including architects, software developers, and data scientists.
- Mentorship: Provide leadership and mentoring to a small, skilled team of data engineers.
Requirements
- Educational Background: Bachelor’s degree in Computer Science, Engineering, or a related field. Certifications in Azure, Azure Databricks Data Engineering, or equivalent practical experience.
- Professional Experience:
- Extensive experience as a data engineer or similar role.
- Proven experience designing and implementing data architectures, data integration, and ETL processes.
- Practical experience in Azure, Azure Data Factory, and Azure Databricks.
- Proficient in Python/PySpark and SQL/SparkSQL programming.
- At least 4 years of experience in Information Technology, specifically in data management.
- Technical Skills:
- Strong knowledge of data management and storage solutions, including SQL Server Database and Azure Data Lake Storage.
- Ability to lead and innovate in a fast-paced and evolving technology landscape.
- Soft Skills:
- Strong communication and leadership abilities.
- Excellent attention to detail and problem-solving skills related to data, data structures, and algorithms.
What’s In It For You?
- Growth Opportunities: Being part of South Africa’s largest company in its field, IDM offers vast opportunities for professional growth. We emphasize the development of our people through internal learning opportunities and support from leaders who are experts in their fields.
- Company Culture: Our culture promotes collaboration, diversity, and helpfulness, both within our team and in our client interactions. Employees at IDM feel valued and listened to, irrespective of their rank.
- Making a Difference: Working at IDM allows you to make a real difference in the lives of South Africans by helping them navigate tough financial situations. Our employees find great satisfaction in knowing their work has a positive impact.
Employee Benefits
- Mental and physical health support through Healthy Together campaigns.
- Various rewards and recognition for hard work.
- Benefits like a half day off on your birthday, medical aid, retirement annuity, and further study opportunities.
- Opportunities for career growth, with access to move both upwards or across the business.
How to Apply
If you meet the above qualifications and are ready to lead a talented team at IDM, we encourage you to apply.
Click on the link to apply: Apply Here
Intelligent Debt Management (IDM) Group offers an unparalleled opportunity for a Data Engineering Lead to advance their career while making a tangible difference in the lives of South Africans. With a culture that fosters growth, collaboration, and innovation, IDM is the ideal environment for professionals seeking to lead in a dynamic and supportive setting. If you possess the skills and experience outlined and are eager to contribute to a company that values its people and their development, we encourage you to apply.
Recommended for you Free CV Templates that Pass the Applicant Tracking System