Data Engineer Opportunity - Join an Exciting Team! Are you an experienced Data Engineer looking to make an impact? We’re searching for a talented professional to help shape the future of data systems at a forward-thinking and flexible organization. If you’re passionate about data architecture, cloud solutions, and building scalable systems, this could be the role for you!
Company Our client is a dynamic and innovative company with a clear mission: empowering people with tailored insurance solutions. Using cutting-edge technology and a customer-focused approach, they’ve built a reputation for delivering personalized, high-quality service.
Responsibilities As a Data Engineer, you’ll play a crucial role in designing and maintaining cutting-edge data systems. Key duties include:
*Building custom data systems for collecting, processing, and provisioning data from various sources.
*Developing and managing Terraform modules for scalable, secure infrastructure.
*Collaborating with DevOps to integrate CI/CD pipelines.
*Assisting with integrating data solutions into existing workflows, including Airflow and DBT pipelines.
*Supporting stakeholders like data scientists and analysts to deliver high-impact data products.
Experience Needed We’re seeking candidates with the following skills and experience:
Must-Haves:
*Strong Python skills (including OOP, asynchronous programming, and Docker).
*Advanced SQL knowledge for building complex queries and optimizing ETL/ELT pipelines.
*Practical experience with Terraform for Infrastructure as Code, especially on Azure.
*Deep understanding of structured and unstructured data, including streaming/batch data.
Nice-to-Haves:
*Familiarity with DBT, Airflow, Delta Tables, or Kafka.
*Experience with Azure Data Lake Storage or similar distributed systems.
*Knowledge of machine learning and AI-related data applications.