Data Engineer (Azure / Databricks / Python)
Two Circles is a Sports & Entertainment Marketing business that helps clients grow audiences and revenues by understanding fan behavior. They are seeking a Data Engineer to join their team, responsible for designing, building, and optimizing scalable data solutions to enhance their Audience Intelligence Platform.
Responsibilities
- Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python
- Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines
- Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value
- Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards
- Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation
Skills
- Experience in designing, building, and testing solutions within a data lakehouse environment
- Proficiency in Python and PySpark for data processing and analytics
- Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps
- Familiarity with CI/CD pipelines using Azure DevOps or similar tools
- Ability to work within established development frameworks and adhere to coding standards
- Excellent communication skills, with an ability to articulate blockers and timelines to non-technical stakeholders
- Strong teamwork skills, with a collaborative mindset and desire to learn from others
- Strong SQL skills for querying and managing data
- A proactive attitude with a passion for continuous learning and growth
- High attention to detail and commitment to delivering quality work
- Comfortable working in a fast-paced environment, with the ability to estimate tasks and deliver incremental value effectively
Company Overview