Sr. Data Engineer - Databricks/dbt
Job Summary We are seeking a highly skilled and motivated Sr. Data Engineer to join our dynamic team. The ideal candidate will have extensive experience developing on Databricks with a dbt transformation layer. Duties
- Work in all areas of Databricks including ingestion, transformations and data modeling within Azure Databricks.
- Create silver (transformation) and gold (mart) layer models using dbt on Databricks.
- Develop models in conformance with industry and customer standards
- Perform testing/QA on models to ensure accuracy and performance
- Work within the customer's CI/CD framework
- Troubleshoot complex technical issues and provide effective solutions.
- Document processes, technical specifications, and project updates for internal use.
- Support the finance and marketing teams or others as assigned.
- Migrate existing data sets from legacy systems into Databricks.
Experience
- Strong SQL, dbt and databricks skills
- 3+ Years of strong dbt experience including dbt core, dbt elementary, dbt loom
- Extensive experience calling REST APIs including performance tuning, pagination etc.
- Excellent problem-solving skills with a keen attention to detail.
- Strong interpersonal skills with the ability to communicate complex ideas clearly to diverse audiences.
- Experience being the key contributor/SME for a specific data set and reporting area
- Proven experience in a technical leadership role within the field of Data Analytics, Data Warehousing with a focus in dbt, Databricks and Power BI
- 6+ Years of Databricks/PySpark experience
- 10+ Years of software development with proficiency in SQL, Python, PySpark, GITHUB, VS Code
- A degree in Computer Science, Engineering, or a related field is preferred.
Type of Role: Contract Duration: 6 Months + possibility of extension Pay: $70.00 - $80.00 per hour Application Question(s):
- REST API programming
Experience:
- Python: 6 years (Required)
- SQL: 6 years (Required)
- Data analytics: 10 years (Required)
- dbt - Data Build Tool: 3 years (Required)
Work Location: Remote Apply tot his job Apply To this Job