APPLICATION DEVELOPER
The future is our choice At Atos, as the global leader in secure and decarbonized digital, our purpose is to help design the future of the information space. Together we bring the diversity of our people’s skills and backgrounds to make the right choices with our clients, for our company and for our own futures.
Position : GCP Big Query Data Engineer
Location: Nashville, TN / Remote
Type: Fulltime
Salary range: $80K - 90K (Depend upon experience)
Job Decription
o 7+ Years of Experience preferred
o Experience in creating ETL pipeline using dataflow & Bigquery, Experience to create best performing tables with partitioning/clustering etc enabled keeping best practices in mind
o Write Complex SQL queries keeping execution cost in mind.
o Hands-on with DAG using YAML or Airflow (Python)
o Knowledge of Cloud Composer
o Load data into BigQuery using files or by streaming one record at a time .
o Create, load, and query partitioned tables for daily batch processing data.
o Implement fine-grained access control using roles and authorized views.
o Should have in-depth understanding of Bigquery architecture, table partitioning, clustering, best practices.
o Should know how to reduce BigQuery costs by reducing the amount of data processed by your queries.
o Should be able to speed up queries by using denormalized data structures, with or without nested repeated fields.
o Exploring and Preparing data using BigQuery.
o Implementing ETL jobs using Bigquery.
o Knowledge of Python
Apply To This Job