Job Details

Email to Friend Save Back

Sr Data Engineer

CHICAGO-60619, IL, US
09/13/2021

-

Required Skills

MySQL, Python

Company

Cloudious

Experience

Job Description

Design and build cloud-based data lakes and data warehouses.

Design and build Data Pipelines to collect, transform, store, analyze, explore and visualize.

Work with the product team to understand data sources, use cases and data models.

Choose the right technology stack to align with the use cases and scalability.

Collaborate with the other team members across different teams.

Develop alert & monitoring systems and procedures for faster disaster recovery.

Provide technical directions and mentor other engineers Qualifications

BA/BS degree in Computer Science, similar technical field of study or equivalent practical experience.

Working experience in building data warehouses and data lakes.

5+ years of experience in working with relational databases such as MySQL, Postgres etc.

2+ years of experience in NoSQL databases like Bigtable, Cassandra, HBase etc.

Expert level SQL skills and database performance concepts.

Experience in relational and dimensional data modeling.

Experience with developing extract-transform-load (ETL).

Understanding of distributed computing frameworks like Apache Spark and Flink.

Experience in Software Development in Java or Python Should be able to communicate and articulate his/her thought process effectively with the other team members.

Preferred Qualifications

Experience building data warehouse, data lake and data pipeline using Google Cloud Platform (GCP) Experience with large scale distributed systems with large datasets.

Experience in distributed computing framework Hadoop, Spark, Flink or Storm Experience with messaging systems like Kafka and RabbitMQ Basic understanding of machine learning concepts and lifecycle.

Knowledge of advertising platforms.