Lead Data Engineer / Sr. Data Engineer
Experience: 7+ Years
Summary:
The Lead Data Engineer will design and implement data solutions that support the organization’s
strategic business goals.
Responsibilities:
• Focuses on data modelling, database design, performance optimization and ETL pipeline.
• Tests, monitors, manage and validate data warehouse activity including data extraction,
transformation, movement, loading, cleansing, and updating processes.
• Design and building simple (non - complex) reusable components of larger process or
framework to support analytics products with guidance from experienced peers
• Participate in design, code, test plans and dataset implementation performed by other data
engineers in support of maintaining data engineering standards
• Implement automated workflows and routines using workflow scheduling tools
Skills Needed:
• 5+ years’ experience developing Data & Analytic solutions
• Experience with data warehousing, Data Lake, analytic processes, and methodologies.
• Proficient experience with SQL queries functionality, Power BI, Tableau, Business Intelligence
software, and ETL tools.
• Strong knowledge of data integration, data quality and multi-dimensional design.
• Experience in Data Migration from on-premises databases to Cloud.
Knowledge with AWS/Azure/GCP data technologies is a plus.
• Knowledge of web services (e.g., SOAP and REST)
• Experience with scripting languages such as Shell, Python
• Experience of Big Data platforms, enabling non-technical users to gain insights
• Experience in big data tools like spark, pyspark,
• Hands on experience with modern data storage systems (e.g. S3, Snowflake, Athena, Glue)
• Experience with workflow scheduling tools such as Airflow
Added Advantage:
• Certifications on Snowflake, AWS /Azure/GCP