Job Summary
Looking for a highly skilled Data Engineer with 6+ Years of strong expertise in Python and SQL, along with hands-on experience in DevOps and CI/CD practices. The role involves building scalable data pipelines, optimizing data systems, and enabling efficient data-driven solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Python and SQL.
- Build and optimize data ingestion and transformation frameworks for large datasets
- Develop robust solutions for data processing, validation, and quality assurance
- Implement CI/CD pipelines and DevOps practices for data engineering workflows
- Automate data pipelines, deployment, and monitoring processes
- Work with cross-functional teams to understand business requirements and deliver data solutions
- Troubleshoot and optimize performance of data pipelines and systems
Must-Have Skills
- Hands-on experience in Python and SQL
- Experience in data engineering concepts: ETL/ELT, data modeling, data warehousing
- Solid exposure to DevOps tools & practices (CI/CD, Git, Jenkins, Docker, etc.)
- Experience in building production-grade data pipelines
- Strong debugging, problem-solving, and optimization skills
Good to Have
- Experience with PySpark / Big Data technologies
- Exposure to cloud platforms.
- Knowledge of workflow orchestration tools (Airflow, etc.)
- Understanding of data governance and quality frameworks
Qualification:
- Bachelor’s degree in related field