Job Description

We are hiring a Lead Data Engineer Remote for one of our clients.

Job Description:

• Develop and enhance ETL pipelines used by UDP platform
• Contribute to the implementation of key requirements as defined in Phase 1 discovery.
• Automate implemented requirements as appropriate, including infrastructure as code and runbooks.
• Document processes and standard operating procedures.
• Ensure the platform meets defined requirements.

Skills/Technology Needed:

• Experienced with Python, PySpark and SQL
• Automation and CI/CD skills, unit and integration testing
• Familiarity with orchestration and ETL solutions
• Hands-on experience with AWS Services (Redshift, Glue, LakeFormation, Lambda)
• Understanding of AWS Least Privilege Security Model and AWS Security Model (IAM)
• Experience with Microsoft Office (Word, Excel, Powerpoint)
• Experience with handling data in Open Table formats (Iceberg, Parquet, Delta Format). Big Data Handling Understanding of such as Buckets and Partitioning
• (Lead) Understanding of PySpark, Glue job optimization techniques to improve operations.

Additional information:

• Location: Remote
• Job Type: Contract
• Duration: 4 Months
• Interview process: 3 interviews.

About Us:

We are specialized in recruiting and deliver the best professional talent of industry and we are committed to deliver best experience for our clients and job seekers. With over two decades of experience in the recruitment industry, we proudly help you to find the next job that matches your professional skills. Our team understands your needs or requirement before starting the recruitment, that enables to find the high quality of talent with high success rate of talent delivery, keeps us continue to be the best in the industry. By responding to this job posting, you are consenting to receive text/SMS messages from us. Thank you.

Job Tags

Similar Jobs