Desired Experience
• You should have a bachelors or master’s degree in computer science, Information Technology or other quantitative fields
• You should have at least 5 years working as a data engineer in supporting large data transformation initiatives related to machine learning, with experience in building and optimizing pipelines and data sets
• Strong analytic skills related to working with unstructured datasets.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift, S3, Athena and familiarity with various log formats from AWS.
Key Skills
• Experience with object-oriented/object function scripting languages: Python, Pyspark, Java, C++, etc.
• Experience in, Dbeaver tool, AWS Glue ETL, AWS Crawler, AWS Lambda, Glue Data Catalog, AWS Glue Studio.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
Primary Qualification
Any
Additional Qualifications
Not Specified
Job Description
Designation:Data Engineer
RESPONSIBILITIES
Primary Responsibilities:
Additional Responsibilites:
CANDIDATE PROFILE
Min Experience:5
Max Experience:8
Work Experience Desired:• You should have a bachelors or master’s degree in computer science, Information Technology or other quantitative fields
• You should have at least 5 years working as a data engineer in supporting large data transformation initiatives related to machine learning, with experience in building and optimizing pipelines and data sets
• Strong analytic skills related to working with unstructured datasets.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift, S3, Athena and familiarity with various log formats from AWS.
Primary Skills:• Experience with object-oriented/object function scripting languages: Python, Pyspark, Java, C++, etc.
• Experience in, Dbeaver tool, AWS Glue ETL, AWS Crawler, AWS Lambda, Glue Data Catalog, AWS Glue Studio.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
Optional Skills:• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• You should be a good team player and committed for the success of team and overall project.
Additional Requirements:
Posted On
10-Jun-2024 03:36:15 PM
|
